00:00:00.000 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v22.11" build number 1008 00:00:00.000 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3675 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.107 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.107 The recommended git tool is: git 00:00:00.108 using credential 00000000-0000-0000-0000-000000000002 00:00:00.109 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.160 Fetching changes from the remote Git repository 00:00:00.163 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.204 Using shallow fetch with depth 1 00:00:00.204 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.204 > git --version # timeout=10 00:00:00.245 > git --version # 'git version 2.39.2' 00:00:00.245 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.270 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.270 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.320 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.330 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.341 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.341 > git config core.sparsecheckout # timeout=10 00:00:06.352 > git read-tree -mu HEAD # timeout=10 00:00:06.367 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.390 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.390 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.469 [Pipeline] Start of Pipeline 00:00:06.483 [Pipeline] library 00:00:06.484 Loading library shm_lib@master 00:00:06.484 Library shm_lib@master is cached. Copying from home. 00:00:06.502 [Pipeline] node 00:00:06.510 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.511 [Pipeline] { 00:00:06.519 [Pipeline] catchError 00:00:06.521 [Pipeline] { 00:00:06.530 [Pipeline] wrap 00:00:06.536 [Pipeline] { 00:00:06.541 [Pipeline] stage 00:00:06.542 [Pipeline] { (Prologue) 00:00:06.742 [Pipeline] sh 00:00:07.024 + logger -p user.info -t JENKINS-CI 00:00:07.042 [Pipeline] echo 00:00:07.044 Node: GP11 00:00:07.053 [Pipeline] sh 00:00:07.349 [Pipeline] setCustomBuildProperty 00:00:07.357 [Pipeline] echo 00:00:07.358 Cleanup processes 00:00:07.362 [Pipeline] sh 00:00:07.646 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.646 498641 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.659 [Pipeline] sh 00:00:07.946 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.946 ++ awk '{print $1}' 00:00:07.946 ++ grep -v 'sudo pgrep' 00:00:07.946 + sudo kill -9 00:00:07.946 + true 00:00:07.962 [Pipeline] cleanWs 00:00:07.972 [WS-CLEANUP] Deleting project workspace... 00:00:07.972 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.978 [WS-CLEANUP] done 00:00:07.982 [Pipeline] setCustomBuildProperty 00:00:07.995 [Pipeline] sh 00:00:08.280 + sudo git config --global --replace-all safe.directory '*' 00:00:08.370 [Pipeline] httpRequest 00:00:09.148 [Pipeline] echo 00:00:09.149 Sorcerer 10.211.164.20 is alive 00:00:09.158 [Pipeline] retry 00:00:09.160 [Pipeline] { 00:00:09.173 [Pipeline] httpRequest 00:00:09.177 HttpMethod: GET 00:00:09.178 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.178 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.203 Response Code: HTTP/1.1 200 OK 00:00:09.203 Success: Status code 200 is in the accepted range: 200,404 00:00:09.203 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:17.990 [Pipeline] } 00:00:18.008 [Pipeline] // retry 00:00:18.015 [Pipeline] sh 00:00:18.303 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:18.321 [Pipeline] httpRequest 00:00:18.712 [Pipeline] echo 00:00:18.713 Sorcerer 10.211.164.20 is alive 00:00:18.723 [Pipeline] retry 00:00:18.725 [Pipeline] { 00:00:18.738 [Pipeline] httpRequest 00:00:18.743 HttpMethod: GET 00:00:18.744 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:18.744 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:18.757 Response Code: HTTP/1.1 200 OK 00:00:18.757 Success: Status code 200 is in the accepted range: 200,404 00:00:18.757 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:18.990 [Pipeline] } 00:01:19.007 [Pipeline] // retry 00:01:19.014 [Pipeline] sh 00:01:19.302 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:21.849 [Pipeline] sh 00:01:22.136 + git -C spdk log --oneline -n5 00:01:22.136 c13c99a5e test: Various fixes for Fedora40 00:01:22.136 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:22.136 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:22.136 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:22.136 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:22.159 [Pipeline] withCredentials 00:01:22.171 > git --version # timeout=10 00:01:22.184 > git --version # 'git version 2.39.2' 00:01:22.203 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:01:22.206 [Pipeline] { 00:01:22.216 [Pipeline] retry 00:01:22.218 [Pipeline] { 00:01:22.236 [Pipeline] sh 00:01:22.528 + git ls-remote http://dpdk.org/git/dpdk-stable v22.11.4 00:01:22.543 [Pipeline] } 00:01:22.560 [Pipeline] // retry 00:01:22.564 [Pipeline] } 00:01:22.576 [Pipeline] // withCredentials 00:01:22.584 [Pipeline] httpRequest 00:01:22.966 [Pipeline] echo 00:01:22.968 Sorcerer 10.211.164.20 is alive 00:01:22.980 [Pipeline] retry 00:01:22.982 [Pipeline] { 00:01:22.998 [Pipeline] httpRequest 00:01:23.003 HttpMethod: GET 00:01:23.004 URL: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:23.004 Sending request to url: http://10.211.164.20/packages/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:23.019 Response Code: HTTP/1.1 200 OK 00:01:23.019 Success: Status code 200 is in the accepted range: 200,404 00:01:23.020 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:29.671 [Pipeline] } 00:01:29.690 [Pipeline] // retry 00:01:29.698 [Pipeline] sh 00:01:29.992 + tar --no-same-owner -xf dpdk_fee0f13c213d0584f0c42a51d0e0625d99a0b2f1.tar.gz 00:01:31.384 [Pipeline] sh 00:01:31.674 + git -C dpdk log --oneline -n5 00:01:31.674 caf0f5d395 version: 22.11.4 00:01:31.674 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:31.674 dc9c799c7d vhost: fix missing spinlock unlock 00:01:31.674 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:31.674 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:31.685 [Pipeline] } 00:01:31.699 [Pipeline] // stage 00:01:31.708 [Pipeline] stage 00:01:31.711 [Pipeline] { (Prepare) 00:01:31.732 [Pipeline] writeFile 00:01:31.748 [Pipeline] sh 00:01:32.037 + logger -p user.info -t JENKINS-CI 00:01:32.051 [Pipeline] sh 00:01:32.340 + logger -p user.info -t JENKINS-CI 00:01:32.354 [Pipeline] sh 00:01:32.643 + cat autorun-spdk.conf 00:01:32.643 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:32.643 SPDK_TEST_NVMF=1 00:01:32.643 SPDK_TEST_NVME_CLI=1 00:01:32.643 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:32.643 SPDK_TEST_NVMF_NICS=e810 00:01:32.643 SPDK_TEST_VFIOUSER=1 00:01:32.643 SPDK_RUN_UBSAN=1 00:01:32.643 NET_TYPE=phy 00:01:32.643 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:32.643 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:32.652 RUN_NIGHTLY=1 00:01:32.657 [Pipeline] readFile 00:01:32.683 [Pipeline] withEnv 00:01:32.685 [Pipeline] { 00:01:32.699 [Pipeline] sh 00:01:32.988 + set -ex 00:01:32.988 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:32.988 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:32.988 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:32.988 ++ SPDK_TEST_NVMF=1 00:01:32.988 ++ SPDK_TEST_NVME_CLI=1 00:01:32.988 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:32.988 ++ SPDK_TEST_NVMF_NICS=e810 00:01:32.988 ++ SPDK_TEST_VFIOUSER=1 00:01:32.988 ++ SPDK_RUN_UBSAN=1 00:01:32.988 ++ NET_TYPE=phy 00:01:32.988 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:32.988 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:32.988 ++ RUN_NIGHTLY=1 00:01:32.988 + case $SPDK_TEST_NVMF_NICS in 00:01:32.988 + DRIVERS=ice 00:01:32.988 + [[ tcp == \r\d\m\a ]] 00:01:32.988 + [[ -n ice ]] 00:01:32.988 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:32.988 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:32.988 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:32.988 rmmod: ERROR: Module irdma is not currently loaded 00:01:32.988 rmmod: ERROR: Module i40iw is not currently loaded 00:01:32.988 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:32.988 + true 00:01:32.988 + for D in $DRIVERS 00:01:32.988 + sudo modprobe ice 00:01:32.988 + exit 0 00:01:32.998 [Pipeline] } 00:01:33.014 [Pipeline] // withEnv 00:01:33.019 [Pipeline] } 00:01:33.033 [Pipeline] // stage 00:01:33.043 [Pipeline] catchError 00:01:33.045 [Pipeline] { 00:01:33.060 [Pipeline] timeout 00:01:33.060 Timeout set to expire in 1 hr 0 min 00:01:33.062 [Pipeline] { 00:01:33.077 [Pipeline] stage 00:01:33.079 [Pipeline] { (Tests) 00:01:33.099 [Pipeline] sh 00:01:33.397 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:33.397 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:33.397 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:33.397 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:33.397 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:33.397 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:33.397 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:33.397 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:33.397 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:33.397 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:33.397 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:33.397 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:33.397 + source /etc/os-release 00:01:33.397 ++ NAME='Fedora Linux' 00:01:33.397 ++ VERSION='39 (Cloud Edition)' 00:01:33.397 ++ ID=fedora 00:01:33.397 ++ VERSION_ID=39 00:01:33.397 ++ VERSION_CODENAME= 00:01:33.397 ++ PLATFORM_ID=platform:f39 00:01:33.397 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:33.397 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:33.397 ++ LOGO=fedora-logo-icon 00:01:33.397 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:33.397 ++ HOME_URL=https://fedoraproject.org/ 00:01:33.397 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:33.397 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:33.397 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:33.397 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:33.397 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:33.397 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:33.397 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:33.397 ++ SUPPORT_END=2024-11-12 00:01:33.397 ++ VARIANT='Cloud Edition' 00:01:33.397 ++ VARIANT_ID=cloud 00:01:33.397 + uname -a 00:01:33.397 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:33.397 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:34.339 Hugepages 00:01:34.339 node hugesize free / total 00:01:34.339 node0 1048576kB 0 / 0 00:01:34.339 node0 2048kB 0 / 0 00:01:34.339 node1 1048576kB 0 / 0 00:01:34.339 node1 2048kB 0 / 0 00:01:34.339 00:01:34.339 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:34.339 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:34.339 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:34.339 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:34.600 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:34.600 + rm -f /tmp/spdk-ld-path 00:01:34.600 + source autorun-spdk.conf 00:01:34.600 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:34.600 ++ SPDK_TEST_NVMF=1 00:01:34.600 ++ SPDK_TEST_NVME_CLI=1 00:01:34.600 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:34.600 ++ SPDK_TEST_NVMF_NICS=e810 00:01:34.600 ++ SPDK_TEST_VFIOUSER=1 00:01:34.600 ++ SPDK_RUN_UBSAN=1 00:01:34.600 ++ NET_TYPE=phy 00:01:34.600 ++ SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:34.600 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:34.600 ++ RUN_NIGHTLY=1 00:01:34.600 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:34.600 + [[ -n '' ]] 00:01:34.600 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:34.600 + for M in /var/spdk/build-*-manifest.txt 00:01:34.600 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:34.600 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:34.600 + for M in /var/spdk/build-*-manifest.txt 00:01:34.600 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:34.600 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:34.600 + for M in /var/spdk/build-*-manifest.txt 00:01:34.600 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:34.600 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:34.600 ++ uname 00:01:34.600 + [[ Linux == \L\i\n\u\x ]] 00:01:34.600 + sudo dmesg -T 00:01:34.600 + sudo dmesg --clear 00:01:34.600 + dmesg_pid=499356 00:01:34.600 + [[ Fedora Linux == FreeBSD ]] 00:01:34.600 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:34.600 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:34.600 + sudo dmesg -Tw 00:01:34.600 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:34.600 + [[ -x /usr/src/fio-static/fio ]] 00:01:34.600 + export FIO_BIN=/usr/src/fio-static/fio 00:01:34.600 + FIO_BIN=/usr/src/fio-static/fio 00:01:34.600 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:34.600 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:34.600 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:34.600 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:34.600 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:34.600 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:34.600 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:34.600 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:34.600 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:34.600 Test configuration: 00:01:34.600 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:34.600 SPDK_TEST_NVMF=1 00:01:34.600 SPDK_TEST_NVME_CLI=1 00:01:34.600 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:34.600 SPDK_TEST_NVMF_NICS=e810 00:01:34.600 SPDK_TEST_VFIOUSER=1 00:01:34.600 SPDK_RUN_UBSAN=1 00:01:34.600 NET_TYPE=phy 00:01:34.600 SPDK_TEST_NATIVE_DPDK=v22.11.4 00:01:34.600 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:34.600 RUN_NIGHTLY=1 14:56:34 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:34.600 14:56:34 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:34.600 14:56:34 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:34.600 14:56:34 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:34.600 14:56:34 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:34.600 14:56:34 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.600 14:56:34 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.600 14:56:34 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.600 14:56:34 -- paths/export.sh@5 -- $ export PATH 00:01:34.600 14:56:34 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:34.600 14:56:34 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:34.600 14:56:34 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:34.600 14:56:34 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732802194.XXXXXX 00:01:34.600 14:56:34 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732802194.ZMb22G 00:01:34.600 14:56:34 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:34.601 14:56:34 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:34.601 14:56:34 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:34.601 14:56:34 -- common/autotest_common.sh@10 -- $ set +x 00:01:34.601 14:56:34 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:34.601 14:56:34 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:34.601 14:56:34 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:34.601 14:56:34 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:34.601 14:56:34 -- spdk/autobuild.sh@16 -- $ date -u 00:01:34.601 Thu Nov 28 01:56:34 PM UTC 2024 00:01:34.601 14:56:34 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:34.601 LTS-67-gc13c99a5e 00:01:34.601 14:56:34 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:34.601 14:56:34 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:34.601 14:56:34 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:34.601 14:56:34 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:34.601 14:56:34 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:34.601 14:56:34 -- common/autotest_common.sh@10 -- $ set +x 00:01:34.601 ************************************ 00:01:34.601 START TEST ubsan 00:01:34.601 ************************************ 00:01:34.601 14:56:34 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:34.601 using ubsan 00:01:34.601 00:01:34.601 real 0m0.000s 00:01:34.601 user 0m0.000s 00:01:34.601 sys 0m0.000s 00:01:34.601 14:56:34 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:34.601 14:56:34 -- common/autotest_common.sh@10 -- $ set +x 00:01:34.601 ************************************ 00:01:34.601 END TEST ubsan 00:01:34.601 ************************************ 00:01:34.601 14:56:34 -- spdk/autobuild.sh@27 -- $ '[' -n v22.11.4 ']' 00:01:34.601 14:56:34 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:34.601 14:56:34 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:34.601 14:56:34 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:34.601 14:56:34 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:34.601 14:56:34 -- common/autotest_common.sh@10 -- $ set +x 00:01:34.601 ************************************ 00:01:34.601 START TEST build_native_dpdk 00:01:34.601 ************************************ 00:01:34.601 14:56:34 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:34.601 14:56:34 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:34.601 14:56:34 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:34.601 14:56:34 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:34.601 14:56:34 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:34.601 14:56:34 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:34.601 14:56:34 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:34.601 14:56:34 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:34.601 14:56:34 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:34.601 14:56:34 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:34.601 14:56:34 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:34.601 14:56:34 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:34.601 14:56:34 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:34.601 14:56:34 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:34.601 14:56:34 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:34.601 14:56:34 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:34.601 14:56:34 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:34.601 14:56:34 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:34.601 caf0f5d395 version: 22.11.4 00:01:34.601 7d6f1cc05f Revert "net/iavf: fix abnormal disable HW interrupt" 00:01:34.601 dc9c799c7d vhost: fix missing spinlock unlock 00:01:34.601 4307659a90 net/mlx5: fix LACP redirection in Rx domain 00:01:34.601 6ef77f2a5e net/gve: fix RX buffer size alignment 00:01:34.601 14:56:34 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:34.601 14:56:34 -- common/autobuild_common.sh@87 -- $ dpdk_ver=22.11.4 00:01:34.601 14:56:34 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:34.601 14:56:34 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:34.601 14:56:34 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:34.601 14:56:34 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:34.601 14:56:34 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:34.601 14:56:34 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:34.601 14:56:34 -- common/autobuild_common.sh@169 -- $ lt 22.11.4 21.11.0 00:01:34.601 14:56:34 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 21.11.0 00:01:34.601 14:56:34 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:34.601 14:56:34 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:34.601 14:56:34 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:34.601 14:56:34 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:34.601 14:56:34 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:34.601 14:56:34 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:34.601 14:56:34 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:34.601 14:56:34 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:34.601 14:56:34 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:34.601 14:56:34 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:34.601 14:56:34 -- scripts/common.sh@343 -- $ case "$op" in 00:01:34.601 14:56:34 -- scripts/common.sh@344 -- $ : 1 00:01:34.601 14:56:34 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:34.601 14:56:34 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:34.601 14:56:34 -- scripts/common.sh@364 -- $ decimal 22 00:01:34.601 14:56:34 -- scripts/common.sh@352 -- $ local d=22 00:01:34.601 14:56:34 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:34.601 14:56:34 -- scripts/common.sh@354 -- $ echo 22 00:01:34.601 14:56:34 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:34.601 14:56:34 -- scripts/common.sh@365 -- $ decimal 21 00:01:34.601 14:56:34 -- scripts/common.sh@352 -- $ local d=21 00:01:34.601 14:56:34 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:34.601 14:56:34 -- scripts/common.sh@354 -- $ echo 21 00:01:34.601 14:56:34 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:34.601 14:56:34 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:34.601 14:56:34 -- scripts/common.sh@366 -- $ return 1 00:01:34.601 14:56:34 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:34.601 patching file config/rte_config.h 00:01:34.601 Hunk #1 succeeded at 60 (offset 1 line). 00:01:34.601 14:56:34 -- common/autobuild_common.sh@176 -- $ lt 22.11.4 24.07.0 00:01:34.601 14:56:34 -- scripts/common.sh@372 -- $ cmp_versions 22.11.4 '<' 24.07.0 00:01:34.601 14:56:34 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:34.601 14:56:34 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:34.601 14:56:34 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:34.601 14:56:34 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:34.601 14:56:34 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:34.601 14:56:34 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:34.601 14:56:34 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:34.601 14:56:34 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:34.601 14:56:34 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:34.601 14:56:34 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:34.601 14:56:34 -- scripts/common.sh@343 -- $ case "$op" in 00:01:34.601 14:56:34 -- scripts/common.sh@344 -- $ : 1 00:01:34.601 14:56:34 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:34.601 14:56:34 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:34.861 14:56:34 -- scripts/common.sh@364 -- $ decimal 22 00:01:34.861 14:56:34 -- scripts/common.sh@352 -- $ local d=22 00:01:34.861 14:56:34 -- scripts/common.sh@353 -- $ [[ 22 =~ ^[0-9]+$ ]] 00:01:34.861 14:56:34 -- scripts/common.sh@354 -- $ echo 22 00:01:34.861 14:56:34 -- scripts/common.sh@364 -- $ ver1[v]=22 00:01:34.861 14:56:34 -- scripts/common.sh@365 -- $ decimal 24 00:01:34.861 14:56:34 -- scripts/common.sh@352 -- $ local d=24 00:01:34.861 14:56:34 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:34.861 14:56:34 -- scripts/common.sh@354 -- $ echo 24 00:01:34.861 14:56:34 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:34.861 14:56:34 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:34.861 14:56:34 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:34.861 14:56:34 -- scripts/common.sh@367 -- $ return 0 00:01:34.861 14:56:34 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:34.861 patching file lib/pcapng/rte_pcapng.c 00:01:34.861 Hunk #1 succeeded at 110 (offset -18 lines). 00:01:34.861 14:56:34 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:34.861 14:56:34 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:34.861 14:56:34 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:34.861 14:56:34 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:34.861 14:56:34 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:39.053 The Meson build system 00:01:39.053 Version: 1.5.0 00:01:39.053 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:39.053 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:39.053 Build type: native build 00:01:39.053 Program cat found: YES (/usr/bin/cat) 00:01:39.053 Project name: DPDK 00:01:39.054 Project version: 22.11.4 00:01:39.054 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:39.054 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:39.054 Host machine cpu family: x86_64 00:01:39.054 Host machine cpu: x86_64 00:01:39.054 Message: ## Building in Developer Mode ## 00:01:39.054 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:39.054 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:39.054 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:39.054 Program objdump found: YES (/usr/bin/objdump) 00:01:39.054 Program python3 found: YES (/usr/bin/python3) 00:01:39.054 Program cat found: YES (/usr/bin/cat) 00:01:39.054 config/meson.build:83: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:39.054 Checking for size of "void *" : 8 00:01:39.054 Checking for size of "void *" : 8 (cached) 00:01:39.054 Library m found: YES 00:01:39.054 Library numa found: YES 00:01:39.054 Has header "numaif.h" : YES 00:01:39.054 Library fdt found: NO 00:01:39.054 Library execinfo found: NO 00:01:39.054 Has header "execinfo.h" : YES 00:01:39.054 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:39.054 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:39.054 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:39.054 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:39.054 Run-time dependency openssl found: YES 3.1.1 00:01:39.054 Run-time dependency libpcap found: YES 1.10.4 00:01:39.054 Has header "pcap.h" with dependency libpcap: YES 00:01:39.054 Compiler for C supports arguments -Wcast-qual: YES 00:01:39.054 Compiler for C supports arguments -Wdeprecated: YES 00:01:39.054 Compiler for C supports arguments -Wformat: YES 00:01:39.054 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:39.054 Compiler for C supports arguments -Wformat-security: NO 00:01:39.054 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:39.054 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:39.054 Compiler for C supports arguments -Wnested-externs: YES 00:01:39.054 Compiler for C supports arguments -Wold-style-definition: YES 00:01:39.054 Compiler for C supports arguments -Wpointer-arith: YES 00:01:39.054 Compiler for C supports arguments -Wsign-compare: YES 00:01:39.054 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:39.054 Compiler for C supports arguments -Wundef: YES 00:01:39.054 Compiler for C supports arguments -Wwrite-strings: YES 00:01:39.054 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:39.054 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:39.054 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:39.054 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:39.054 Compiler for C supports arguments -mavx512f: YES 00:01:39.054 Checking if "AVX512 checking" compiles: YES 00:01:39.054 Fetching value of define "__SSE4_2__" : 1 00:01:39.054 Fetching value of define "__AES__" : 1 00:01:39.054 Fetching value of define "__AVX__" : 1 00:01:39.054 Fetching value of define "__AVX2__" : (undefined) 00:01:39.054 Fetching value of define "__AVX512BW__" : (undefined) 00:01:39.054 Fetching value of define "__AVX512CD__" : (undefined) 00:01:39.054 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:39.054 Fetching value of define "__AVX512F__" : (undefined) 00:01:39.054 Fetching value of define "__AVX512VL__" : (undefined) 00:01:39.054 Fetching value of define "__PCLMUL__" : 1 00:01:39.054 Fetching value of define "__RDRND__" : 1 00:01:39.054 Fetching value of define "__RDSEED__" : (undefined) 00:01:39.054 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:39.054 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:39.054 Message: lib/kvargs: Defining dependency "kvargs" 00:01:39.054 Message: lib/telemetry: Defining dependency "telemetry" 00:01:39.054 Checking for function "getentropy" : YES 00:01:39.054 Message: lib/eal: Defining dependency "eal" 00:01:39.054 Message: lib/ring: Defining dependency "ring" 00:01:39.054 Message: lib/rcu: Defining dependency "rcu" 00:01:39.054 Message: lib/mempool: Defining dependency "mempool" 00:01:39.054 Message: lib/mbuf: Defining dependency "mbuf" 00:01:39.054 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:39.054 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:39.054 Compiler for C supports arguments -mpclmul: YES 00:01:39.054 Compiler for C supports arguments -maes: YES 00:01:39.054 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:39.054 Compiler for C supports arguments -mavx512bw: YES 00:01:39.054 Compiler for C supports arguments -mavx512dq: YES 00:01:39.054 Compiler for C supports arguments -mavx512vl: YES 00:01:39.054 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:39.054 Compiler for C supports arguments -mavx2: YES 00:01:39.054 Compiler for C supports arguments -mavx: YES 00:01:39.054 Message: lib/net: Defining dependency "net" 00:01:39.054 Message: lib/meter: Defining dependency "meter" 00:01:39.054 Message: lib/ethdev: Defining dependency "ethdev" 00:01:39.054 Message: lib/pci: Defining dependency "pci" 00:01:39.054 Message: lib/cmdline: Defining dependency "cmdline" 00:01:39.054 Message: lib/metrics: Defining dependency "metrics" 00:01:39.054 Message: lib/hash: Defining dependency "hash" 00:01:39.054 Message: lib/timer: Defining dependency "timer" 00:01:39.054 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:39.054 Compiler for C supports arguments -mavx2: YES (cached) 00:01:39.054 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:39.054 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:39.054 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:39.054 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:39.054 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:39.054 Message: lib/acl: Defining dependency "acl" 00:01:39.054 Message: lib/bbdev: Defining dependency "bbdev" 00:01:39.054 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:39.054 Run-time dependency libelf found: YES 0.191 00:01:39.054 Message: lib/bpf: Defining dependency "bpf" 00:01:39.054 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:39.054 Message: lib/compressdev: Defining dependency "compressdev" 00:01:39.054 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:39.054 Message: lib/distributor: Defining dependency "distributor" 00:01:39.054 Message: lib/efd: Defining dependency "efd" 00:01:39.054 Message: lib/eventdev: Defining dependency "eventdev" 00:01:39.054 Message: lib/gpudev: Defining dependency "gpudev" 00:01:39.054 Message: lib/gro: Defining dependency "gro" 00:01:39.054 Message: lib/gso: Defining dependency "gso" 00:01:39.054 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:39.054 Message: lib/jobstats: Defining dependency "jobstats" 00:01:39.054 Message: lib/latencystats: Defining dependency "latencystats" 00:01:39.054 Message: lib/lpm: Defining dependency "lpm" 00:01:39.054 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:39.054 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:39.054 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:39.054 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:39.054 Message: lib/member: Defining dependency "member" 00:01:39.054 Message: lib/pcapng: Defining dependency "pcapng" 00:01:39.054 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:39.054 Message: lib/power: Defining dependency "power" 00:01:39.054 Message: lib/rawdev: Defining dependency "rawdev" 00:01:39.054 Message: lib/regexdev: Defining dependency "regexdev" 00:01:39.054 Message: lib/dmadev: Defining dependency "dmadev" 00:01:39.054 Message: lib/rib: Defining dependency "rib" 00:01:39.054 Message: lib/reorder: Defining dependency "reorder" 00:01:39.054 Message: lib/sched: Defining dependency "sched" 00:01:39.054 Message: lib/security: Defining dependency "security" 00:01:39.054 Message: lib/stack: Defining dependency "stack" 00:01:39.054 Has header "linux/userfaultfd.h" : YES 00:01:39.054 Message: lib/vhost: Defining dependency "vhost" 00:01:39.054 Message: lib/ipsec: Defining dependency "ipsec" 00:01:39.054 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:39.054 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:39.054 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:39.054 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:39.054 Message: lib/fib: Defining dependency "fib" 00:01:39.054 Message: lib/port: Defining dependency "port" 00:01:39.054 Message: lib/pdump: Defining dependency "pdump" 00:01:39.054 Message: lib/table: Defining dependency "table" 00:01:39.054 Message: lib/pipeline: Defining dependency "pipeline" 00:01:39.054 Message: lib/graph: Defining dependency "graph" 00:01:39.054 Message: lib/node: Defining dependency "node" 00:01:39.054 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:39.054 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:39.054 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:39.054 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:39.054 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:39.054 Compiler for C supports arguments -Wno-unused-value: YES 00:01:40.432 Compiler for C supports arguments -Wno-format: YES 00:01:40.432 Compiler for C supports arguments -Wno-format-security: YES 00:01:40.432 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:40.432 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:40.432 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:40.432 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:40.432 Fetching value of define "__AVX2__" : (undefined) (cached) 00:01:40.432 Compiler for C supports arguments -mavx2: YES (cached) 00:01:40.432 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:40.432 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:40.432 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:40.433 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:40.433 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:40.433 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:40.433 Configuring doxy-api.conf using configuration 00:01:40.433 Program sphinx-build found: NO 00:01:40.433 Configuring rte_build_config.h using configuration 00:01:40.433 Message: 00:01:40.433 ================= 00:01:40.433 Applications Enabled 00:01:40.433 ================= 00:01:40.433 00:01:40.433 apps: 00:01:40.433 dumpcap, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, test-crypto-perf, 00:01:40.433 test-eventdev, test-fib, test-flow-perf, test-gpudev, test-pipeline, test-pmd, test-regex, test-sad, 00:01:40.433 test-security-perf, 00:01:40.433 00:01:40.433 Message: 00:01:40.433 ================= 00:01:40.433 Libraries Enabled 00:01:40.433 ================= 00:01:40.433 00:01:40.433 libs: 00:01:40.433 kvargs, telemetry, eal, ring, rcu, mempool, mbuf, net, 00:01:40.433 meter, ethdev, pci, cmdline, metrics, hash, timer, acl, 00:01:40.433 bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, efd, 00:01:40.433 eventdev, gpudev, gro, gso, ip_frag, jobstats, latencystats, lpm, 00:01:40.433 member, pcapng, power, rawdev, regexdev, dmadev, rib, reorder, 00:01:40.433 sched, security, stack, vhost, ipsec, fib, port, pdump, 00:01:40.433 table, pipeline, graph, node, 00:01:40.433 00:01:40.433 Message: 00:01:40.433 =============== 00:01:40.433 Drivers Enabled 00:01:40.433 =============== 00:01:40.433 00:01:40.433 common: 00:01:40.433 00:01:40.433 bus: 00:01:40.433 pci, vdev, 00:01:40.433 mempool: 00:01:40.433 ring, 00:01:40.433 dma: 00:01:40.433 00:01:40.433 net: 00:01:40.433 i40e, 00:01:40.433 raw: 00:01:40.433 00:01:40.433 crypto: 00:01:40.433 00:01:40.433 compress: 00:01:40.433 00:01:40.433 regex: 00:01:40.433 00:01:40.433 vdpa: 00:01:40.433 00:01:40.433 event: 00:01:40.433 00:01:40.433 baseband: 00:01:40.433 00:01:40.433 gpu: 00:01:40.433 00:01:40.433 00:01:40.433 Message: 00:01:40.433 ================= 00:01:40.433 Content Skipped 00:01:40.433 ================= 00:01:40.433 00:01:40.433 apps: 00:01:40.433 00:01:40.433 libs: 00:01:40.433 kni: explicitly disabled via build config (deprecated lib) 00:01:40.433 flow_classify: explicitly disabled via build config (deprecated lib) 00:01:40.433 00:01:40.433 drivers: 00:01:40.433 common/cpt: not in enabled drivers build config 00:01:40.433 common/dpaax: not in enabled drivers build config 00:01:40.433 common/iavf: not in enabled drivers build config 00:01:40.433 common/idpf: not in enabled drivers build config 00:01:40.433 common/mvep: not in enabled drivers build config 00:01:40.433 common/octeontx: not in enabled drivers build config 00:01:40.433 bus/auxiliary: not in enabled drivers build config 00:01:40.433 bus/dpaa: not in enabled drivers build config 00:01:40.433 bus/fslmc: not in enabled drivers build config 00:01:40.433 bus/ifpga: not in enabled drivers build config 00:01:40.433 bus/vmbus: not in enabled drivers build config 00:01:40.433 common/cnxk: not in enabled drivers build config 00:01:40.433 common/mlx5: not in enabled drivers build config 00:01:40.433 common/qat: not in enabled drivers build config 00:01:40.433 common/sfc_efx: not in enabled drivers build config 00:01:40.433 mempool/bucket: not in enabled drivers build config 00:01:40.433 mempool/cnxk: not in enabled drivers build config 00:01:40.433 mempool/dpaa: not in enabled drivers build config 00:01:40.433 mempool/dpaa2: not in enabled drivers build config 00:01:40.433 mempool/octeontx: not in enabled drivers build config 00:01:40.433 mempool/stack: not in enabled drivers build config 00:01:40.433 dma/cnxk: not in enabled drivers build config 00:01:40.433 dma/dpaa: not in enabled drivers build config 00:01:40.433 dma/dpaa2: not in enabled drivers build config 00:01:40.433 dma/hisilicon: not in enabled drivers build config 00:01:40.433 dma/idxd: not in enabled drivers build config 00:01:40.433 dma/ioat: not in enabled drivers build config 00:01:40.433 dma/skeleton: not in enabled drivers build config 00:01:40.433 net/af_packet: not in enabled drivers build config 00:01:40.433 net/af_xdp: not in enabled drivers build config 00:01:40.433 net/ark: not in enabled drivers build config 00:01:40.433 net/atlantic: not in enabled drivers build config 00:01:40.433 net/avp: not in enabled drivers build config 00:01:40.433 net/axgbe: not in enabled drivers build config 00:01:40.433 net/bnx2x: not in enabled drivers build config 00:01:40.433 net/bnxt: not in enabled drivers build config 00:01:40.433 net/bonding: not in enabled drivers build config 00:01:40.433 net/cnxk: not in enabled drivers build config 00:01:40.433 net/cxgbe: not in enabled drivers build config 00:01:40.433 net/dpaa: not in enabled drivers build config 00:01:40.433 net/dpaa2: not in enabled drivers build config 00:01:40.433 net/e1000: not in enabled drivers build config 00:01:40.433 net/ena: not in enabled drivers build config 00:01:40.433 net/enetc: not in enabled drivers build config 00:01:40.433 net/enetfec: not in enabled drivers build config 00:01:40.433 net/enic: not in enabled drivers build config 00:01:40.433 net/failsafe: not in enabled drivers build config 00:01:40.433 net/fm10k: not in enabled drivers build config 00:01:40.433 net/gve: not in enabled drivers build config 00:01:40.433 net/hinic: not in enabled drivers build config 00:01:40.433 net/hns3: not in enabled drivers build config 00:01:40.433 net/iavf: not in enabled drivers build config 00:01:40.433 net/ice: not in enabled drivers build config 00:01:40.433 net/idpf: not in enabled drivers build config 00:01:40.433 net/igc: not in enabled drivers build config 00:01:40.433 net/ionic: not in enabled drivers build config 00:01:40.433 net/ipn3ke: not in enabled drivers build config 00:01:40.433 net/ixgbe: not in enabled drivers build config 00:01:40.433 net/kni: not in enabled drivers build config 00:01:40.433 net/liquidio: not in enabled drivers build config 00:01:40.433 net/mana: not in enabled drivers build config 00:01:40.433 net/memif: not in enabled drivers build config 00:01:40.433 net/mlx4: not in enabled drivers build config 00:01:40.433 net/mlx5: not in enabled drivers build config 00:01:40.433 net/mvneta: not in enabled drivers build config 00:01:40.433 net/mvpp2: not in enabled drivers build config 00:01:40.433 net/netvsc: not in enabled drivers build config 00:01:40.433 net/nfb: not in enabled drivers build config 00:01:40.433 net/nfp: not in enabled drivers build config 00:01:40.433 net/ngbe: not in enabled drivers build config 00:01:40.433 net/null: not in enabled drivers build config 00:01:40.433 net/octeontx: not in enabled drivers build config 00:01:40.433 net/octeon_ep: not in enabled drivers build config 00:01:40.433 net/pcap: not in enabled drivers build config 00:01:40.433 net/pfe: not in enabled drivers build config 00:01:40.433 net/qede: not in enabled drivers build config 00:01:40.433 net/ring: not in enabled drivers build config 00:01:40.433 net/sfc: not in enabled drivers build config 00:01:40.433 net/softnic: not in enabled drivers build config 00:01:40.433 net/tap: not in enabled drivers build config 00:01:40.433 net/thunderx: not in enabled drivers build config 00:01:40.433 net/txgbe: not in enabled drivers build config 00:01:40.433 net/vdev_netvsc: not in enabled drivers build config 00:01:40.433 net/vhost: not in enabled drivers build config 00:01:40.433 net/virtio: not in enabled drivers build config 00:01:40.433 net/vmxnet3: not in enabled drivers build config 00:01:40.433 raw/cnxk_bphy: not in enabled drivers build config 00:01:40.433 raw/cnxk_gpio: not in enabled drivers build config 00:01:40.433 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:40.433 raw/ifpga: not in enabled drivers build config 00:01:40.433 raw/ntb: not in enabled drivers build config 00:01:40.433 raw/skeleton: not in enabled drivers build config 00:01:40.433 crypto/armv8: not in enabled drivers build config 00:01:40.433 crypto/bcmfs: not in enabled drivers build config 00:01:40.433 crypto/caam_jr: not in enabled drivers build config 00:01:40.433 crypto/ccp: not in enabled drivers build config 00:01:40.433 crypto/cnxk: not in enabled drivers build config 00:01:40.433 crypto/dpaa_sec: not in enabled drivers build config 00:01:40.433 crypto/dpaa2_sec: not in enabled drivers build config 00:01:40.433 crypto/ipsec_mb: not in enabled drivers build config 00:01:40.433 crypto/mlx5: not in enabled drivers build config 00:01:40.433 crypto/mvsam: not in enabled drivers build config 00:01:40.433 crypto/nitrox: not in enabled drivers build config 00:01:40.433 crypto/null: not in enabled drivers build config 00:01:40.433 crypto/octeontx: not in enabled drivers build config 00:01:40.433 crypto/openssl: not in enabled drivers build config 00:01:40.433 crypto/scheduler: not in enabled drivers build config 00:01:40.433 crypto/uadk: not in enabled drivers build config 00:01:40.433 crypto/virtio: not in enabled drivers build config 00:01:40.433 compress/isal: not in enabled drivers build config 00:01:40.433 compress/mlx5: not in enabled drivers build config 00:01:40.433 compress/octeontx: not in enabled drivers build config 00:01:40.433 compress/zlib: not in enabled drivers build config 00:01:40.433 regex/mlx5: not in enabled drivers build config 00:01:40.433 regex/cn9k: not in enabled drivers build config 00:01:40.433 vdpa/ifc: not in enabled drivers build config 00:01:40.433 vdpa/mlx5: not in enabled drivers build config 00:01:40.433 vdpa/sfc: not in enabled drivers build config 00:01:40.433 event/cnxk: not in enabled drivers build config 00:01:40.433 event/dlb2: not in enabled drivers build config 00:01:40.433 event/dpaa: not in enabled drivers build config 00:01:40.433 event/dpaa2: not in enabled drivers build config 00:01:40.433 event/dsw: not in enabled drivers build config 00:01:40.433 event/opdl: not in enabled drivers build config 00:01:40.433 event/skeleton: not in enabled drivers build config 00:01:40.433 event/sw: not in enabled drivers build config 00:01:40.433 event/octeontx: not in enabled drivers build config 00:01:40.433 baseband/acc: not in enabled drivers build config 00:01:40.434 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:40.434 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:40.434 baseband/la12xx: not in enabled drivers build config 00:01:40.434 baseband/null: not in enabled drivers build config 00:01:40.434 baseband/turbo_sw: not in enabled drivers build config 00:01:40.434 gpu/cuda: not in enabled drivers build config 00:01:40.434 00:01:40.434 00:01:40.434 Build targets in project: 316 00:01:40.434 00:01:40.434 DPDK 22.11.4 00:01:40.434 00:01:40.434 User defined options 00:01:40.434 libdir : lib 00:01:40.434 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:40.434 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:40.434 c_link_args : 00:01:40.434 enable_docs : false 00:01:40.434 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:40.434 enable_kmods : false 00:01:40.434 machine : native 00:01:40.434 tests : false 00:01:40.434 00:01:40.434 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:40.434 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:40.434 14:56:40 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:40.702 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:40.702 [1/745] Generating lib/rte_telemetry_def with a custom command 00:01:40.702 [2/745] Generating lib/rte_kvargs_def with a custom command 00:01:40.702 [3/745] Generating lib/rte_kvargs_mingw with a custom command 00:01:40.702 [4/745] Generating lib/rte_telemetry_mingw with a custom command 00:01:40.702 [5/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:40.702 [6/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:40.702 [7/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:40.702 [8/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:40.702 [9/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:40.702 [10/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:40.702 [11/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:40.702 [12/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:40.702 [13/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:40.702 [14/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:40.702 [15/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:40.702 [16/745] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:40.702 [17/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:40.702 [18/745] Linking static target lib/librte_kvargs.a 00:01:40.702 [19/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:40.702 [20/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:40.965 [21/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:40.965 [22/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:40.965 [23/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:40.965 [24/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:40.965 [25/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:40.965 [26/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:40.965 [27/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:40.965 [28/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:40.965 [29/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:40.965 [30/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:40.965 [31/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:40.965 [32/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_log.c.o 00:01:40.965 [33/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:40.965 [34/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:40.965 [35/745] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:40.965 [36/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:40.965 [37/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:40.965 [38/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:40.965 [39/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:40.965 [40/745] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:40.965 [41/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:40.965 [42/745] Generating lib/rte_eal_def with a custom command 00:01:40.965 [43/745] Generating lib/rte_eal_mingw with a custom command 00:01:40.965 [44/745] Generating lib/rte_ring_def with a custom command 00:01:40.965 [45/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:40.965 [46/745] Generating lib/rte_ring_mingw with a custom command 00:01:40.965 [47/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:40.965 [48/745] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:40.965 [49/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:40.965 [50/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:40.965 [51/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:40.965 [52/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:40.965 [53/745] Generating lib/rte_rcu_def with a custom command 00:01:40.965 [54/745] Generating lib/rte_rcu_mingw with a custom command 00:01:40.965 [55/745] Generating lib/rte_mempool_def with a custom command 00:01:40.965 [56/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:40.965 [57/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:40.965 [58/745] Generating lib/rte_mempool_mingw with a custom command 00:01:40.965 [59/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:40.965 [60/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_log.c.o 00:01:40.965 [61/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:40.965 [62/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:40.965 [63/745] Generating lib/rte_mbuf_def with a custom command 00:01:40.965 [64/745] Generating lib/rte_mbuf_mingw with a custom command 00:01:40.965 [65/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:40.965 [66/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:40.965 [67/745] Generating lib/rte_net_def with a custom command 00:01:40.965 [68/745] Generating lib/rte_net_mingw with a custom command 00:01:40.965 [69/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:40.965 [70/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:40.965 [71/745] Generating lib/rte_meter_mingw with a custom command 00:01:40.965 [72/745] Generating lib/rte_meter_def with a custom command 00:01:41.230 [73/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:41.230 [74/745] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:41.230 [75/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:41.230 [76/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:41.230 [77/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:41.230 [78/745] Generating lib/rte_ethdev_def with a custom command 00:01:41.230 [79/745] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.230 [80/745] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:41.230 [81/745] Generating lib/rte_ethdev_mingw with a custom command 00:01:41.230 [82/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:41.230 [83/745] Linking static target lib/librte_ring.a 00:01:41.230 [84/745] Linking target lib/librte_kvargs.so.23.0 00:01:41.230 [85/745] Generating lib/rte_pci_def with a custom command 00:01:41.230 [86/745] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:41.230 [87/745] Linking static target lib/librte_meter.a 00:01:41.230 [88/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:41.230 [89/745] Generating lib/rte_pci_mingw with a custom command 00:01:41.495 [90/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:41.495 [91/745] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:41.495 [92/745] Linking static target lib/librte_pci.a 00:01:41.495 [93/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:41.495 [94/745] Generating symbol file lib/librte_kvargs.so.23.0.p/librte_kvargs.so.23.0.symbols 00:01:41.495 [95/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:41.495 [96/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:41.495 [97/745] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:41.495 [98/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:41.764 [99/745] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.764 [100/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:41.764 [101/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:41.764 [102/745] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.764 [103/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:41.764 [104/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:41.764 [105/745] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.764 [106/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:41.764 [107/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:41.764 [108/745] Generating lib/rte_cmdline_def with a custom command 00:01:41.764 [109/745] Generating lib/rte_cmdline_mingw with a custom command 00:01:41.764 [110/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:41.764 [111/745] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:41.764 [112/745] Linking static target lib/librte_telemetry.a 00:01:41.764 [113/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:41.764 [114/745] Generating lib/rte_metrics_def with a custom command 00:01:41.764 [115/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:41.764 [116/745] Generating lib/rte_metrics_mingw with a custom command 00:01:41.764 [117/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:41.764 [118/745] Generating lib/rte_hash_def with a custom command 00:01:41.764 [119/745] Generating lib/rte_hash_mingw with a custom command 00:01:41.764 [120/745] Generating lib/rte_timer_def with a custom command 00:01:41.764 [121/745] Generating lib/rte_timer_mingw with a custom command 00:01:41.764 [122/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:42.025 [123/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:42.025 [124/745] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:42.025 [125/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:42.292 [126/745] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:42.292 [127/745] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:42.292 [128/745] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:42.292 [129/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:42.292 [130/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:42.292 [131/745] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:42.292 [132/745] Generating lib/rte_acl_def with a custom command 00:01:42.292 [133/745] Generating lib/rte_acl_mingw with a custom command 00:01:42.292 [134/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:42.292 [135/745] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:42.292 [136/745] Generating lib/rte_bbdev_def with a custom command 00:01:42.292 [137/745] Generating lib/rte_bbdev_mingw with a custom command 00:01:42.292 [138/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:42.292 [139/745] Generating lib/rte_bitratestats_mingw with a custom command 00:01:42.292 [140/745] Generating lib/rte_bitratestats_def with a custom command 00:01:42.292 [141/745] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.292 [142/745] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:42.292 [143/745] Linking target lib/librte_telemetry.so.23.0 00:01:42.292 [144/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:42.292 [145/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:42.292 [146/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:42.292 [147/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:42.555 [148/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:42.555 [149/745] Generating lib/rte_bpf_def with a custom command 00:01:42.556 [150/745] Generating lib/rte_bpf_mingw with a custom command 00:01:42.556 [151/745] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:42.556 [152/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:42.556 [153/745] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:42.556 [154/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:42.556 [155/745] Generating lib/rte_cfgfile_def with a custom command 00:01:42.556 [156/745] Generating lib/rte_cfgfile_mingw with a custom command 00:01:42.556 [157/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:42.556 [158/745] Generating symbol file lib/librte_telemetry.so.23.0.p/librte_telemetry.so.23.0.symbols 00:01:42.556 [159/745] Generating lib/rte_compressdev_mingw with a custom command 00:01:42.556 [160/745] Generating lib/rte_compressdev_def with a custom command 00:01:42.556 [161/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:42.556 [162/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:42.556 [163/745] Generating lib/rte_cryptodev_def with a custom command 00:01:42.556 [164/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:42.826 [165/745] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:42.826 [166/745] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:42.826 [167/745] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:42.826 [168/745] Generating lib/rte_cryptodev_mingw with a custom command 00:01:42.826 [169/745] Linking static target lib/librte_rcu.a 00:01:42.826 [170/745] Linking static target lib/librte_timer.a 00:01:42.826 [171/745] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:42.826 [172/745] Generating lib/rte_distributor_def with a custom command 00:01:42.826 [173/745] Generating lib/rte_distributor_mingw with a custom command 00:01:42.826 [174/745] Linking static target lib/librte_cmdline.a 00:01:42.826 [175/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:42.826 [176/745] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:42.826 [177/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:42.826 [178/745] Linking static target lib/librte_net.a 00:01:42.826 [179/745] Generating lib/rte_efd_def with a custom command 00:01:42.826 [180/745] Generating lib/rte_efd_mingw with a custom command 00:01:42.826 [181/745] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:43.092 [182/745] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:43.092 [183/745] Linking static target lib/librte_metrics.a 00:01:43.092 [184/745] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:43.092 [185/745] Linking static target lib/librte_cfgfile.a 00:01:43.092 [186/745] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:43.092 [187/745] Linking static target lib/librte_mempool.a 00:01:43.092 [188/745] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:43.092 [189/745] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.092 [190/745] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.092 [191/745] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.354 [192/745] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:43.354 [193/745] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:43.354 [194/745] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:43.354 [195/745] Linking static target lib/librte_eal.a 00:01:43.354 [196/745] Generating lib/rte_eventdev_def with a custom command 00:01:43.354 [197/745] Generating lib/rte_eventdev_mingw with a custom command 00:01:43.354 [198/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:43.354 [199/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:43.616 [200/745] Generating lib/rte_gpudev_mingw with a custom command 00:01:43.616 [201/745] Generating lib/rte_gpudev_def with a custom command 00:01:43.616 [202/745] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:43.616 [203/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:43.616 [204/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:43.616 [205/745] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.616 [206/745] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:43.616 [207/745] Linking static target lib/librte_bitratestats.a 00:01:43.616 [208/745] Generating lib/rte_gro_def with a custom command 00:01:43.616 [209/745] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.616 [210/745] Generating lib/rte_gro_mingw with a custom command 00:01:43.616 [211/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:43.882 [212/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:43.882 [213/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:43.882 [214/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:43.882 [215/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:43.882 [216/745] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.882 [217/745] Generating lib/rte_gso_mingw with a custom command 00:01:43.882 [218/745] Generating lib/rte_gso_def with a custom command 00:01:43.882 [219/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:44.146 [220/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:44.146 [221/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:44.146 [222/745] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.146 [223/745] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:44.146 [224/745] Linking static target lib/librte_bbdev.a 00:01:44.146 [225/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:44.146 [226/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:44.146 [227/745] Generating lib/rte_ip_frag_def with a custom command 00:01:44.146 [228/745] Generating lib/rte_ip_frag_mingw with a custom command 00:01:44.146 [229/745] Generating lib/rte_jobstats_def with a custom command 00:01:44.146 [230/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:44.146 [231/745] Generating lib/rte_jobstats_mingw with a custom command 00:01:44.146 [232/745] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:44.410 [233/745] Generating lib/rte_latencystats_def with a custom command 00:01:44.410 [234/745] Generating lib/rte_latencystats_mingw with a custom command 00:01:44.410 [235/745] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.410 [236/745] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:44.410 [237/745] Linking static target lib/librte_compressdev.a 00:01:44.410 [238/745] Generating lib/rte_lpm_def with a custom command 00:01:44.410 [239/745] Generating lib/rte_lpm_mingw with a custom command 00:01:44.410 [240/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:44.410 [241/745] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:44.410 [242/745] Linking static target lib/librte_jobstats.a 00:01:44.679 [243/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:44.679 [244/745] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:44.679 [245/745] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:44.679 [246/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:44.679 [247/745] Linking static target lib/librte_distributor.a 00:01:44.944 [248/745] Generating lib/rte_member_def with a custom command 00:01:44.944 [249/745] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:44.944 [250/745] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.944 [251/745] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:44.944 [252/745] Generating lib/rte_member_mingw with a custom command 00:01:44.944 [253/745] Generating lib/rte_pcapng_def with a custom command 00:01:44.944 [254/745] Generating lib/rte_pcapng_mingw with a custom command 00:01:44.944 [255/745] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.944 [256/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:44.944 [257/745] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:44.944 [258/745] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:44.944 [259/745] Linking static target lib/librte_bpf.a 00:01:45.207 [260/745] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:45.207 [261/745] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:45.207 [262/745] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:45.207 [263/745] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:45.207 [264/745] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:45.207 [265/745] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:45.207 [266/745] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:45.207 [267/745] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.207 [268/745] Generating lib/rte_power_mingw with a custom command 00:01:45.207 [269/745] Generating lib/rte_power_def with a custom command 00:01:45.207 [270/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:45.207 [271/745] Generating lib/rte_rawdev_def with a custom command 00:01:45.207 [272/745] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:45.207 [273/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:45.207 [274/745] Linking static target lib/librte_gpudev.a 00:01:45.207 [275/745] Generating lib/rte_rawdev_mingw with a custom command 00:01:45.207 [276/745] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:45.207 [277/745] Generating lib/rte_regexdev_def with a custom command 00:01:45.207 [278/745] Linking static target lib/librte_gro.a 00:01:45.207 [279/745] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:45.207 [280/745] Generating lib/rte_regexdev_mingw with a custom command 00:01:45.207 [281/745] Generating lib/rte_dmadev_def with a custom command 00:01:45.471 [282/745] Generating lib/rte_dmadev_mingw with a custom command 00:01:45.471 [283/745] Generating lib/rte_rib_def with a custom command 00:01:45.471 [284/745] Generating lib/rte_rib_mingw with a custom command 00:01:45.471 [285/745] Generating lib/rte_reorder_def with a custom command 00:01:45.471 [286/745] Compiling C object lib/librte_power.a.p/power_rte_power_empty_poll.c.o 00:01:45.471 [287/745] Generating lib/rte_reorder_mingw with a custom command 00:01:45.471 [288/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:45.471 [289/745] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.730 [290/745] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.730 [291/745] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.730 [292/745] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:45.730 [293/745] Generating lib/rte_sched_def with a custom command 00:01:45.730 [294/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:45.730 [295/745] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:45.730 [296/745] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:45.730 [297/745] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:45.730 [298/745] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:45.730 [299/745] Generating lib/rte_sched_mingw with a custom command 00:01:45.730 [300/745] Generating lib/rte_security_mingw with a custom command 00:01:45.730 [301/745] Generating lib/rte_security_def with a custom command 00:01:45.730 [302/745] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:45.730 [303/745] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:45.730 [304/745] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:45.730 [305/745] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:45.730 [306/745] Linking static target lib/librte_latencystats.a 00:01:45.730 [307/745] Generating lib/rte_stack_def with a custom command 00:01:45.730 [308/745] Generating lib/rte_stack_mingw with a custom command 00:01:45.992 [309/745] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:45.992 [310/745] Linking static target lib/librte_rawdev.a 00:01:45.992 [311/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:45.992 [312/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:45.992 [313/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:45.992 [314/745] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:45.992 [315/745] Linking static target lib/librte_stack.a 00:01:45.992 [316/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:45.992 [317/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:45.992 [318/745] Generating lib/rte_vhost_def with a custom command 00:01:45.992 [319/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:45.992 [320/745] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:45.992 [321/745] Generating lib/rte_vhost_mingw with a custom command 00:01:45.992 [322/745] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:45.992 [323/745] Linking static target lib/librte_dmadev.a 00:01:46.258 [324/745] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:46.258 [325/745] Linking static target lib/librte_ip_frag.a 00:01:46.258 [326/745] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.258 [327/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:46.258 [328/745] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:46.258 [329/745] Generating lib/rte_ipsec_def with a custom command 00:01:46.258 [330/745] Generating lib/rte_ipsec_mingw with a custom command 00:01:46.258 [331/745] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.258 [332/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:46.524 [333/745] Compiling C object lib/librte_power.a.p/power_rte_power_intel_uncore.c.o 00:01:46.524 [334/745] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.524 [335/745] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.524 [336/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:46.524 [337/745] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.524 [338/745] Generating lib/rte_fib_def with a custom command 00:01:46.524 [339/745] Generating lib/rte_fib_mingw with a custom command 00:01:46.785 [340/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:46.785 [341/745] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:46.785 [342/745] Linking static target lib/librte_gso.a 00:01:46.785 [343/745] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:46.785 [344/745] Linking static target lib/librte_regexdev.a 00:01:46.785 [345/745] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:46.785 [346/745] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.051 [347/745] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:47.051 [348/745] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.051 [349/745] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:47.051 [350/745] Linking static target lib/librte_efd.a 00:01:47.312 [351/745] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:47.312 [352/745] Linking static target lib/librte_pcapng.a 00:01:47.312 [353/745] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:47.312 [354/745] Linking static target lib/librte_lpm.a 00:01:47.312 [355/745] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:47.312 [356/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:47.312 [357/745] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:47.312 [358/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:47.312 [359/745] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:47.312 [360/745] Linking static target lib/librte_reorder.a 00:01:47.312 [361/745] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.312 [362/745] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:47.575 [363/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:47.575 [364/745] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:47.575 [365/745] Generating lib/rte_port_def with a custom command 00:01:47.575 [366/745] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:47.575 [367/745] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:47.575 [368/745] Generating lib/rte_port_mingw with a custom command 00:01:47.575 [369/745] Generating lib/rte_pdump_def with a custom command 00:01:47.575 [370/745] Generating lib/rte_pdump_mingw with a custom command 00:01:47.575 [371/745] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:47.575 [372/745] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:47.575 [373/745] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:47.575 [374/745] Linking static target lib/acl/libavx2_tmp.a 00:01:47.575 [375/745] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:47.575 [376/745] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.575 [377/745] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:47.575 [378/745] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:47.842 [379/745] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.842 [380/745] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:47.842 [381/745] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.842 [382/745] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:47.842 [383/745] Linking static target lib/librte_security.a 00:01:47.842 [384/745] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:47.842 [385/745] Linking static target lib/librte_power.a 00:01:47.842 [386/745] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.842 [387/745] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:47.842 [388/745] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:47.842 [389/745] Linking static target lib/librte_hash.a 00:01:48.105 [390/745] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:48.105 [391/745] Linking static target lib/librte_rib.a 00:01:48.105 [392/745] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:48.105 [393/745] Linking static target lib/acl/libavx512_tmp.a 00:01:48.105 [394/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:48.105 [395/745] Linking static target lib/librte_acl.a 00:01:48.105 [396/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:48.105 [397/745] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:48.371 [398/745] Generating lib/rte_table_def with a custom command 00:01:48.371 [399/745] Generating lib/rte_table_mingw with a custom command 00:01:48.371 [400/745] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:48.371 [401/745] Linking static target lib/librte_ethdev.a 00:01:48.371 [402/745] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.633 [403/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:48.633 [404/745] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.633 [405/745] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.898 [406/745] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:48.898 [407/745] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:48.899 [408/745] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:48.899 [409/745] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:48.899 [410/745] Linking static target lib/librte_mbuf.a 00:01:48.899 [411/745] Generating lib/rte_pipeline_def with a custom command 00:01:48.899 [412/745] Generating lib/rte_pipeline_mingw with a custom command 00:01:48.899 [413/745] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:48.899 [414/745] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:48.899 [415/745] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:48.899 [416/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:48.899 [417/745] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:48.899 [418/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:48.899 [419/745] Linking static target lib/librte_fib.a 00:01:48.899 [420/745] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:48.899 [421/745] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:48.899 [422/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:49.160 [423/745] Generating lib/rte_graph_def with a custom command 00:01:49.160 [424/745] Generating lib/rte_graph_mingw with a custom command 00:01:49.160 [425/745] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:49.160 [426/745] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.160 [427/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:49.160 [428/745] Linking static target lib/librte_member.a 00:01:49.160 [429/745] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:49.160 [430/745] Linking static target lib/librte_eventdev.a 00:01:49.421 [431/745] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:49.421 [432/745] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:49.421 [433/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:49.421 [434/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:49.421 [435/745] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:49.421 [436/745] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:49.421 [437/745] Generating lib/rte_node_def with a custom command 00:01:49.421 [438/745] Generating lib/rte_node_mingw with a custom command 00:01:49.421 [439/745] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:49.421 [440/745] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.684 [441/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:49.684 [442/745] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:49.684 [443/745] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.684 [444/745] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:49.684 [445/745] Linking static target lib/librte_sched.a 00:01:49.684 [446/745] Generating drivers/rte_bus_pci_def with a custom command 00:01:49.684 [447/745] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.684 [448/745] Generating drivers/rte_bus_pci_mingw with a custom command 00:01:49.684 [449/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:49.684 [450/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:49.946 [451/745] Generating drivers/rte_bus_vdev_def with a custom command 00:01:49.946 [452/745] Generating drivers/rte_bus_vdev_mingw with a custom command 00:01:49.946 [453/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:49.946 [454/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:49.946 [455/745] Generating drivers/rte_mempool_ring_def with a custom command 00:01:49.946 [456/745] Generating drivers/rte_mempool_ring_mingw with a custom command 00:01:49.946 [457/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:49.946 [458/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:49.946 [459/745] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:49.946 [460/745] Linking static target lib/librte_cryptodev.a 00:01:49.946 [461/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:49.946 [462/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:49.946 [463/745] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:50.210 [464/745] Linking static target lib/librte_pdump.a 00:01:50.210 [465/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:50.210 [466/745] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:50.210 [467/745] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:50.210 [468/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:50.210 [469/745] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:50.210 [470/745] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:50.210 [471/745] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:50.210 [472/745] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:50.210 [473/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:50.474 [474/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:50.474 [475/745] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:50.474 [476/745] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:50.474 [477/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:50.474 [478/745] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:50.474 [479/745] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.474 [480/745] Generating drivers/rte_net_i40e_def with a custom command 00:01:50.474 [481/745] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:50.474 [482/745] Generating drivers/rte_net_i40e_mingw with a custom command 00:01:50.740 [483/745] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:50.740 [484/745] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:50.740 [485/745] Linking static target lib/librte_table.a 00:01:50.740 [486/745] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:50.740 [487/745] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:50.740 [488/745] Linking static target lib/librte_ipsec.a 00:01:50.740 [489/745] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:50.740 [490/745] Linking static target drivers/librte_bus_vdev.a 00:01:50.740 [491/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:50.740 [492/745] Compiling C object drivers/librte_bus_vdev.so.23.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:51.004 [493/745] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:51.004 [494/745] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:51.004 [495/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:51.266 [496/745] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.266 [497/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:51.266 [498/745] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:51.266 [499/745] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:51.266 [500/745] Linking static target lib/librte_graph.a 00:01:51.266 [501/745] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:51.266 [502/745] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:51.266 [503/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:51.266 [504/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:51.266 [505/745] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:51.534 [506/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:51.534 [507/745] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:51.534 [508/745] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:51.534 [509/745] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.534 [510/745] Linking static target drivers/librte_bus_pci.a 00:01:51.534 [511/745] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:51.800 [512/745] Compiling C object drivers/librte_bus_pci.so.23.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:51.800 [513/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:51.800 [514/745] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.072 [515/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:52.072 [516/745] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.072 [517/745] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.072 [518/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:52.339 [519/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:52.339 [520/745] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:52.339 [521/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:52.339 [522/745] Linking static target lib/librte_port.a 00:01:52.339 [523/745] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:52.601 [524/745] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:52.601 [525/745] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:52.601 [526/745] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:52.601 [527/745] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.868 [528/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:52.868 [529/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:52.868 [530/745] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:52.868 [531/745] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:52.868 [532/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:52.868 [533/745] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:52.868 [534/745] Linking static target drivers/librte_mempool_ring.a 00:01:52.868 [535/745] Compiling C object drivers/librte_mempool_ring.so.23.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:52.868 [536/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:53.135 [537/745] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:53.135 [538/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:53.135 [539/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:53.135 [540/745] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.395 [541/745] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.659 [542/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:53.659 [543/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:53.659 [544/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:53.919 [545/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:53.919 [546/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:53.919 [547/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:53.919 [548/745] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:53.919 [549/745] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:53.919 [550/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:53.919 [551/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:54.184 [552/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:54.184 [553/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:54.449 [554/745] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:54.449 [555/745] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:54.709 [556/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:54.709 [557/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:54.709 [558/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:54.973 [559/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:54.973 [560/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:55.236 [561/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:55.236 [562/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:55.236 [563/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:55.236 [564/745] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:55.236 [565/745] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.236 [566/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:55.236 [567/745] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:55.236 [568/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:55.236 [569/745] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:55.236 [570/745] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:55.513 [571/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:55.513 [572/745] Linking target lib/librte_eal.so.23.0 00:01:55.513 [573/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:55.513 [574/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:55.513 [575/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:55.801 [576/745] Generating symbol file lib/librte_eal.so.23.0.p/librte_eal.so.23.0.symbols 00:01:55.802 [577/745] Linking target lib/librte_ring.so.23.0 00:01:55.802 [578/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:55.802 [579/745] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.802 [580/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:55.802 [581/745] Linking target lib/librte_meter.so.23.0 00:01:55.802 [582/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:55.802 [583/745] Linking target lib/librte_pci.so.23.0 00:01:55.802 [584/745] Linking target lib/librte_timer.so.23.0 00:01:56.084 [585/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:56.085 [586/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:56.085 [587/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:56.085 [588/745] Linking target lib/librte_acl.so.23.0 00:01:56.085 [589/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:56.085 [590/745] Linking target lib/librte_cfgfile.so.23.0 00:01:56.085 [591/745] Generating symbol file lib/librte_ring.so.23.0.p/librte_ring.so.23.0.symbols 00:01:56.085 [592/745] Linking target lib/librte_jobstats.so.23.0 00:01:56.085 [593/745] Linking target lib/librte_rawdev.so.23.0 00:01:56.085 [594/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:56.085 [595/745] Linking target lib/librte_dmadev.so.23.0 00:01:56.085 [596/745] Linking target lib/librte_stack.so.23.0 00:01:56.085 [597/745] Linking target lib/librte_rcu.so.23.0 00:01:56.085 [598/745] Linking target lib/librte_mempool.so.23.0 00:01:56.085 [599/745] Generating symbol file lib/librte_meter.so.23.0.p/librte_meter.so.23.0.symbols 00:01:56.085 [600/745] Linking target lib/librte_graph.so.23.0 00:01:56.085 [601/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:56.085 [602/745] Linking target drivers/librte_bus_vdev.so.23.0 00:01:56.085 [603/745] Generating symbol file lib/librte_pci.so.23.0.p/librte_pci.so.23.0.symbols 00:01:56.085 [604/745] Generating symbol file lib/librte_acl.so.23.0.p/librte_acl.so.23.0.symbols 00:01:56.085 [605/745] Generating symbol file lib/librte_timer.so.23.0.p/librte_timer.so.23.0.symbols 00:01:56.085 [606/745] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:56.363 [607/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:56.363 [608/745] Linking target drivers/librte_bus_pci.so.23.0 00:01:56.363 [609/745] Generating symbol file lib/librte_dmadev.so.23.0.p/librte_dmadev.so.23.0.symbols 00:01:56.363 [610/745] Generating symbol file lib/librte_rcu.so.23.0.p/librte_rcu.so.23.0.symbols 00:01:56.363 [611/745] Generating symbol file lib/librte_graph.so.23.0.p/librte_graph.so.23.0.symbols 00:01:56.363 [612/745] Generating symbol file drivers/librte_bus_vdev.so.23.0.p/librte_bus_vdev.so.23.0.symbols 00:01:56.363 [613/745] Generating symbol file lib/librte_mempool.so.23.0.p/librte_mempool.so.23.0.symbols 00:01:56.363 [614/745] Linking target lib/librte_mbuf.so.23.0 00:01:56.364 [615/745] Generating symbol file drivers/librte_bus_pci.so.23.0.p/librte_bus_pci.so.23.0.symbols 00:01:56.638 [616/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:56.638 [617/745] Linking target lib/librte_rib.so.23.0 00:01:56.638 [618/745] Linking target drivers/librte_mempool_ring.so.23.0 00:01:56.638 [619/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:56.638 [620/745] Generating symbol file lib/librte_mbuf.so.23.0.p/librte_mbuf.so.23.0.symbols 00:01:56.638 [621/745] Linking target lib/librte_net.so.23.0 00:01:56.900 [622/745] Generating symbol file lib/librte_rib.so.23.0.p/librte_rib.so.23.0.symbols 00:01:56.900 [623/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:56.900 [624/745] Linking target lib/librte_bbdev.so.23.0 00:01:56.900 [625/745] Linking target lib/librte_compressdev.so.23.0 00:01:56.900 [626/745] Linking target lib/librte_cryptodev.so.23.0 00:01:56.900 [627/745] Linking target lib/librte_distributor.so.23.0 00:01:56.900 [628/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:56.900 [629/745] Generating symbol file lib/librte_net.so.23.0.p/librte_net.so.23.0.symbols 00:01:57.164 [630/745] Linking target lib/librte_gpudev.so.23.0 00:01:57.164 [631/745] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:57.164 [632/745] Linking target lib/librte_regexdev.so.23.0 00:01:57.164 [633/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:57.164 [634/745] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:57.164 [635/745] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:57.164 [636/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:57.164 [637/745] Linking target lib/librte_ethdev.so.23.0 00:01:57.164 [638/745] Linking target lib/librte_cmdline.so.23.0 00:01:57.164 [639/745] Linking target lib/librte_reorder.so.23.0 00:01:57.164 [640/745] Linking target lib/librte_hash.so.23.0 00:01:57.164 [641/745] Linking target lib/librte_sched.so.23.0 00:01:57.164 [642/745] Linking target lib/librte_fib.so.23.0 00:01:57.164 [643/745] Generating symbol file lib/librte_cryptodev.so.23.0.p/librte_cryptodev.so.23.0.symbols 00:01:57.164 [644/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:57.164 [645/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:57.164 [646/745] Linking target lib/librte_security.so.23.0 00:01:57.424 [647/745] Generating symbol file lib/librte_ethdev.so.23.0.p/librte_ethdev.so.23.0.symbols 00:01:57.424 [648/745] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:57.425 [649/745] Generating symbol file lib/librte_hash.so.23.0.p/librte_hash.so.23.0.symbols 00:01:57.425 [650/745] Generating symbol file lib/librte_sched.so.23.0.p/librte_sched.so.23.0.symbols 00:01:57.425 [651/745] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:57.425 [652/745] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:57.425 [653/745] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:57.425 [654/745] Linking target lib/librte_efd.so.23.0 00:01:57.425 [655/745] Linking target lib/librte_pcapng.so.23.0 00:01:57.425 [656/745] Linking target lib/librte_gro.so.23.0 00:01:57.425 [657/745] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:57.425 [658/745] Linking target lib/librte_gso.so.23.0 00:01:57.425 [659/745] Linking target lib/librte_lpm.so.23.0 00:01:57.425 [660/745] Linking target lib/librte_metrics.so.23.0 00:01:57.425 [661/745] Linking target lib/librte_bpf.so.23.0 00:01:57.425 [662/745] Linking target lib/librte_member.so.23.0 00:01:57.425 [663/745] Linking target lib/librte_ip_frag.so.23.0 00:01:57.425 [664/745] Linking target lib/librte_power.so.23.0 00:01:57.425 [665/745] Linking target lib/librte_eventdev.so.23.0 00:01:57.425 [666/745] Generating symbol file lib/librte_security.so.23.0.p/librte_security.so.23.0.symbols 00:01:57.684 [667/745] Linking target lib/librte_ipsec.so.23.0 00:01:57.684 [668/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:57.684 [669/745] Generating symbol file lib/librte_metrics.so.23.0.p/librte_metrics.so.23.0.symbols 00:01:57.684 [670/745] Generating symbol file lib/librte_bpf.so.23.0.p/librte_bpf.so.23.0.symbols 00:01:57.684 [671/745] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:57.684 [672/745] Generating symbol file lib/librte_pcapng.so.23.0.p/librte_pcapng.so.23.0.symbols 00:01:57.684 [673/745] Generating symbol file lib/librte_lpm.so.23.0.p/librte_lpm.so.23.0.symbols 00:01:57.684 [674/745] Generating symbol file lib/librte_eventdev.so.23.0.p/librte_eventdev.so.23.0.symbols 00:01:57.684 [675/745] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:57.684 [676/745] Generating symbol file lib/librte_ip_frag.so.23.0.p/librte_ip_frag.so.23.0.symbols 00:01:57.684 [677/745] Linking target lib/librte_latencystats.so.23.0 00:01:57.684 [678/745] Linking target lib/librte_bitratestats.so.23.0 00:01:57.684 [679/745] Linking target lib/librte_pdump.so.23.0 00:01:57.684 [680/745] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:57.684 [681/745] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:57.684 [682/745] Linking target lib/librte_port.so.23.0 00:01:57.944 [683/745] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:57.944 [684/745] Generating symbol file lib/librte_port.so.23.0.p/librte_port.so.23.0.symbols 00:01:57.944 [685/745] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:57.944 [686/745] Linking target lib/librte_table.so.23.0 00:01:57.944 [687/745] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:57.944 [688/745] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:57.945 [689/745] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:57.945 [690/745] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:58.204 [691/745] Generating symbol file lib/librte_table.so.23.0.p/librte_table.so.23.0.symbols 00:01:58.204 [692/745] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:58.204 [693/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:58.204 [694/745] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:58.463 [695/745] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:58.463 [696/745] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:58.721 [697/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:58.721 [698/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:59.288 [699/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:59.289 [700/745] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:59.289 [701/745] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:59.289 [702/745] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:59.289 [703/745] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:59.855 [704/745] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:59.855 [705/745] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:59.855 [706/745] Compiling C object drivers/librte_net_i40e.so.23.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:59.855 [707/745] Linking static target drivers/librte_net_i40e.a 00:01:59.855 [708/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:59.855 [709/745] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:02:00.422 [710/745] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:02:00.422 [711/745] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.422 [712/745] Linking target drivers/librte_net_i40e.so.23.0 00:02:00.988 [713/745] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:02:00.988 [714/745] Linking static target lib/librte_node.a 00:02:01.246 [715/745] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.246 [716/745] Linking target lib/librte_node.so.23.0 00:02:01.505 [717/745] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:02:02.072 [718/745] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:03.005 [719/745] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:02:11.119 [720/745] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:43.221 [721/745] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:43.221 [722/745] Linking static target lib/librte_vhost.a 00:02:43.221 [723/745] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:43.221 [724/745] Linking target lib/librte_vhost.so.23.0 00:02:55.447 [725/745] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:55.447 [726/745] Linking static target lib/librte_pipeline.a 00:02:55.447 [727/745] Linking target app/dpdk-pdump 00:02:55.447 [728/745] Linking target app/dpdk-test-flow-perf 00:02:55.447 [729/745] Linking target app/dpdk-test-bbdev 00:02:55.447 [730/745] Linking target app/dpdk-test-fib 00:02:55.447 [731/745] Linking target app/dpdk-test-regex 00:02:55.447 [732/745] Linking target app/dpdk-test-pipeline 00:02:55.447 [733/745] Linking target app/dpdk-test-security-perf 00:02:55.447 [734/745] Linking target app/dpdk-test-cmdline 00:02:55.447 [735/745] Linking target app/dpdk-proc-info 00:02:55.447 [736/745] Linking target app/dpdk-test-sad 00:02:55.447 [737/745] Linking target app/dpdk-test-gpudev 00:02:55.447 [738/745] Linking target app/dpdk-test-acl 00:02:55.447 [739/745] Linking target app/dpdk-dumpcap 00:02:55.447 [740/745] Linking target app/dpdk-test-eventdev 00:02:55.447 [741/745] Linking target app/dpdk-test-crypto-perf 00:02:55.447 [742/745] Linking target app/dpdk-test-compress-perf 00:02:55.447 [743/745] Linking target app/dpdk-testpmd 00:02:56.018 [744/745] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:56.277 [745/745] Linking target lib/librte_pipeline.so.23.0 00:02:56.277 14:57:56 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:56.277 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:56.277 [0/1] Installing files. 00:02:56.539 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:56.539 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:56.539 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:56.539 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:56.539 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:56.539 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:56.540 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/flow_classify.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/ipv4_rules_file.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_classify/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_classify 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.541 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/node 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/server 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.542 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.543 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.805 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/kni.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/kni.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:56.806 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:56.807 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:56.807 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing lib/librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing lib/librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing drivers/librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.383 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing drivers/librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.383 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing drivers/librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.383 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.383 Installing drivers/librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0 00:02:57.383 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.383 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.384 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.385 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.386 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_empty_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_intel_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.387 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.388 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:57.389 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:57.389 Installing symlink pointing to librte_kvargs.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.23 00:02:57.389 Installing symlink pointing to librte_kvargs.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:57.389 Installing symlink pointing to librte_telemetry.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.23 00:02:57.389 Installing symlink pointing to librte_telemetry.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:57.389 Installing symlink pointing to librte_eal.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.23 00:02:57.389 Installing symlink pointing to librte_eal.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:57.389 Installing symlink pointing to librte_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.23 00:02:57.389 Installing symlink pointing to librte_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:57.389 Installing symlink pointing to librte_rcu.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.23 00:02:57.389 Installing symlink pointing to librte_rcu.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:57.389 Installing symlink pointing to librte_mempool.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.23 00:02:57.389 Installing symlink pointing to librte_mempool.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:57.389 Installing symlink pointing to librte_mbuf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.23 00:02:57.389 Installing symlink pointing to librte_mbuf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:57.389 Installing symlink pointing to librte_net.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.23 00:02:57.389 Installing symlink pointing to librte_net.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:57.389 Installing symlink pointing to librte_meter.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.23 00:02:57.389 Installing symlink pointing to librte_meter.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:57.389 Installing symlink pointing to librte_ethdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.23 00:02:57.389 Installing symlink pointing to librte_ethdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:57.389 Installing symlink pointing to librte_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.23 00:02:57.389 Installing symlink pointing to librte_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:57.389 Installing symlink pointing to librte_cmdline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.23 00:02:57.389 Installing symlink pointing to librte_cmdline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:57.389 Installing symlink pointing to librte_metrics.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.23 00:02:57.389 Installing symlink pointing to librte_metrics.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:57.389 Installing symlink pointing to librte_hash.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.23 00:02:57.389 Installing symlink pointing to librte_hash.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:57.389 Installing symlink pointing to librte_timer.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.23 00:02:57.389 Installing symlink pointing to librte_timer.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:57.389 Installing symlink pointing to librte_acl.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.23 00:02:57.389 Installing symlink pointing to librte_acl.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:57.389 Installing symlink pointing to librte_bbdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.23 00:02:57.389 Installing symlink pointing to librte_bbdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:57.389 Installing symlink pointing to librte_bitratestats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.23 00:02:57.389 Installing symlink pointing to librte_bitratestats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:57.389 Installing symlink pointing to librte_bpf.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.23 00:02:57.389 Installing symlink pointing to librte_bpf.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:57.389 Installing symlink pointing to librte_cfgfile.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.23 00:02:57.389 Installing symlink pointing to librte_cfgfile.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:57.389 Installing symlink pointing to librte_compressdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.23 00:02:57.389 Installing symlink pointing to librte_compressdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:57.389 Installing symlink pointing to librte_cryptodev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.23 00:02:57.390 Installing symlink pointing to librte_cryptodev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:57.390 Installing symlink pointing to librte_distributor.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.23 00:02:57.390 Installing symlink pointing to librte_distributor.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:57.390 Installing symlink pointing to librte_efd.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.23 00:02:57.390 Installing symlink pointing to librte_efd.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:57.390 Installing symlink pointing to librte_eventdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.23 00:02:57.390 Installing symlink pointing to librte_eventdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:57.390 Installing symlink pointing to librte_gpudev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.23 00:02:57.390 Installing symlink pointing to librte_gpudev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:57.390 Installing symlink pointing to librte_gro.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.23 00:02:57.390 Installing symlink pointing to librte_gro.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:57.390 Installing symlink pointing to librte_gso.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.23 00:02:57.390 Installing symlink pointing to librte_gso.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:57.390 Installing symlink pointing to librte_ip_frag.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.23 00:02:57.390 Installing symlink pointing to librte_ip_frag.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:57.390 Installing symlink pointing to librte_jobstats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.23 00:02:57.390 Installing symlink pointing to librte_jobstats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:57.390 Installing symlink pointing to librte_latencystats.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.23 00:02:57.390 Installing symlink pointing to librte_latencystats.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:57.390 Installing symlink pointing to librte_lpm.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.23 00:02:57.390 Installing symlink pointing to librte_lpm.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:57.390 Installing symlink pointing to librte_member.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.23 00:02:57.390 Installing symlink pointing to librte_member.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:57.390 Installing symlink pointing to librte_pcapng.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.23 00:02:57.390 Installing symlink pointing to librte_pcapng.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:57.390 Installing symlink pointing to librte_power.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.23 00:02:57.390 Installing symlink pointing to librte_power.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:57.390 Installing symlink pointing to librte_rawdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.23 00:02:57.390 Installing symlink pointing to librte_rawdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:57.390 Installing symlink pointing to librte_regexdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.23 00:02:57.390 Installing symlink pointing to librte_regexdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:57.390 Installing symlink pointing to librte_dmadev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.23 00:02:57.390 Installing symlink pointing to librte_dmadev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:57.390 Installing symlink pointing to librte_rib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.23 00:02:57.390 Installing symlink pointing to librte_rib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:57.390 Installing symlink pointing to librte_reorder.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.23 00:02:57.390 Installing symlink pointing to librte_reorder.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:57.390 Installing symlink pointing to librte_sched.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.23 00:02:57.390 Installing symlink pointing to librte_sched.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:57.390 Installing symlink pointing to librte_security.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.23 00:02:57.390 Installing symlink pointing to librte_security.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:57.390 Installing symlink pointing to librte_stack.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.23 00:02:57.390 Installing symlink pointing to librte_stack.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:57.390 Installing symlink pointing to librte_vhost.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.23 00:02:57.390 Installing symlink pointing to librte_vhost.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:57.390 Installing symlink pointing to librte_ipsec.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.23 00:02:57.390 Installing symlink pointing to librte_ipsec.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:57.390 Installing symlink pointing to librte_fib.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.23 00:02:57.390 Installing symlink pointing to librte_fib.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:57.390 Installing symlink pointing to librte_port.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.23 00:02:57.390 Installing symlink pointing to librte_port.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:57.390 Installing symlink pointing to librte_pdump.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.23 00:02:57.390 Installing symlink pointing to librte_pdump.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:57.390 Installing symlink pointing to librte_table.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.23 00:02:57.390 Installing symlink pointing to librte_table.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:57.390 Installing symlink pointing to librte_pipeline.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.23 00:02:57.390 Installing symlink pointing to librte_pipeline.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:57.390 Installing symlink pointing to librte_graph.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.23 00:02:57.390 Installing symlink pointing to librte_graph.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:57.390 Installing symlink pointing to librte_node.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.23 00:02:57.390 Installing symlink pointing to librte_node.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:57.391 Installing symlink pointing to librte_bus_pci.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23 00:02:57.391 Installing symlink pointing to librte_bus_pci.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:02:57.391 Installing symlink pointing to librte_bus_vdev.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23 00:02:57.391 Installing symlink pointing to librte_bus_vdev.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:02:57.391 Installing symlink pointing to librte_mempool_ring.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23 00:02:57.391 Installing symlink pointing to librte_mempool_ring.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:02:57.391 Installing symlink pointing to librte_net_i40e.so.23.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23 00:02:57.391 './librte_bus_pci.so' -> 'dpdk/pmds-23.0/librte_bus_pci.so' 00:02:57.391 './librte_bus_pci.so.23' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23' 00:02:57.391 './librte_bus_pci.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_pci.so.23.0' 00:02:57.391 './librte_bus_vdev.so' -> 'dpdk/pmds-23.0/librte_bus_vdev.so' 00:02:57.391 './librte_bus_vdev.so.23' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23' 00:02:57.391 './librte_bus_vdev.so.23.0' -> 'dpdk/pmds-23.0/librte_bus_vdev.so.23.0' 00:02:57.391 './librte_mempool_ring.so' -> 'dpdk/pmds-23.0/librte_mempool_ring.so' 00:02:57.391 './librte_mempool_ring.so.23' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23' 00:02:57.391 './librte_mempool_ring.so.23.0' -> 'dpdk/pmds-23.0/librte_mempool_ring.so.23.0' 00:02:57.391 './librte_net_i40e.so' -> 'dpdk/pmds-23.0/librte_net_i40e.so' 00:02:57.391 './librte_net_i40e.so.23' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23' 00:02:57.391 './librte_net_i40e.so.23.0' -> 'dpdk/pmds-23.0/librte_net_i40e.so.23.0' 00:02:57.391 Installing symlink pointing to librte_net_i40e.so.23 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:02:57.391 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-23.0' 00:02:57.391 14:57:57 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:57.391 14:57:57 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:57.391 14:57:57 -- common/autobuild_common.sh@203 -- $ cat 00:02:57.391 14:57:57 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:57.391 00:02:57.391 real 1m22.657s 00:02:57.391 user 14m26.338s 00:02:57.391 sys 1m49.598s 00:02:57.391 14:57:57 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:57.391 14:57:57 -- common/autotest_common.sh@10 -- $ set +x 00:02:57.391 ************************************ 00:02:57.391 END TEST build_native_dpdk 00:02:57.391 ************************************ 00:02:57.391 14:57:57 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:57.391 14:57:57 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:57.391 14:57:57 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:57.391 14:57:57 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:57.391 14:57:57 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:57.391 14:57:57 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:57.391 14:57:57 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:57.391 14:57:57 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:57.391 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:57.652 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:57.652 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:57.652 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:57.913 Using 'verbs' RDMA provider 00:03:08.154 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:18.138 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:18.138 Creating mk/config.mk...done. 00:03:18.138 Creating mk/cc.flags.mk...done. 00:03:18.138 Type 'make' to build. 00:03:18.138 14:58:16 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:18.138 14:58:16 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:18.138 14:58:16 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:18.138 14:58:16 -- common/autotest_common.sh@10 -- $ set +x 00:03:18.138 ************************************ 00:03:18.138 START TEST make 00:03:18.139 ************************************ 00:03:18.139 14:58:17 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:18.139 make[1]: Nothing to be done for 'all'. 00:03:18.713 The Meson build system 00:03:18.713 Version: 1.5.0 00:03:18.713 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:18.713 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:18.713 Build type: native build 00:03:18.713 Project name: libvfio-user 00:03:18.713 Project version: 0.0.1 00:03:18.713 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:18.713 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:18.713 Host machine cpu family: x86_64 00:03:18.713 Host machine cpu: x86_64 00:03:18.713 Run-time dependency threads found: YES 00:03:18.713 Library dl found: YES 00:03:18.713 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:18.713 Run-time dependency json-c found: YES 0.17 00:03:18.713 Run-time dependency cmocka found: YES 1.1.7 00:03:18.713 Program pytest-3 found: NO 00:03:18.713 Program flake8 found: NO 00:03:18.713 Program misspell-fixer found: NO 00:03:18.713 Program restructuredtext-lint found: NO 00:03:18.713 Program valgrind found: YES (/usr/bin/valgrind) 00:03:18.713 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:18.713 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:18.713 Compiler for C supports arguments -Wwrite-strings: YES 00:03:18.713 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:18.713 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:18.713 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:18.714 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:18.714 Build targets in project: 8 00:03:18.714 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:18.714 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:18.714 00:03:18.714 libvfio-user 0.0.1 00:03:18.714 00:03:18.714 User defined options 00:03:18.714 buildtype : debug 00:03:18.714 default_library: shared 00:03:18.714 libdir : /usr/local/lib 00:03:18.714 00:03:18.714 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:19.672 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:19.936 [1/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:19.936 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:19.936 [3/37] Compiling C object samples/null.p/null.c.o 00:03:19.936 [4/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:19.936 [5/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:19.936 [6/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:19.936 [7/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:19.936 [8/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:19.936 [9/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:19.936 [10/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:19.936 [11/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:19.936 [12/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:19.936 [13/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:19.936 [14/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:19.936 [15/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:19.936 [16/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:19.936 [17/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:19.936 [18/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:19.936 [19/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:19.936 [20/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:19.936 [21/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:19.936 [22/37] Compiling C object samples/server.p/server.c.o 00:03:19.936 [23/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:19.936 [24/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:19.936 [25/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:20.196 [26/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:20.196 [27/37] Compiling C object samples/client.p/client.c.o 00:03:20.196 [28/37] Linking target lib/libvfio-user.so.0.0.1 00:03:20.196 [29/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:20.196 [30/37] Linking target samples/client 00:03:20.196 [31/37] Linking target test/unit_tests 00:03:20.460 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:20.460 [33/37] Linking target samples/null 00:03:20.460 [34/37] Linking target samples/gpio-pci-idio-16 00:03:20.460 [35/37] Linking target samples/server 00:03:20.460 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:20.460 [37/37] Linking target samples/lspci 00:03:20.460 INFO: autodetecting backend as ninja 00:03:20.460 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:20.720 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:21.293 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:21.293 ninja: no work to do. 00:03:33.501 CC lib/ut_mock/mock.o 00:03:33.501 CC lib/ut/ut.o 00:03:33.501 CC lib/log/log.o 00:03:33.501 CC lib/log/log_flags.o 00:03:33.501 CC lib/log/log_deprecated.o 00:03:33.501 LIB libspdk_ut_mock.a 00:03:33.501 SO libspdk_ut_mock.so.5.0 00:03:33.501 LIB libspdk_ut.a 00:03:33.501 LIB libspdk_log.a 00:03:33.501 SO libspdk_ut.so.1.0 00:03:33.501 SYMLINK libspdk_ut_mock.so 00:03:33.501 SO libspdk_log.so.6.1 00:03:33.501 SYMLINK libspdk_ut.so 00:03:33.501 SYMLINK libspdk_log.so 00:03:33.501 CC lib/ioat/ioat.o 00:03:33.501 CC lib/dma/dma.o 00:03:33.501 CXX lib/trace_parser/trace.o 00:03:33.501 CC lib/util/base64.o 00:03:33.501 CC lib/util/bit_array.o 00:03:33.501 CC lib/util/cpuset.o 00:03:33.501 CC lib/util/crc16.o 00:03:33.501 CC lib/util/crc32.o 00:03:33.501 CC lib/util/crc32c.o 00:03:33.501 CC lib/util/crc32_ieee.o 00:03:33.501 CC lib/util/crc64.o 00:03:33.501 CC lib/util/dif.o 00:03:33.501 CC lib/util/fd.o 00:03:33.501 CC lib/util/file.o 00:03:33.501 CC lib/util/hexlify.o 00:03:33.501 CC lib/util/iov.o 00:03:33.501 CC lib/util/math.o 00:03:33.501 CC lib/util/pipe.o 00:03:33.501 CC lib/util/strerror_tls.o 00:03:33.501 CC lib/util/string.o 00:03:33.501 CC lib/util/uuid.o 00:03:33.501 CC lib/util/fd_group.o 00:03:33.501 CC lib/util/xor.o 00:03:33.501 CC lib/util/zipf.o 00:03:33.501 CC lib/vfio_user/host/vfio_user_pci.o 00:03:33.501 CC lib/vfio_user/host/vfio_user.o 00:03:33.501 LIB libspdk_dma.a 00:03:33.501 SO libspdk_dma.so.3.0 00:03:33.501 SYMLINK libspdk_dma.so 00:03:33.501 LIB libspdk_ioat.a 00:03:33.501 SO libspdk_ioat.so.6.0 00:03:33.501 SYMLINK libspdk_ioat.so 00:03:33.501 LIB libspdk_vfio_user.a 00:03:33.501 SO libspdk_vfio_user.so.4.0 00:03:33.501 SYMLINK libspdk_vfio_user.so 00:03:33.501 LIB libspdk_util.a 00:03:33.501 SO libspdk_util.so.8.0 00:03:33.501 SYMLINK libspdk_util.so 00:03:33.501 CC lib/json/json_parse.o 00:03:33.501 CC lib/vmd/vmd.o 00:03:33.501 CC lib/conf/conf.o 00:03:33.501 CC lib/vmd/led.o 00:03:33.501 CC lib/idxd/idxd.o 00:03:33.501 CC lib/json/json_util.o 00:03:33.501 CC lib/idxd/idxd_user.o 00:03:33.501 CC lib/env_dpdk/env.o 00:03:33.501 CC lib/json/json_write.o 00:03:33.501 CC lib/rdma/common.o 00:03:33.501 CC lib/env_dpdk/memory.o 00:03:33.501 CC lib/idxd/idxd_kernel.o 00:03:33.501 CC lib/rdma/rdma_verbs.o 00:03:33.501 CC lib/env_dpdk/pci.o 00:03:33.501 CC lib/env_dpdk/init.o 00:03:33.501 CC lib/env_dpdk/threads.o 00:03:33.501 CC lib/env_dpdk/pci_ioat.o 00:03:33.501 CC lib/env_dpdk/pci_virtio.o 00:03:33.501 CC lib/env_dpdk/pci_vmd.o 00:03:33.501 CC lib/env_dpdk/pci_idxd.o 00:03:33.501 CC lib/env_dpdk/sigbus_handler.o 00:03:33.501 CC lib/env_dpdk/pci_event.o 00:03:33.501 CC lib/env_dpdk/pci_dpdk.o 00:03:33.501 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:33.501 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:33.501 LIB libspdk_trace_parser.a 00:03:33.501 SO libspdk_trace_parser.so.4.0 00:03:33.501 SYMLINK libspdk_trace_parser.so 00:03:33.501 LIB libspdk_conf.a 00:03:33.501 SO libspdk_conf.so.5.0 00:03:33.501 LIB libspdk_json.a 00:03:33.501 SYMLINK libspdk_conf.so 00:03:33.501 SO libspdk_json.so.5.1 00:03:33.501 SYMLINK libspdk_json.so 00:03:33.501 LIB libspdk_rdma.a 00:03:33.501 SO libspdk_rdma.so.5.0 00:03:33.501 SYMLINK libspdk_rdma.so 00:03:33.501 CC lib/jsonrpc/jsonrpc_server.o 00:03:33.501 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:33.501 CC lib/jsonrpc/jsonrpc_client.o 00:03:33.501 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:33.501 LIB libspdk_idxd.a 00:03:33.501 SO libspdk_idxd.so.11.0 00:03:33.760 SYMLINK libspdk_idxd.so 00:03:33.760 LIB libspdk_vmd.a 00:03:33.760 SO libspdk_vmd.so.5.0 00:03:33.760 SYMLINK libspdk_vmd.so 00:03:33.760 LIB libspdk_jsonrpc.a 00:03:33.760 SO libspdk_jsonrpc.so.5.1 00:03:33.760 SYMLINK libspdk_jsonrpc.so 00:03:34.019 CC lib/rpc/rpc.o 00:03:34.277 LIB libspdk_rpc.a 00:03:34.277 SO libspdk_rpc.so.5.0 00:03:34.277 SYMLINK libspdk_rpc.so 00:03:34.277 CC lib/notify/notify.o 00:03:34.277 CC lib/notify/notify_rpc.o 00:03:34.277 CC lib/trace/trace.o 00:03:34.277 CC lib/trace/trace_flags.o 00:03:34.277 CC lib/sock/sock.o 00:03:34.277 CC lib/trace/trace_rpc.o 00:03:34.277 CC lib/sock/sock_rpc.o 00:03:34.536 LIB libspdk_notify.a 00:03:34.536 SO libspdk_notify.so.5.0 00:03:34.536 SYMLINK libspdk_notify.so 00:03:34.536 LIB libspdk_trace.a 00:03:34.536 SO libspdk_trace.so.9.0 00:03:34.536 SYMLINK libspdk_trace.so 00:03:34.794 LIB libspdk_sock.a 00:03:34.794 CC lib/thread/thread.o 00:03:34.794 CC lib/thread/iobuf.o 00:03:34.794 SO libspdk_sock.so.8.0 00:03:34.794 SYMLINK libspdk_sock.so 00:03:34.794 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:34.794 CC lib/nvme/nvme_ctrlr.o 00:03:34.794 CC lib/nvme/nvme_fabric.o 00:03:34.794 CC lib/nvme/nvme_ns_cmd.o 00:03:34.794 CC lib/nvme/nvme_ns.o 00:03:34.794 CC lib/nvme/nvme_pcie_common.o 00:03:34.794 CC lib/nvme/nvme_pcie.o 00:03:34.794 CC lib/nvme/nvme_qpair.o 00:03:34.794 CC lib/nvme/nvme.o 00:03:34.794 CC lib/nvme/nvme_quirks.o 00:03:34.794 CC lib/nvme/nvme_transport.o 00:03:34.794 CC lib/nvme/nvme_discovery.o 00:03:34.794 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:34.794 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:34.794 CC lib/nvme/nvme_tcp.o 00:03:34.794 CC lib/nvme/nvme_opal.o 00:03:34.794 CC lib/nvme/nvme_io_msg.o 00:03:34.794 CC lib/nvme/nvme_poll_group.o 00:03:34.794 CC lib/nvme/nvme_zns.o 00:03:34.794 CC lib/nvme/nvme_cuse.o 00:03:34.794 CC lib/nvme/nvme_vfio_user.o 00:03:35.066 CC lib/nvme/nvme_rdma.o 00:03:35.066 LIB libspdk_env_dpdk.a 00:03:35.066 SO libspdk_env_dpdk.so.13.0 00:03:35.331 SYMLINK libspdk_env_dpdk.so 00:03:36.266 LIB libspdk_thread.a 00:03:36.525 SO libspdk_thread.so.9.0 00:03:36.525 SYMLINK libspdk_thread.so 00:03:36.525 CC lib/blob/blobstore.o 00:03:36.525 CC lib/init/json_config.o 00:03:36.525 CC lib/blob/request.o 00:03:36.525 CC lib/virtio/virtio.o 00:03:36.525 CC lib/init/subsystem.o 00:03:36.525 CC lib/blob/zeroes.o 00:03:36.525 CC lib/init/subsystem_rpc.o 00:03:36.525 CC lib/virtio/virtio_vhost_user.o 00:03:36.525 CC lib/blob/blob_bs_dev.o 00:03:36.525 CC lib/init/rpc.o 00:03:36.525 CC lib/virtio/virtio_vfio_user.o 00:03:36.525 CC lib/virtio/virtio_pci.o 00:03:36.525 CC lib/vfu_tgt/tgt_endpoint.o 00:03:36.525 CC lib/accel/accel.o 00:03:36.525 CC lib/vfu_tgt/tgt_rpc.o 00:03:36.525 CC lib/accel/accel_rpc.o 00:03:36.525 CC lib/accel/accel_sw.o 00:03:36.784 LIB libspdk_init.a 00:03:36.784 SO libspdk_init.so.4.0 00:03:36.784 SYMLINK libspdk_init.so 00:03:36.784 LIB libspdk_virtio.a 00:03:36.784 LIB libspdk_vfu_tgt.a 00:03:37.043 SO libspdk_virtio.so.6.0 00:03:37.043 SO libspdk_vfu_tgt.so.2.0 00:03:37.043 SYMLINK libspdk_vfu_tgt.so 00:03:37.043 SYMLINK libspdk_virtio.so 00:03:37.043 CC lib/event/app.o 00:03:37.043 CC lib/event/reactor.o 00:03:37.043 CC lib/event/log_rpc.o 00:03:37.043 CC lib/event/app_rpc.o 00:03:37.043 CC lib/event/scheduler_static.o 00:03:37.301 LIB libspdk_nvme.a 00:03:37.301 SO libspdk_nvme.so.12.0 00:03:37.301 LIB libspdk_event.a 00:03:37.560 SO libspdk_event.so.12.0 00:03:37.560 SYMLINK libspdk_event.so 00:03:37.560 SYMLINK libspdk_nvme.so 00:03:37.560 LIB libspdk_accel.a 00:03:37.560 SO libspdk_accel.so.14.0 00:03:37.818 SYMLINK libspdk_accel.so 00:03:37.818 CC lib/bdev/bdev.o 00:03:37.818 CC lib/bdev/bdev_rpc.o 00:03:37.818 CC lib/bdev/bdev_zone.o 00:03:37.818 CC lib/bdev/part.o 00:03:37.818 CC lib/bdev/scsi_nvme.o 00:03:39.719 LIB libspdk_blob.a 00:03:39.719 SO libspdk_blob.so.10.1 00:03:39.719 SYMLINK libspdk_blob.so 00:03:39.719 CC lib/blobfs/blobfs.o 00:03:39.719 CC lib/blobfs/tree.o 00:03:39.719 CC lib/lvol/lvol.o 00:03:40.284 LIB libspdk_blobfs.a 00:03:40.284 LIB libspdk_bdev.a 00:03:40.284 SO libspdk_blobfs.so.9.0 00:03:40.284 SO libspdk_bdev.so.14.0 00:03:40.284 LIB libspdk_lvol.a 00:03:40.550 SYMLINK libspdk_blobfs.so 00:03:40.550 SO libspdk_lvol.so.9.1 00:03:40.550 SYMLINK libspdk_bdev.so 00:03:40.550 SYMLINK libspdk_lvol.so 00:03:40.550 CC lib/nvmf/ctrlr.o 00:03:40.550 CC lib/nvmf/ctrlr_discovery.o 00:03:40.550 CC lib/nvmf/ctrlr_bdev.o 00:03:40.550 CC lib/nvmf/subsystem.o 00:03:40.550 CC lib/nvmf/nvmf.o 00:03:40.550 CC lib/nvmf/nvmf_rpc.o 00:03:40.550 CC lib/nvmf/transport.o 00:03:40.550 CC lib/ublk/ublk.o 00:03:40.550 CC lib/nbd/nbd.o 00:03:40.550 CC lib/ublk/ublk_rpc.o 00:03:40.550 CC lib/nvmf/tcp.o 00:03:40.550 CC lib/ftl/ftl_core.o 00:03:40.550 CC lib/nbd/nbd_rpc.o 00:03:40.550 CC lib/nvmf/vfio_user.o 00:03:40.550 CC lib/ftl/ftl_init.o 00:03:40.550 CC lib/nvmf/rdma.o 00:03:40.550 CC lib/ftl/ftl_layout.o 00:03:40.550 CC lib/ftl/ftl_debug.o 00:03:40.550 CC lib/scsi/dev.o 00:03:40.550 CC lib/ftl/ftl_io.o 00:03:40.550 CC lib/scsi/lun.o 00:03:40.550 CC lib/ftl/ftl_sb.o 00:03:40.550 CC lib/scsi/port.o 00:03:40.550 CC lib/ftl/ftl_l2p.o 00:03:40.550 CC lib/scsi/scsi.o 00:03:40.550 CC lib/ftl/ftl_l2p_flat.o 00:03:40.550 CC lib/ftl/ftl_nv_cache.o 00:03:40.550 CC lib/scsi/scsi_pr.o 00:03:40.550 CC lib/scsi/scsi_bdev.o 00:03:40.550 CC lib/scsi/scsi_rpc.o 00:03:40.550 CC lib/ftl/ftl_band.o 00:03:40.550 CC lib/ftl/ftl_band_ops.o 00:03:40.550 CC lib/scsi/task.o 00:03:40.550 CC lib/ftl/ftl_writer.o 00:03:40.550 CC lib/ftl/ftl_rq.o 00:03:40.550 CC lib/ftl/ftl_reloc.o 00:03:40.550 CC lib/ftl/ftl_l2p_cache.o 00:03:40.550 CC lib/ftl/ftl_p2l.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:40.550 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:41.121 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:41.121 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:41.121 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:41.121 CC lib/ftl/utils/ftl_conf.o 00:03:41.121 CC lib/ftl/utils/ftl_md.o 00:03:41.121 CC lib/ftl/utils/ftl_mempool.o 00:03:41.121 CC lib/ftl/utils/ftl_bitmap.o 00:03:41.121 CC lib/ftl/utils/ftl_property.o 00:03:41.121 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:41.121 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:41.121 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:41.121 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:41.121 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:41.121 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:41.121 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:41.121 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:41.121 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:41.121 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:41.121 CC lib/ftl/base/ftl_base_dev.o 00:03:41.121 CC lib/ftl/base/ftl_base_bdev.o 00:03:41.121 CC lib/ftl/ftl_trace.o 00:03:41.379 LIB libspdk_nbd.a 00:03:41.379 SO libspdk_nbd.so.6.0 00:03:41.379 SYMLINK libspdk_nbd.so 00:03:41.379 LIB libspdk_scsi.a 00:03:41.637 SO libspdk_scsi.so.8.0 00:03:41.637 SYMLINK libspdk_scsi.so 00:03:41.637 LIB libspdk_ublk.a 00:03:41.637 SO libspdk_ublk.so.2.0 00:03:41.637 SYMLINK libspdk_ublk.so 00:03:41.637 CC lib/vhost/vhost.o 00:03:41.637 CC lib/iscsi/conn.o 00:03:41.637 CC lib/iscsi/init_grp.o 00:03:41.637 CC lib/vhost/vhost_rpc.o 00:03:41.637 CC lib/iscsi/iscsi.o 00:03:41.637 CC lib/vhost/vhost_scsi.o 00:03:41.637 CC lib/iscsi/md5.o 00:03:41.637 CC lib/vhost/vhost_blk.o 00:03:41.638 CC lib/iscsi/param.o 00:03:41.638 CC lib/vhost/rte_vhost_user.o 00:03:41.638 CC lib/iscsi/portal_grp.o 00:03:41.638 CC lib/iscsi/tgt_node.o 00:03:41.638 CC lib/iscsi/iscsi_subsystem.o 00:03:41.638 CC lib/iscsi/iscsi_rpc.o 00:03:41.638 CC lib/iscsi/task.o 00:03:41.896 LIB libspdk_ftl.a 00:03:42.153 SO libspdk_ftl.so.8.0 00:03:42.410 SYMLINK libspdk_ftl.so 00:03:42.977 LIB libspdk_vhost.a 00:03:42.977 SO libspdk_vhost.so.7.1 00:03:42.977 SYMLINK libspdk_vhost.so 00:03:43.235 LIB libspdk_nvmf.a 00:03:43.235 LIB libspdk_iscsi.a 00:03:43.235 SO libspdk_nvmf.so.17.0 00:03:43.235 SO libspdk_iscsi.so.7.0 00:03:43.235 SYMLINK libspdk_iscsi.so 00:03:43.494 SYMLINK libspdk_nvmf.so 00:03:43.494 CC module/vfu_device/vfu_virtio.o 00:03:43.494 CC module/env_dpdk/env_dpdk_rpc.o 00:03:43.494 CC module/vfu_device/vfu_virtio_blk.o 00:03:43.494 CC module/vfu_device/vfu_virtio_scsi.o 00:03:43.494 CC module/vfu_device/vfu_virtio_rpc.o 00:03:43.494 CC module/accel/error/accel_error.o 00:03:43.494 CC module/blob/bdev/blob_bdev.o 00:03:43.494 CC module/accel/error/accel_error_rpc.o 00:03:43.494 CC module/accel/ioat/accel_ioat.o 00:03:43.494 CC module/accel/iaa/accel_iaa.o 00:03:43.494 CC module/accel/iaa/accel_iaa_rpc.o 00:03:43.494 CC module/accel/ioat/accel_ioat_rpc.o 00:03:43.494 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:43.494 CC module/sock/posix/posix.o 00:03:43.494 CC module/accel/dsa/accel_dsa.o 00:03:43.494 CC module/accel/dsa/accel_dsa_rpc.o 00:03:43.494 CC module/scheduler/gscheduler/gscheduler.o 00:03:43.494 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:43.752 LIB libspdk_env_dpdk_rpc.a 00:03:43.752 SO libspdk_env_dpdk_rpc.so.5.0 00:03:43.752 SYMLINK libspdk_env_dpdk_rpc.so 00:03:43.752 LIB libspdk_scheduler_gscheduler.a 00:03:43.752 LIB libspdk_scheduler_dpdk_governor.a 00:03:43.752 SO libspdk_scheduler_gscheduler.so.3.0 00:03:43.752 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:43.752 LIB libspdk_accel_error.a 00:03:43.752 LIB libspdk_accel_ioat.a 00:03:43.752 LIB libspdk_scheduler_dynamic.a 00:03:43.752 SO libspdk_accel_error.so.1.0 00:03:43.752 LIB libspdk_accel_iaa.a 00:03:43.752 SO libspdk_accel_ioat.so.5.0 00:03:43.752 SO libspdk_scheduler_dynamic.so.3.0 00:03:43.752 SYMLINK libspdk_scheduler_gscheduler.so 00:03:43.752 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:43.752 SO libspdk_accel_iaa.so.2.0 00:03:44.010 LIB libspdk_accel_dsa.a 00:03:44.010 SYMLINK libspdk_accel_error.so 00:03:44.010 SYMLINK libspdk_accel_ioat.so 00:03:44.010 SYMLINK libspdk_scheduler_dynamic.so 00:03:44.010 LIB libspdk_blob_bdev.a 00:03:44.010 SO libspdk_accel_dsa.so.4.0 00:03:44.010 SYMLINK libspdk_accel_iaa.so 00:03:44.010 SO libspdk_blob_bdev.so.10.1 00:03:44.010 SYMLINK libspdk_accel_dsa.so 00:03:44.010 SYMLINK libspdk_blob_bdev.so 00:03:44.276 CC module/bdev/delay/vbdev_delay.o 00:03:44.276 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:44.276 CC module/bdev/malloc/bdev_malloc.o 00:03:44.276 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:44.276 CC module/blobfs/bdev/blobfs_bdev.o 00:03:44.276 CC module/bdev/gpt/gpt.o 00:03:44.276 CC module/bdev/null/bdev_null.o 00:03:44.276 CC module/bdev/error/vbdev_error_rpc.o 00:03:44.276 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:44.276 CC module/bdev/null/bdev_null_rpc.o 00:03:44.276 CC module/bdev/gpt/vbdev_gpt.o 00:03:44.276 CC module/bdev/error/vbdev_error.o 00:03:44.276 CC module/bdev/lvol/vbdev_lvol.o 00:03:44.276 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:44.276 CC module/bdev/passthru/vbdev_passthru.o 00:03:44.276 CC module/bdev/iscsi/bdev_iscsi.o 00:03:44.276 CC module/bdev/split/vbdev_split.o 00:03:44.276 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:44.276 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:44.276 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:44.276 CC module/bdev/split/vbdev_split_rpc.o 00:03:44.276 CC module/bdev/raid/bdev_raid.o 00:03:44.276 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:44.276 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:44.276 CC module/bdev/raid/bdev_raid_rpc.o 00:03:44.276 CC module/bdev/nvme/bdev_nvme.o 00:03:44.276 CC module/bdev/raid/bdev_raid_sb.o 00:03:44.276 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:44.276 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:44.276 CC module/bdev/ftl/bdev_ftl.o 00:03:44.276 CC module/bdev/raid/raid0.o 00:03:44.276 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:44.276 CC module/bdev/nvme/nvme_rpc.o 00:03:44.276 CC module/bdev/raid/raid1.o 00:03:44.276 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:44.276 CC module/bdev/nvme/bdev_mdns_client.o 00:03:44.276 CC module/bdev/raid/concat.o 00:03:44.276 CC module/bdev/nvme/vbdev_opal.o 00:03:44.276 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:44.276 CC module/bdev/aio/bdev_aio.o 00:03:44.276 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:44.276 CC module/bdev/aio/bdev_aio_rpc.o 00:03:44.276 LIB libspdk_vfu_device.a 00:03:44.276 SO libspdk_vfu_device.so.2.0 00:03:44.535 SYMLINK libspdk_vfu_device.so 00:03:44.535 LIB libspdk_bdev_error.a 00:03:44.535 LIB libspdk_bdev_null.a 00:03:44.535 SO libspdk_bdev_null.so.5.0 00:03:44.535 SO libspdk_bdev_error.so.5.0 00:03:44.535 LIB libspdk_blobfs_bdev.a 00:03:44.535 SO libspdk_blobfs_bdev.so.5.0 00:03:44.535 LIB libspdk_bdev_gpt.a 00:03:44.535 SYMLINK libspdk_bdev_error.so 00:03:44.535 SO libspdk_bdev_gpt.so.5.0 00:03:44.535 SYMLINK libspdk_bdev_null.so 00:03:44.535 LIB libspdk_sock_posix.a 00:03:44.535 SYMLINK libspdk_blobfs_bdev.so 00:03:44.535 LIB libspdk_bdev_split.a 00:03:44.535 SO libspdk_sock_posix.so.5.0 00:03:44.535 SYMLINK libspdk_bdev_gpt.so 00:03:44.535 SO libspdk_bdev_split.so.5.0 00:03:44.535 LIB libspdk_bdev_passthru.a 00:03:44.793 SO libspdk_bdev_passthru.so.5.0 00:03:44.793 SYMLINK libspdk_sock_posix.so 00:03:44.793 LIB libspdk_bdev_ftl.a 00:03:44.793 SYMLINK libspdk_bdev_split.so 00:03:44.793 SO libspdk_bdev_ftl.so.5.0 00:03:44.793 SYMLINK libspdk_bdev_passthru.so 00:03:44.793 LIB libspdk_bdev_aio.a 00:03:44.793 LIB libspdk_bdev_malloc.a 00:03:44.793 LIB libspdk_bdev_zone_block.a 00:03:44.793 SYMLINK libspdk_bdev_ftl.so 00:03:44.793 SO libspdk_bdev_aio.so.5.0 00:03:44.793 SO libspdk_bdev_malloc.so.5.0 00:03:44.793 SO libspdk_bdev_zone_block.so.5.0 00:03:44.793 LIB libspdk_bdev_delay.a 00:03:44.793 LIB libspdk_bdev_iscsi.a 00:03:44.793 SO libspdk_bdev_delay.so.5.0 00:03:44.793 SO libspdk_bdev_iscsi.so.5.0 00:03:44.793 SYMLINK libspdk_bdev_aio.so 00:03:44.793 SYMLINK libspdk_bdev_zone_block.so 00:03:44.793 SYMLINK libspdk_bdev_malloc.so 00:03:44.793 SYMLINK libspdk_bdev_delay.so 00:03:44.793 SYMLINK libspdk_bdev_iscsi.so 00:03:44.793 LIB libspdk_bdev_virtio.a 00:03:44.793 SO libspdk_bdev_virtio.so.5.0 00:03:44.793 LIB libspdk_bdev_lvol.a 00:03:45.050 SO libspdk_bdev_lvol.so.5.0 00:03:45.050 SYMLINK libspdk_bdev_virtio.so 00:03:45.050 SYMLINK libspdk_bdev_lvol.so 00:03:45.309 LIB libspdk_bdev_raid.a 00:03:45.309 SO libspdk_bdev_raid.so.5.0 00:03:45.309 SYMLINK libspdk_bdev_raid.so 00:03:46.690 LIB libspdk_bdev_nvme.a 00:03:46.691 SO libspdk_bdev_nvme.so.6.0 00:03:46.691 SYMLINK libspdk_bdev_nvme.so 00:03:46.949 CC module/event/subsystems/vmd/vmd.o 00:03:46.949 CC module/event/subsystems/iobuf/iobuf.o 00:03:46.949 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:46.949 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:46.949 CC module/event/subsystems/scheduler/scheduler.o 00:03:46.949 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:46.949 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:46.949 CC module/event/subsystems/sock/sock.o 00:03:46.949 LIB libspdk_event_sock.a 00:03:46.949 LIB libspdk_event_vhost_blk.a 00:03:46.949 LIB libspdk_event_vmd.a 00:03:46.949 LIB libspdk_event_scheduler.a 00:03:46.949 LIB libspdk_event_vfu_tgt.a 00:03:46.949 SO libspdk_event_sock.so.4.0 00:03:46.949 LIB libspdk_event_iobuf.a 00:03:46.949 SO libspdk_event_vhost_blk.so.2.0 00:03:46.949 SO libspdk_event_vmd.so.5.0 00:03:46.949 SO libspdk_event_scheduler.so.3.0 00:03:46.949 SO libspdk_event_vfu_tgt.so.2.0 00:03:46.949 SO libspdk_event_iobuf.so.2.0 00:03:46.949 SYMLINK libspdk_event_sock.so 00:03:46.949 SYMLINK libspdk_event_vhost_blk.so 00:03:46.949 SYMLINK libspdk_event_scheduler.so 00:03:46.949 SYMLINK libspdk_event_vfu_tgt.so 00:03:46.949 SYMLINK libspdk_event_vmd.so 00:03:47.208 SYMLINK libspdk_event_iobuf.so 00:03:47.208 CC module/event/subsystems/accel/accel.o 00:03:47.467 LIB libspdk_event_accel.a 00:03:47.467 SO libspdk_event_accel.so.5.0 00:03:47.467 SYMLINK libspdk_event_accel.so 00:03:47.467 CC module/event/subsystems/bdev/bdev.o 00:03:47.726 LIB libspdk_event_bdev.a 00:03:47.726 SO libspdk_event_bdev.so.5.0 00:03:47.726 SYMLINK libspdk_event_bdev.so 00:03:47.985 CC module/event/subsystems/ublk/ublk.o 00:03:47.985 CC module/event/subsystems/nbd/nbd.o 00:03:47.985 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:47.985 CC module/event/subsystems/scsi/scsi.o 00:03:47.985 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:47.985 LIB libspdk_event_nbd.a 00:03:47.985 LIB libspdk_event_ublk.a 00:03:47.985 SO libspdk_event_ublk.so.2.0 00:03:47.985 SO libspdk_event_nbd.so.5.0 00:03:47.985 LIB libspdk_event_scsi.a 00:03:47.985 SO libspdk_event_scsi.so.5.0 00:03:47.985 SYMLINK libspdk_event_ublk.so 00:03:47.985 SYMLINK libspdk_event_nbd.so 00:03:48.243 SYMLINK libspdk_event_scsi.so 00:03:48.243 LIB libspdk_event_nvmf.a 00:03:48.243 SO libspdk_event_nvmf.so.5.0 00:03:48.243 SYMLINK libspdk_event_nvmf.so 00:03:48.243 CC module/event/subsystems/iscsi/iscsi.o 00:03:48.243 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:48.502 LIB libspdk_event_vhost_scsi.a 00:03:48.502 SO libspdk_event_vhost_scsi.so.2.0 00:03:48.502 LIB libspdk_event_iscsi.a 00:03:48.502 SO libspdk_event_iscsi.so.5.0 00:03:48.502 SYMLINK libspdk_event_vhost_scsi.so 00:03:48.502 SYMLINK libspdk_event_iscsi.so 00:03:48.503 SO libspdk.so.5.0 00:03:48.503 SYMLINK libspdk.so 00:03:48.768 CXX app/trace/trace.o 00:03:48.768 CC app/trace_record/trace_record.o 00:03:48.768 CC app/spdk_nvme_identify/identify.o 00:03:48.768 CC app/spdk_lspci/spdk_lspci.o 00:03:48.768 CC app/spdk_nvme_perf/perf.o 00:03:48.768 CC app/spdk_nvme_discover/discovery_aer.o 00:03:48.768 CC app/spdk_top/spdk_top.o 00:03:48.768 CC test/rpc_client/rpc_client_test.o 00:03:48.768 TEST_HEADER include/spdk/accel.h 00:03:48.768 TEST_HEADER include/spdk/accel_module.h 00:03:48.768 TEST_HEADER include/spdk/assert.h 00:03:48.768 TEST_HEADER include/spdk/barrier.h 00:03:48.768 TEST_HEADER include/spdk/base64.h 00:03:48.768 TEST_HEADER include/spdk/bdev.h 00:03:48.768 TEST_HEADER include/spdk/bdev_module.h 00:03:48.768 TEST_HEADER include/spdk/bdev_zone.h 00:03:48.768 TEST_HEADER include/spdk/bit_array.h 00:03:48.768 TEST_HEADER include/spdk/bit_pool.h 00:03:48.768 TEST_HEADER include/spdk/blob_bdev.h 00:03:48.768 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:48.768 TEST_HEADER include/spdk/blobfs.h 00:03:48.768 CC app/spdk_dd/spdk_dd.o 00:03:48.768 TEST_HEADER include/spdk/blob.h 00:03:48.768 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:48.768 TEST_HEADER include/spdk/conf.h 00:03:48.768 CC app/iscsi_tgt/iscsi_tgt.o 00:03:48.768 TEST_HEADER include/spdk/config.h 00:03:48.768 TEST_HEADER include/spdk/cpuset.h 00:03:48.768 CC app/nvmf_tgt/nvmf_main.o 00:03:48.768 TEST_HEADER include/spdk/crc16.h 00:03:48.768 TEST_HEADER include/spdk/crc32.h 00:03:48.768 CC app/vhost/vhost.o 00:03:48.768 TEST_HEADER include/spdk/crc64.h 00:03:48.768 TEST_HEADER include/spdk/dif.h 00:03:48.768 CC examples/sock/hello_world/hello_sock.o 00:03:48.768 CC examples/ioat/verify/verify.o 00:03:48.768 TEST_HEADER include/spdk/dma.h 00:03:48.768 CC examples/ioat/perf/perf.o 00:03:48.768 TEST_HEADER include/spdk/endian.h 00:03:48.768 CC examples/util/zipf/zipf.o 00:03:48.768 CC examples/vmd/lsvmd/lsvmd.o 00:03:48.768 CC examples/vmd/led/led.o 00:03:48.768 CC examples/accel/perf/accel_perf.o 00:03:48.768 TEST_HEADER include/spdk/env_dpdk.h 00:03:48.768 CC app/fio/nvme/fio_plugin.o 00:03:48.769 CC examples/nvme/reconnect/reconnect.o 00:03:48.769 CC examples/idxd/perf/perf.o 00:03:48.769 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:48.769 TEST_HEADER include/spdk/env.h 00:03:48.769 TEST_HEADER include/spdk/event.h 00:03:48.769 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:48.769 TEST_HEADER include/spdk/fd_group.h 00:03:48.769 TEST_HEADER include/spdk/fd.h 00:03:48.769 CC examples/nvme/hello_world/hello_world.o 00:03:48.769 TEST_HEADER include/spdk/file.h 00:03:48.769 TEST_HEADER include/spdk/ftl.h 00:03:48.769 CC test/event/event_perf/event_perf.o 00:03:48.769 CC examples/nvme/abort/abort.o 00:03:48.769 TEST_HEADER include/spdk/gpt_spec.h 00:03:48.769 CC app/spdk_tgt/spdk_tgt.o 00:03:48.769 CC examples/nvme/hotplug/hotplug.o 00:03:48.769 TEST_HEADER include/spdk/hexlify.h 00:03:48.769 CC examples/nvme/arbitration/arbitration.o 00:03:48.769 CC test/nvme/aer/aer.o 00:03:48.769 CC test/thread/poller_perf/poller_perf.o 00:03:48.769 TEST_HEADER include/spdk/histogram_data.h 00:03:48.769 TEST_HEADER include/spdk/idxd.h 00:03:48.769 TEST_HEADER include/spdk/idxd_spec.h 00:03:48.769 TEST_HEADER include/spdk/init.h 00:03:48.769 TEST_HEADER include/spdk/ioat.h 00:03:48.769 TEST_HEADER include/spdk/ioat_spec.h 00:03:48.769 TEST_HEADER include/spdk/iscsi_spec.h 00:03:48.769 TEST_HEADER include/spdk/json.h 00:03:48.769 TEST_HEADER include/spdk/jsonrpc.h 00:03:48.769 TEST_HEADER include/spdk/likely.h 00:03:48.769 CC examples/bdev/hello_world/hello_bdev.o 00:03:48.769 CC examples/blob/hello_world/hello_blob.o 00:03:48.769 TEST_HEADER include/spdk/log.h 00:03:48.769 TEST_HEADER include/spdk/lvol.h 00:03:48.769 TEST_HEADER include/spdk/memory.h 00:03:48.769 TEST_HEADER include/spdk/mmio.h 00:03:48.769 TEST_HEADER include/spdk/nbd.h 00:03:48.769 CC examples/bdev/bdevperf/bdevperf.o 00:03:48.769 CC examples/nvmf/nvmf/nvmf.o 00:03:48.769 CC examples/blob/cli/blobcli.o 00:03:48.769 CC examples/thread/thread/thread_ex.o 00:03:48.769 CC app/fio/bdev/fio_plugin.o 00:03:48.769 TEST_HEADER include/spdk/notify.h 00:03:48.769 CC test/bdev/bdevio/bdevio.o 00:03:48.769 CC test/blobfs/mkfs/mkfs.o 00:03:48.769 TEST_HEADER include/spdk/nvme.h 00:03:49.031 TEST_HEADER include/spdk/nvme_intel.h 00:03:49.031 CC test/dma/test_dma/test_dma.o 00:03:49.031 CC test/app/bdev_svc/bdev_svc.o 00:03:49.031 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:49.031 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:49.031 TEST_HEADER include/spdk/nvme_spec.h 00:03:49.031 CC test/accel/dif/dif.o 00:03:49.031 TEST_HEADER include/spdk/nvme_zns.h 00:03:49.031 CC test/env/mem_callbacks/mem_callbacks.o 00:03:49.031 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:49.031 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:49.031 TEST_HEADER include/spdk/nvmf.h 00:03:49.031 TEST_HEADER include/spdk/nvmf_spec.h 00:03:49.031 TEST_HEADER include/spdk/nvmf_transport.h 00:03:49.031 CC test/lvol/esnap/esnap.o 00:03:49.031 TEST_HEADER include/spdk/opal.h 00:03:49.031 TEST_HEADER include/spdk/opal_spec.h 00:03:49.031 TEST_HEADER include/spdk/pci_ids.h 00:03:49.031 TEST_HEADER include/spdk/pipe.h 00:03:49.031 TEST_HEADER include/spdk/queue.h 00:03:49.031 TEST_HEADER include/spdk/reduce.h 00:03:49.031 TEST_HEADER include/spdk/rpc.h 00:03:49.031 TEST_HEADER include/spdk/scheduler.h 00:03:49.031 TEST_HEADER include/spdk/scsi.h 00:03:49.031 TEST_HEADER include/spdk/scsi_spec.h 00:03:49.031 TEST_HEADER include/spdk/sock.h 00:03:49.031 TEST_HEADER include/spdk/stdinc.h 00:03:49.031 TEST_HEADER include/spdk/string.h 00:03:49.031 TEST_HEADER include/spdk/thread.h 00:03:49.031 TEST_HEADER include/spdk/trace.h 00:03:49.031 TEST_HEADER include/spdk/trace_parser.h 00:03:49.031 TEST_HEADER include/spdk/tree.h 00:03:49.031 TEST_HEADER include/spdk/ublk.h 00:03:49.031 LINK spdk_lspci 00:03:49.031 TEST_HEADER include/spdk/util.h 00:03:49.031 TEST_HEADER include/spdk/uuid.h 00:03:49.031 TEST_HEADER include/spdk/version.h 00:03:49.031 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:49.031 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:49.031 TEST_HEADER include/spdk/vhost.h 00:03:49.031 TEST_HEADER include/spdk/vmd.h 00:03:49.031 TEST_HEADER include/spdk/xor.h 00:03:49.031 TEST_HEADER include/spdk/zipf.h 00:03:49.031 CXX test/cpp_headers/accel.o 00:03:49.031 LINK rpc_client_test 00:03:49.031 LINK lsvmd 00:03:49.031 LINK spdk_nvme_discover 00:03:49.031 LINK led 00:03:49.031 LINK zipf 00:03:49.031 LINK interrupt_tgt 00:03:49.031 LINK poller_perf 00:03:49.031 LINK event_perf 00:03:49.031 LINK nvmf_tgt 00:03:49.291 LINK vhost 00:03:49.291 LINK cmb_copy 00:03:49.291 LINK iscsi_tgt 00:03:49.291 LINK spdk_trace_record 00:03:49.291 LINK ioat_perf 00:03:49.291 LINK verify 00:03:49.291 LINK spdk_tgt 00:03:49.291 LINK bdev_svc 00:03:49.291 LINK hello_sock 00:03:49.291 LINK hello_world 00:03:49.291 LINK mkfs 00:03:49.291 LINK hotplug 00:03:49.291 LINK mem_callbacks 00:03:49.291 LINK hello_bdev 00:03:49.291 LINK hello_blob 00:03:49.291 CXX test/cpp_headers/accel_module.o 00:03:49.291 LINK thread 00:03:49.291 CXX test/cpp_headers/assert.o 00:03:49.291 LINK aer 00:03:49.291 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:49.556 CXX test/cpp_headers/barrier.o 00:03:49.556 LINK nvmf 00:03:49.556 CXX test/cpp_headers/base64.o 00:03:49.556 LINK idxd_perf 00:03:49.556 LINK arbitration 00:03:49.556 LINK spdk_dd 00:03:49.556 LINK reconnect 00:03:49.556 CXX test/cpp_headers/bdev.o 00:03:49.556 CC test/event/reactor/reactor.o 00:03:49.556 CC test/event/reactor_perf/reactor_perf.o 00:03:49.556 LINK abort 00:03:49.556 CC test/nvme/reset/reset.o 00:03:49.556 LINK spdk_trace 00:03:49.556 CXX test/cpp_headers/bdev_module.o 00:03:49.556 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:49.556 CC test/env/vtophys/vtophys.o 00:03:49.556 LINK test_dma 00:03:49.556 LINK bdevio 00:03:49.556 CC test/app/histogram_perf/histogram_perf.o 00:03:49.556 LINK dif 00:03:49.556 CC test/event/app_repeat/app_repeat.o 00:03:49.556 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:49.556 CC test/nvme/sgl/sgl.o 00:03:49.556 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:49.556 LINK accel_perf 00:03:49.821 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:49.821 CC test/event/scheduler/scheduler.o 00:03:49.821 CXX test/cpp_headers/bdev_zone.o 00:03:49.821 CXX test/cpp_headers/bit_array.o 00:03:49.821 CC test/app/jsoncat/jsoncat.o 00:03:49.821 CC test/app/stub/stub.o 00:03:49.821 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:49.821 LINK nvme_manage 00:03:49.821 LINK pmr_persistence 00:03:49.821 CXX test/cpp_headers/bit_pool.o 00:03:49.821 CXX test/cpp_headers/blob_bdev.o 00:03:49.821 CC test/env/memory/memory_ut.o 00:03:49.821 CXX test/cpp_headers/blobfs_bdev.o 00:03:49.821 CC test/env/pci/pci_ut.o 00:03:49.821 CC test/nvme/e2edp/nvme_dp.o 00:03:49.821 CXX test/cpp_headers/blobfs.o 00:03:49.821 CXX test/cpp_headers/blob.o 00:03:49.821 LINK reactor 00:03:49.821 LINK reactor_perf 00:03:49.821 CXX test/cpp_headers/conf.o 00:03:49.821 LINK blobcli 00:03:49.821 CXX test/cpp_headers/config.o 00:03:49.821 LINK spdk_bdev 00:03:49.821 CXX test/cpp_headers/cpuset.o 00:03:49.821 CC test/nvme/overhead/overhead.o 00:03:49.821 LINK spdk_nvme 00:03:49.821 CXX test/cpp_headers/crc16.o 00:03:49.821 CC test/nvme/err_injection/err_injection.o 00:03:49.821 LINK vtophys 00:03:49.821 CXX test/cpp_headers/crc32.o 00:03:50.086 LINK env_dpdk_post_init 00:03:50.086 LINK histogram_perf 00:03:50.086 LINK app_repeat 00:03:50.086 CC test/nvme/reserve/reserve.o 00:03:50.086 CC test/nvme/startup/startup.o 00:03:50.086 CXX test/cpp_headers/crc64.o 00:03:50.086 LINK jsoncat 00:03:50.086 LINK reset 00:03:50.086 CXX test/cpp_headers/dif.o 00:03:50.086 CXX test/cpp_headers/dma.o 00:03:50.086 CC test/nvme/simple_copy/simple_copy.o 00:03:50.086 CXX test/cpp_headers/endian.o 00:03:50.086 LINK stub 00:03:50.086 CC test/nvme/connect_stress/connect_stress.o 00:03:50.086 CXX test/cpp_headers/env_dpdk.o 00:03:50.086 CC test/nvme/boot_partition/boot_partition.o 00:03:50.086 CXX test/cpp_headers/env.o 00:03:50.086 CXX test/cpp_headers/event.o 00:03:50.086 CC test/nvme/compliance/nvme_compliance.o 00:03:50.086 CC test/nvme/fused_ordering/fused_ordering.o 00:03:50.086 LINK sgl 00:03:50.086 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:50.086 LINK scheduler 00:03:50.086 CXX test/cpp_headers/fd_group.o 00:03:50.086 CXX test/cpp_headers/fd.o 00:03:50.086 CXX test/cpp_headers/file.o 00:03:50.086 CXX test/cpp_headers/ftl.o 00:03:50.350 CC test/nvme/fdp/fdp.o 00:03:50.350 CXX test/cpp_headers/gpt_spec.o 00:03:50.350 CXX test/cpp_headers/hexlify.o 00:03:50.350 CXX test/cpp_headers/histogram_data.o 00:03:50.350 CXX test/cpp_headers/idxd.o 00:03:50.350 LINK spdk_nvme_perf 00:03:50.350 CC test/nvme/cuse/cuse.o 00:03:50.350 CXX test/cpp_headers/idxd_spec.o 00:03:50.350 CXX test/cpp_headers/ioat.o 00:03:50.350 CXX test/cpp_headers/init.o 00:03:50.350 CXX test/cpp_headers/iscsi_spec.o 00:03:50.350 CXX test/cpp_headers/ioat_spec.o 00:03:50.350 LINK err_injection 00:03:50.350 CXX test/cpp_headers/json.o 00:03:50.350 CXX test/cpp_headers/jsonrpc.o 00:03:50.350 CXX test/cpp_headers/likely.o 00:03:50.350 LINK spdk_nvme_identify 00:03:50.350 LINK bdevperf 00:03:50.350 LINK spdk_top 00:03:50.350 LINK nvme_dp 00:03:50.350 LINK startup 00:03:50.350 CXX test/cpp_headers/log.o 00:03:50.350 CXX test/cpp_headers/lvol.o 00:03:50.350 CXX test/cpp_headers/memory.o 00:03:50.350 LINK nvme_fuzz 00:03:50.350 LINK reserve 00:03:50.350 CXX test/cpp_headers/mmio.o 00:03:50.350 LINK overhead 00:03:50.612 CXX test/cpp_headers/nbd.o 00:03:50.612 CXX test/cpp_headers/notify.o 00:03:50.612 LINK connect_stress 00:03:50.612 LINK vhost_fuzz 00:03:50.612 LINK boot_partition 00:03:50.612 LINK simple_copy 00:03:50.612 CXX test/cpp_headers/nvme.o 00:03:50.612 CXX test/cpp_headers/nvme_intel.o 00:03:50.612 LINK pci_ut 00:03:50.612 CXX test/cpp_headers/nvme_ocssd.o 00:03:50.612 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:50.612 CXX test/cpp_headers/nvme_spec.o 00:03:50.612 CXX test/cpp_headers/nvme_zns.o 00:03:50.612 LINK doorbell_aers 00:03:50.612 CXX test/cpp_headers/nvmf_cmd.o 00:03:50.612 LINK fused_ordering 00:03:50.612 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:50.612 CXX test/cpp_headers/nvmf.o 00:03:50.612 CXX test/cpp_headers/nvmf_spec.o 00:03:50.612 CXX test/cpp_headers/nvmf_transport.o 00:03:50.612 CXX test/cpp_headers/opal.o 00:03:50.612 CXX test/cpp_headers/opal_spec.o 00:03:50.612 CXX test/cpp_headers/pci_ids.o 00:03:50.612 CXX test/cpp_headers/pipe.o 00:03:50.612 CXX test/cpp_headers/queue.o 00:03:50.612 CXX test/cpp_headers/reduce.o 00:03:50.612 CXX test/cpp_headers/rpc.o 00:03:50.612 CXX test/cpp_headers/scheduler.o 00:03:50.612 CXX test/cpp_headers/scsi.o 00:03:50.612 CXX test/cpp_headers/scsi_spec.o 00:03:50.612 CXX test/cpp_headers/sock.o 00:03:50.612 CXX test/cpp_headers/stdinc.o 00:03:50.612 CXX test/cpp_headers/thread.o 00:03:50.612 CXX test/cpp_headers/string.o 00:03:50.612 CXX test/cpp_headers/trace.o 00:03:50.875 CXX test/cpp_headers/trace_parser.o 00:03:50.875 LINK memory_ut 00:03:50.875 CXX test/cpp_headers/tree.o 00:03:50.875 CXX test/cpp_headers/ublk.o 00:03:50.875 CXX test/cpp_headers/util.o 00:03:50.875 CXX test/cpp_headers/uuid.o 00:03:50.875 CXX test/cpp_headers/version.o 00:03:50.875 LINK nvme_compliance 00:03:50.875 CXX test/cpp_headers/vfio_user_pci.o 00:03:50.875 CXX test/cpp_headers/vfio_user_spec.o 00:03:50.875 CXX test/cpp_headers/vhost.o 00:03:50.875 CXX test/cpp_headers/vmd.o 00:03:50.875 CXX test/cpp_headers/xor.o 00:03:50.875 CXX test/cpp_headers/zipf.o 00:03:50.875 LINK fdp 00:03:51.909 LINK cuse 00:03:51.909 LINK iscsi_fuzz 00:03:54.457 LINK esnap 00:03:54.717 00:03:54.717 real 0m37.767s 00:03:54.717 user 7m12.647s 00:03:54.717 sys 1m36.288s 00:03:54.717 14:58:54 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:54.717 14:58:54 -- common/autotest_common.sh@10 -- $ set +x 00:03:54.717 ************************************ 00:03:54.717 END TEST make 00:03:54.717 ************************************ 00:03:54.717 14:58:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:54.718 14:58:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:54.718 14:58:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:54.718 14:58:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:54.718 14:58:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:54.718 14:58:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:54.718 14:58:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:54.718 14:58:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:54.718 14:58:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:54.718 14:58:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:54.718 14:58:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:54.718 14:58:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:54.718 14:58:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:54.718 14:58:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:54.718 14:58:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:54.718 14:58:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:54.718 14:58:54 -- scripts/common.sh@344 -- # : 1 00:03:54.718 14:58:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:54.718 14:58:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:54.718 14:58:54 -- scripts/common.sh@364 -- # decimal 1 00:03:54.718 14:58:54 -- scripts/common.sh@352 -- # local d=1 00:03:54.718 14:58:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:54.718 14:58:54 -- scripts/common.sh@354 -- # echo 1 00:03:54.718 14:58:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:54.718 14:58:54 -- scripts/common.sh@365 -- # decimal 2 00:03:54.718 14:58:54 -- scripts/common.sh@352 -- # local d=2 00:03:54.718 14:58:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:54.718 14:58:54 -- scripts/common.sh@354 -- # echo 2 00:03:54.718 14:58:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:54.718 14:58:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:54.718 14:58:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:54.718 14:58:54 -- scripts/common.sh@367 -- # return 0 00:03:54.718 14:58:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:54.718 14:58:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:54.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.718 --rc genhtml_branch_coverage=1 00:03:54.718 --rc genhtml_function_coverage=1 00:03:54.718 --rc genhtml_legend=1 00:03:54.718 --rc geninfo_all_blocks=1 00:03:54.718 --rc geninfo_unexecuted_blocks=1 00:03:54.718 00:03:54.718 ' 00:03:54.718 14:58:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:54.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.718 --rc genhtml_branch_coverage=1 00:03:54.718 --rc genhtml_function_coverage=1 00:03:54.718 --rc genhtml_legend=1 00:03:54.718 --rc geninfo_all_blocks=1 00:03:54.718 --rc geninfo_unexecuted_blocks=1 00:03:54.718 00:03:54.718 ' 00:03:54.718 14:58:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:54.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.718 --rc genhtml_branch_coverage=1 00:03:54.718 --rc genhtml_function_coverage=1 00:03:54.718 --rc genhtml_legend=1 00:03:54.718 --rc geninfo_all_blocks=1 00:03:54.718 --rc geninfo_unexecuted_blocks=1 00:03:54.718 00:03:54.718 ' 00:03:54.718 14:58:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:54.718 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:54.718 --rc genhtml_branch_coverage=1 00:03:54.718 --rc genhtml_function_coverage=1 00:03:54.718 --rc genhtml_legend=1 00:03:54.718 --rc geninfo_all_blocks=1 00:03:54.718 --rc geninfo_unexecuted_blocks=1 00:03:54.718 00:03:54.718 ' 00:03:54.718 14:58:54 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:54.718 14:58:54 -- nvmf/common.sh@7 -- # uname -s 00:03:54.718 14:58:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:54.718 14:58:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:54.718 14:58:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:54.718 14:58:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:54.718 14:58:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:54.718 14:58:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:54.718 14:58:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:54.718 14:58:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:54.718 14:58:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:54.718 14:58:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:54.718 14:58:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:54.718 14:58:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:54.718 14:58:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:54.718 14:58:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:54.718 14:58:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:54.718 14:58:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:54.718 14:58:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:54.718 14:58:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:54.718 14:58:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:54.718 14:58:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.718 14:58:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.718 14:58:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.718 14:58:54 -- paths/export.sh@5 -- # export PATH 00:03:54.718 14:58:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:54.718 14:58:54 -- nvmf/common.sh@46 -- # : 0 00:03:54.718 14:58:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:54.718 14:58:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:54.718 14:58:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:54.718 14:58:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:54.978 14:58:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:54.978 14:58:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:54.978 14:58:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:54.978 14:58:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:54.978 14:58:54 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:54.978 14:58:54 -- spdk/autotest.sh@32 -- # uname -s 00:03:54.978 14:58:54 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:54.978 14:58:54 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:54.978 14:58:54 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:54.978 14:58:54 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:54.978 14:58:54 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:54.978 14:58:54 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:54.978 14:58:54 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:54.978 14:58:54 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:54.978 14:58:54 -- spdk/autotest.sh@48 -- # udevadm_pid=554138 00:03:54.978 14:58:54 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:54.978 14:58:54 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.978 14:58:54 -- spdk/autotest.sh@54 -- # echo 554140 00:03:54.978 14:58:54 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.978 14:58:54 -- spdk/autotest.sh@56 -- # echo 554141 00:03:54.978 14:58:54 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:54.978 14:58:54 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:54.978 14:58:54 -- spdk/autotest.sh@60 -- # echo 554142 00:03:54.978 14:58:54 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:54.978 14:58:54 -- spdk/autotest.sh@62 -- # echo 554143 00:03:54.978 14:58:54 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:54.978 14:58:54 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:54.978 14:58:54 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:54.978 14:58:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:54.978 14:58:54 -- common/autotest_common.sh@10 -- # set +x 00:03:54.978 14:58:54 -- spdk/autotest.sh@70 -- # create_test_list 00:03:54.978 14:58:54 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:54.978 14:58:54 -- common/autotest_common.sh@10 -- # set +x 00:03:54.978 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:54.978 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:54.978 14:58:54 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:54.978 14:58:54 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.978 14:58:55 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.978 14:58:55 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:54.978 14:58:55 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:54.978 14:58:55 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:54.978 14:58:55 -- common/autotest_common.sh@1450 -- # uname 00:03:54.978 14:58:55 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:54.978 14:58:55 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:54.978 14:58:55 -- common/autotest_common.sh@1470 -- # uname 00:03:54.978 14:58:55 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:54.978 14:58:55 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:54.978 14:58:55 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:54.978 lcov: LCOV version 1.15 00:03:54.978 14:58:55 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:58.270 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:58.270 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:58.270 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:58.270 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:03:58.270 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:58.270 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:04:30.365 14:59:27 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:30.365 14:59:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:30.365 14:59:27 -- common/autotest_common.sh@10 -- # set +x 00:04:30.365 14:59:27 -- spdk/autotest.sh@89 -- # rm -f 00:04:30.365 14:59:27 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.365 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:30.365 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:30.365 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:30.365 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:30.365 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:30.365 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:30.365 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:30.365 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:30.365 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:30.365 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:30.365 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:30.365 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:30.365 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:30.365 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:30.365 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:30.365 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:30.365 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:30.365 14:59:29 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:30.365 14:59:29 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:30.365 14:59:29 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:30.365 14:59:29 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:30.365 14:59:29 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:30.366 14:59:29 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:30.366 14:59:29 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:30.366 14:59:29 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:30.366 14:59:29 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:30.366 14:59:29 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:30.366 14:59:29 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:30.366 14:59:29 -- spdk/autotest.sh@108 -- # grep -v p 00:04:30.366 14:59:29 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:30.366 14:59:29 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:30.366 14:59:29 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:30.366 14:59:29 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:30.366 14:59:29 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:30.366 No valid GPT data, bailing 00:04:30.366 14:59:29 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:30.366 14:59:29 -- scripts/common.sh@393 -- # pt= 00:04:30.366 14:59:29 -- scripts/common.sh@394 -- # return 1 00:04:30.366 14:59:29 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:30.366 1+0 records in 00:04:30.366 1+0 records out 00:04:30.366 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00236585 s, 443 MB/s 00:04:30.366 14:59:29 -- spdk/autotest.sh@116 -- # sync 00:04:30.366 14:59:29 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:30.366 14:59:29 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:30.366 14:59:29 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:31.301 14:59:31 -- spdk/autotest.sh@122 -- # uname -s 00:04:31.301 14:59:31 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:31.301 14:59:31 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:31.301 14:59:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.301 14:59:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.301 14:59:31 -- common/autotest_common.sh@10 -- # set +x 00:04:31.301 ************************************ 00:04:31.301 START TEST setup.sh 00:04:31.301 ************************************ 00:04:31.301 14:59:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:31.561 * Looking for test storage... 00:04:31.561 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:31.561 14:59:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:31.561 14:59:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:31.561 14:59:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.561 14:59:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.561 14:59:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.561 14:59:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.561 14:59:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.561 14:59:31 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.561 14:59:31 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.561 14:59:31 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.561 14:59:31 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.561 14:59:31 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.561 14:59:31 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.561 14:59:31 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.561 14:59:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.561 14:59:31 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.561 14:59:31 -- scripts/common.sh@344 -- # : 1 00:04:31.561 14:59:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.561 14:59:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.561 14:59:31 -- scripts/common.sh@364 -- # decimal 1 00:04:31.561 14:59:31 -- scripts/common.sh@352 -- # local d=1 00:04:31.561 14:59:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.561 14:59:31 -- scripts/common.sh@354 -- # echo 1 00:04:31.561 14:59:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.561 14:59:31 -- scripts/common.sh@365 -- # decimal 2 00:04:31.561 14:59:31 -- scripts/common.sh@352 -- # local d=2 00:04:31.561 14:59:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.561 14:59:31 -- scripts/common.sh@354 -- # echo 2 00:04:31.561 14:59:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.561 14:59:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.561 14:59:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.561 14:59:31 -- scripts/common.sh@367 -- # return 0 00:04:31.561 14:59:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.561 14:59:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.561 --rc genhtml_branch_coverage=1 00:04:31.561 --rc genhtml_function_coverage=1 00:04:31.561 --rc genhtml_legend=1 00:04:31.561 --rc geninfo_all_blocks=1 00:04:31.561 --rc geninfo_unexecuted_blocks=1 00:04:31.561 00:04:31.561 ' 00:04:31.561 14:59:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.561 --rc genhtml_branch_coverage=1 00:04:31.561 --rc genhtml_function_coverage=1 00:04:31.561 --rc genhtml_legend=1 00:04:31.561 --rc geninfo_all_blocks=1 00:04:31.561 --rc geninfo_unexecuted_blocks=1 00:04:31.561 00:04:31.561 ' 00:04:31.561 14:59:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.561 --rc genhtml_branch_coverage=1 00:04:31.561 --rc genhtml_function_coverage=1 00:04:31.561 --rc genhtml_legend=1 00:04:31.561 --rc geninfo_all_blocks=1 00:04:31.561 --rc geninfo_unexecuted_blocks=1 00:04:31.561 00:04:31.561 ' 00:04:31.561 14:59:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.561 --rc genhtml_branch_coverage=1 00:04:31.561 --rc genhtml_function_coverage=1 00:04:31.561 --rc genhtml_legend=1 00:04:31.561 --rc geninfo_all_blocks=1 00:04:31.561 --rc geninfo_unexecuted_blocks=1 00:04:31.561 00:04:31.562 ' 00:04:31.562 14:59:31 -- setup/test-setup.sh@10 -- # uname -s 00:04:31.562 14:59:31 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:31.562 14:59:31 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:31.562 14:59:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:31.562 14:59:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:31.562 14:59:31 -- common/autotest_common.sh@10 -- # set +x 00:04:31.562 ************************************ 00:04:31.562 START TEST acl 00:04:31.562 ************************************ 00:04:31.562 14:59:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:31.562 * Looking for test storage... 00:04:31.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:31.562 14:59:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:31.562 14:59:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:31.562 14:59:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.562 14:59:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.562 14:59:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.562 14:59:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.562 14:59:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.562 14:59:31 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.562 14:59:31 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.562 14:59:31 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.562 14:59:31 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.562 14:59:31 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.562 14:59:31 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.562 14:59:31 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.562 14:59:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.562 14:59:31 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.562 14:59:31 -- scripts/common.sh@344 -- # : 1 00:04:31.562 14:59:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.562 14:59:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.562 14:59:31 -- scripts/common.sh@364 -- # decimal 1 00:04:31.562 14:59:31 -- scripts/common.sh@352 -- # local d=1 00:04:31.562 14:59:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.562 14:59:31 -- scripts/common.sh@354 -- # echo 1 00:04:31.562 14:59:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.562 14:59:31 -- scripts/common.sh@365 -- # decimal 2 00:04:31.562 14:59:31 -- scripts/common.sh@352 -- # local d=2 00:04:31.562 14:59:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.562 14:59:31 -- scripts/common.sh@354 -- # echo 2 00:04:31.562 14:59:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.562 14:59:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.562 14:59:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.562 14:59:31 -- scripts/common.sh@367 -- # return 0 00:04:31.562 14:59:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.562 14:59:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.562 --rc genhtml_branch_coverage=1 00:04:31.562 --rc genhtml_function_coverage=1 00:04:31.562 --rc genhtml_legend=1 00:04:31.562 --rc geninfo_all_blocks=1 00:04:31.562 --rc geninfo_unexecuted_blocks=1 00:04:31.562 00:04:31.562 ' 00:04:31.562 14:59:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.562 --rc genhtml_branch_coverage=1 00:04:31.562 --rc genhtml_function_coverage=1 00:04:31.562 --rc genhtml_legend=1 00:04:31.562 --rc geninfo_all_blocks=1 00:04:31.562 --rc geninfo_unexecuted_blocks=1 00:04:31.562 00:04:31.562 ' 00:04:31.562 14:59:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.562 --rc genhtml_branch_coverage=1 00:04:31.562 --rc genhtml_function_coverage=1 00:04:31.562 --rc genhtml_legend=1 00:04:31.562 --rc geninfo_all_blocks=1 00:04:31.562 --rc geninfo_unexecuted_blocks=1 00:04:31.562 00:04:31.562 ' 00:04:31.562 14:59:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.562 --rc genhtml_branch_coverage=1 00:04:31.562 --rc genhtml_function_coverage=1 00:04:31.562 --rc genhtml_legend=1 00:04:31.562 --rc geninfo_all_blocks=1 00:04:31.562 --rc geninfo_unexecuted_blocks=1 00:04:31.562 00:04:31.562 ' 00:04:31.562 14:59:31 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:31.562 14:59:31 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:31.562 14:59:31 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:31.562 14:59:31 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:31.562 14:59:31 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:31.562 14:59:31 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:31.562 14:59:31 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:31.562 14:59:31 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:31.562 14:59:31 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:31.562 14:59:31 -- setup/acl.sh@12 -- # devs=() 00:04:31.562 14:59:31 -- setup/acl.sh@12 -- # declare -a devs 00:04:31.562 14:59:31 -- setup/acl.sh@13 -- # drivers=() 00:04:31.562 14:59:31 -- setup/acl.sh@13 -- # declare -A drivers 00:04:31.562 14:59:31 -- setup/acl.sh@51 -- # setup reset 00:04:31.821 14:59:31 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:31.821 14:59:31 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:33.198 14:59:33 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:33.198 14:59:33 -- setup/acl.sh@16 -- # local dev driver 00:04:33.198 14:59:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:33.198 14:59:33 -- setup/acl.sh@15 -- # setup output status 00:04:33.198 14:59:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:33.198 14:59:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:34.577 Hugepages 00:04:34.577 node hugesize free / total 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 00:04:34.577 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # continue 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:34.577 14:59:34 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:34.577 14:59:34 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:34.577 14:59:34 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:34.577 14:59:34 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:34.577 14:59:34 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:34.577 14:59:34 -- setup/acl.sh@54 -- # run_test denied denied 00:04:34.577 14:59:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:34.577 14:59:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:34.577 14:59:34 -- common/autotest_common.sh@10 -- # set +x 00:04:34.577 ************************************ 00:04:34.577 START TEST denied 00:04:34.577 ************************************ 00:04:34.577 14:59:34 -- common/autotest_common.sh@1114 -- # denied 00:04:34.577 14:59:34 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:34.577 14:59:34 -- setup/acl.sh@38 -- # setup output config 00:04:34.577 14:59:34 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:34.577 14:59:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:34.577 14:59:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:35.957 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:35.957 14:59:36 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:35.957 14:59:36 -- setup/acl.sh@28 -- # local dev driver 00:04:35.957 14:59:36 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:35.957 14:59:36 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:35.957 14:59:36 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:35.957 14:59:36 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:35.957 14:59:36 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:35.957 14:59:36 -- setup/acl.sh@41 -- # setup reset 00:04:35.957 14:59:36 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.957 14:59:36 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:39.246 00:04:39.246 real 0m4.137s 00:04:39.246 user 0m1.191s 00:04:39.246 sys 0m2.017s 00:04:39.246 14:59:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:39.246 14:59:38 -- common/autotest_common.sh@10 -- # set +x 00:04:39.246 ************************************ 00:04:39.246 END TEST denied 00:04:39.246 ************************************ 00:04:39.246 14:59:38 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:39.246 14:59:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:39.246 14:59:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:39.246 14:59:38 -- common/autotest_common.sh@10 -- # set +x 00:04:39.246 ************************************ 00:04:39.246 START TEST allowed 00:04:39.246 ************************************ 00:04:39.246 14:59:38 -- common/autotest_common.sh@1114 -- # allowed 00:04:39.246 14:59:38 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:39.246 14:59:38 -- setup/acl.sh@45 -- # setup output config 00:04:39.246 14:59:38 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:39.246 14:59:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:39.246 14:59:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:41.153 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:41.153 14:59:41 -- setup/acl.sh@47 -- # verify 00:04:41.153 14:59:41 -- setup/acl.sh@28 -- # local dev driver 00:04:41.153 14:59:41 -- setup/acl.sh@48 -- # setup reset 00:04:41.153 14:59:41 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:41.153 14:59:41 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:43.071 00:04:43.071 real 0m4.077s 00:04:43.071 user 0m1.070s 00:04:43.071 sys 0m1.899s 00:04:43.071 14:59:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.071 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:04:43.071 ************************************ 00:04:43.071 END TEST allowed 00:04:43.071 ************************************ 00:04:43.071 00:04:43.071 real 0m11.210s 00:04:43.071 user 0m3.442s 00:04:43.071 sys 0m5.830s 00:04:43.071 14:59:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.071 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:04:43.071 ************************************ 00:04:43.071 END TEST acl 00:04:43.071 ************************************ 00:04:43.071 14:59:42 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:43.071 14:59:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.071 14:59:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.071 14:59:42 -- common/autotest_common.sh@10 -- # set +x 00:04:43.071 ************************************ 00:04:43.071 START TEST hugepages 00:04:43.071 ************************************ 00:04:43.071 14:59:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:43.071 * Looking for test storage... 00:04:43.071 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:43.071 14:59:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:43.071 14:59:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:43.071 14:59:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:43.071 14:59:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:43.071 14:59:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:43.071 14:59:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:43.071 14:59:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:43.071 14:59:43 -- scripts/common.sh@335 -- # IFS=.-: 00:04:43.071 14:59:43 -- scripts/common.sh@335 -- # read -ra ver1 00:04:43.071 14:59:43 -- scripts/common.sh@336 -- # IFS=.-: 00:04:43.071 14:59:43 -- scripts/common.sh@336 -- # read -ra ver2 00:04:43.071 14:59:43 -- scripts/common.sh@337 -- # local 'op=<' 00:04:43.071 14:59:43 -- scripts/common.sh@339 -- # ver1_l=2 00:04:43.071 14:59:43 -- scripts/common.sh@340 -- # ver2_l=1 00:04:43.071 14:59:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:43.071 14:59:43 -- scripts/common.sh@343 -- # case "$op" in 00:04:43.072 14:59:43 -- scripts/common.sh@344 -- # : 1 00:04:43.072 14:59:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:43.072 14:59:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:43.072 14:59:43 -- scripts/common.sh@364 -- # decimal 1 00:04:43.072 14:59:43 -- scripts/common.sh@352 -- # local d=1 00:04:43.072 14:59:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:43.072 14:59:43 -- scripts/common.sh@354 -- # echo 1 00:04:43.072 14:59:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:43.072 14:59:43 -- scripts/common.sh@365 -- # decimal 2 00:04:43.072 14:59:43 -- scripts/common.sh@352 -- # local d=2 00:04:43.072 14:59:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:43.072 14:59:43 -- scripts/common.sh@354 -- # echo 2 00:04:43.072 14:59:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:43.072 14:59:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:43.072 14:59:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:43.072 14:59:43 -- scripts/common.sh@367 -- # return 0 00:04:43.072 14:59:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:43.072 14:59:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:43.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.072 --rc genhtml_branch_coverage=1 00:04:43.072 --rc genhtml_function_coverage=1 00:04:43.072 --rc genhtml_legend=1 00:04:43.072 --rc geninfo_all_blocks=1 00:04:43.072 --rc geninfo_unexecuted_blocks=1 00:04:43.072 00:04:43.072 ' 00:04:43.072 14:59:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:43.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.072 --rc genhtml_branch_coverage=1 00:04:43.072 --rc genhtml_function_coverage=1 00:04:43.072 --rc genhtml_legend=1 00:04:43.072 --rc geninfo_all_blocks=1 00:04:43.072 --rc geninfo_unexecuted_blocks=1 00:04:43.072 00:04:43.072 ' 00:04:43.072 14:59:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:43.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.072 --rc genhtml_branch_coverage=1 00:04:43.072 --rc genhtml_function_coverage=1 00:04:43.072 --rc genhtml_legend=1 00:04:43.072 --rc geninfo_all_blocks=1 00:04:43.072 --rc geninfo_unexecuted_blocks=1 00:04:43.072 00:04:43.072 ' 00:04:43.072 14:59:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:43.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:43.072 --rc genhtml_branch_coverage=1 00:04:43.072 --rc genhtml_function_coverage=1 00:04:43.072 --rc genhtml_legend=1 00:04:43.072 --rc geninfo_all_blocks=1 00:04:43.072 --rc geninfo_unexecuted_blocks=1 00:04:43.072 00:04:43.072 ' 00:04:43.072 14:59:43 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:43.072 14:59:43 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:43.072 14:59:43 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:43.072 14:59:43 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:43.072 14:59:43 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:43.072 14:59:43 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:43.072 14:59:43 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:43.072 14:59:43 -- setup/common.sh@18 -- # local node= 00:04:43.072 14:59:43 -- setup/common.sh@19 -- # local var val 00:04:43.072 14:59:43 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.072 14:59:43 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.072 14:59:43 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.072 14:59:43 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.072 14:59:43 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.072 14:59:43 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 42078860 kB' 'MemAvailable: 45825432 kB' 'Buffers: 2708 kB' 'Cached: 11782748 kB' 'SwapCached: 0 kB' 'Active: 8518460 kB' 'Inactive: 3752508 kB' 'Active(anon): 8126420 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488880 kB' 'Mapped: 182540 kB' 'Shmem: 7640908 kB' 'KReclaimable: 191204 kB' 'Slab: 646948 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455744 kB' 'KernelStack: 12816 kB' 'PageTables: 7868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 9249404 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.072 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.072 14:59:43 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # continue 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.073 14:59:43 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.073 14:59:43 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:43.073 14:59:43 -- setup/common.sh@33 -- # echo 2048 00:04:43.073 14:59:43 -- setup/common.sh@33 -- # return 0 00:04:43.073 14:59:43 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:43.073 14:59:43 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:43.073 14:59:43 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:43.073 14:59:43 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:43.073 14:59:43 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:43.073 14:59:43 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:43.073 14:59:43 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:43.073 14:59:43 -- setup/hugepages.sh@207 -- # get_nodes 00:04:43.073 14:59:43 -- setup/hugepages.sh@27 -- # local node 00:04:43.073 14:59:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.073 14:59:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:43.073 14:59:43 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.073 14:59:43 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:43.073 14:59:43 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:43.073 14:59:43 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:43.073 14:59:43 -- setup/hugepages.sh@208 -- # clear_hp 00:04:43.073 14:59:43 -- setup/hugepages.sh@37 -- # local node hp 00:04:43.073 14:59:43 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:43.073 14:59:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:43.073 14:59:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:43.073 14:59:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:43.073 14:59:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:43.073 14:59:43 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:43.073 14:59:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:43.073 14:59:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:43.073 14:59:43 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:43.073 14:59:43 -- setup/hugepages.sh@41 -- # echo 0 00:04:43.073 14:59:43 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:43.073 14:59:43 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:43.073 14:59:43 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:43.073 14:59:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.073 14:59:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.073 14:59:43 -- common/autotest_common.sh@10 -- # set +x 00:04:43.073 ************************************ 00:04:43.073 START TEST default_setup 00:04:43.073 ************************************ 00:04:43.074 14:59:43 -- common/autotest_common.sh@1114 -- # default_setup 00:04:43.074 14:59:43 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:43.074 14:59:43 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:43.074 14:59:43 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:43.074 14:59:43 -- setup/hugepages.sh@51 -- # shift 00:04:43.074 14:59:43 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:43.074 14:59:43 -- setup/hugepages.sh@52 -- # local node_ids 00:04:43.074 14:59:43 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:43.074 14:59:43 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:43.074 14:59:43 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:43.074 14:59:43 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:43.074 14:59:43 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:43.074 14:59:43 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:43.074 14:59:43 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:43.074 14:59:43 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:43.074 14:59:43 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:43.074 14:59:43 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:43.074 14:59:43 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:43.074 14:59:43 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:43.074 14:59:43 -- setup/hugepages.sh@73 -- # return 0 00:04:43.074 14:59:43 -- setup/hugepages.sh@137 -- # setup output 00:04:43.074 14:59:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:43.074 14:59:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:44.450 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:44.450 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:44.450 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:44.451 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:44.451 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:44.451 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:44.451 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:44.451 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:44.451 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:45.393 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:45.393 14:59:45 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:45.393 14:59:45 -- setup/hugepages.sh@89 -- # local node 00:04:45.394 14:59:45 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:45.394 14:59:45 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:45.394 14:59:45 -- setup/hugepages.sh@92 -- # local surp 00:04:45.394 14:59:45 -- setup/hugepages.sh@93 -- # local resv 00:04:45.394 14:59:45 -- setup/hugepages.sh@94 -- # local anon 00:04:45.394 14:59:45 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:45.394 14:59:45 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:45.394 14:59:45 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:45.394 14:59:45 -- setup/common.sh@18 -- # local node= 00:04:45.394 14:59:45 -- setup/common.sh@19 -- # local var val 00:04:45.394 14:59:45 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.394 14:59:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.394 14:59:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.394 14:59:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.394 14:59:45 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.394 14:59:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44177476 kB' 'MemAvailable: 47924052 kB' 'Buffers: 2708 kB' 'Cached: 11782836 kB' 'SwapCached: 0 kB' 'Active: 8520936 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128896 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491188 kB' 'Mapped: 182124 kB' 'Shmem: 7640996 kB' 'KReclaimable: 191212 kB' 'Slab: 646792 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455580 kB' 'KernelStack: 12816 kB' 'PageTables: 7896 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.394 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.394 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.395 14:59:45 -- setup/common.sh@33 -- # echo 0 00:04:45.395 14:59:45 -- setup/common.sh@33 -- # return 0 00:04:45.395 14:59:45 -- setup/hugepages.sh@97 -- # anon=0 00:04:45.395 14:59:45 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:45.395 14:59:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.395 14:59:45 -- setup/common.sh@18 -- # local node= 00:04:45.395 14:59:45 -- setup/common.sh@19 -- # local var val 00:04:45.395 14:59:45 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.395 14:59:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.395 14:59:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.395 14:59:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.395 14:59:45 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.395 14:59:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44182284 kB' 'MemAvailable: 47928860 kB' 'Buffers: 2708 kB' 'Cached: 11782840 kB' 'SwapCached: 0 kB' 'Active: 8520828 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128788 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491128 kB' 'Mapped: 182044 kB' 'Shmem: 7641000 kB' 'KReclaimable: 191212 kB' 'Slab: 646808 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455596 kB' 'KernelStack: 12752 kB' 'PageTables: 7744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255152 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.395 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.395 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.396 14:59:45 -- setup/common.sh@33 -- # echo 0 00:04:45.396 14:59:45 -- setup/common.sh@33 -- # return 0 00:04:45.396 14:59:45 -- setup/hugepages.sh@99 -- # surp=0 00:04:45.396 14:59:45 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:45.396 14:59:45 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:45.396 14:59:45 -- setup/common.sh@18 -- # local node= 00:04:45.396 14:59:45 -- setup/common.sh@19 -- # local var val 00:04:45.396 14:59:45 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.396 14:59:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.396 14:59:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.396 14:59:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.396 14:59:45 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.396 14:59:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44182456 kB' 'MemAvailable: 47929032 kB' 'Buffers: 2708 kB' 'Cached: 11782852 kB' 'SwapCached: 0 kB' 'Active: 8520416 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128376 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490656 kB' 'Mapped: 182076 kB' 'Shmem: 7641012 kB' 'KReclaimable: 191212 kB' 'Slab: 646800 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455588 kB' 'KernelStack: 12720 kB' 'PageTables: 7644 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255300 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.396 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.396 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.397 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.397 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.398 14:59:45 -- setup/common.sh@33 -- # echo 0 00:04:45.398 14:59:45 -- setup/common.sh@33 -- # return 0 00:04:45.398 14:59:45 -- setup/hugepages.sh@100 -- # resv=0 00:04:45.398 14:59:45 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:45.398 nr_hugepages=1024 00:04:45.398 14:59:45 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:45.398 resv_hugepages=0 00:04:45.398 14:59:45 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:45.398 surplus_hugepages=0 00:04:45.398 14:59:45 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:45.398 anon_hugepages=0 00:04:45.398 14:59:45 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:45.398 14:59:45 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:45.398 14:59:45 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:45.398 14:59:45 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:45.398 14:59:45 -- setup/common.sh@18 -- # local node= 00:04:45.398 14:59:45 -- setup/common.sh@19 -- # local var val 00:04:45.398 14:59:45 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.398 14:59:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.398 14:59:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.398 14:59:45 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.398 14:59:45 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.398 14:59:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44182204 kB' 'MemAvailable: 47928780 kB' 'Buffers: 2708 kB' 'Cached: 11782868 kB' 'SwapCached: 0 kB' 'Active: 8520496 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128456 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490800 kB' 'Mapped: 182076 kB' 'Shmem: 7641028 kB' 'KReclaimable: 191212 kB' 'Slab: 646904 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455692 kB' 'KernelStack: 12800 kB' 'PageTables: 7784 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255688 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.398 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.398 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.399 14:59:45 -- setup/common.sh@33 -- # echo 1024 00:04:45.399 14:59:45 -- setup/common.sh@33 -- # return 0 00:04:45.399 14:59:45 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:45.399 14:59:45 -- setup/hugepages.sh@112 -- # get_nodes 00:04:45.399 14:59:45 -- setup/hugepages.sh@27 -- # local node 00:04:45.399 14:59:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.399 14:59:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:45.399 14:59:45 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.399 14:59:45 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:45.399 14:59:45 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.399 14:59:45 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.399 14:59:45 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.399 14:59:45 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.399 14:59:45 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:45.399 14:59:45 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.399 14:59:45 -- setup/common.sh@18 -- # local node=0 00:04:45.399 14:59:45 -- setup/common.sh@19 -- # local var val 00:04:45.399 14:59:45 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.399 14:59:45 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.399 14:59:45 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:45.399 14:59:45 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:45.399 14:59:45 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.399 14:59:45 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20823684 kB' 'MemUsed: 12002172 kB' 'SwapCached: 0 kB' 'Active: 5138180 kB' 'Inactive: 3561576 kB' 'Active(anon): 4945900 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8553836 kB' 'Mapped: 59324 kB' 'AnonPages: 149220 kB' 'Shmem: 4799980 kB' 'KernelStack: 6344 kB' 'PageTables: 3676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87816 kB' 'Slab: 339352 kB' 'SReclaimable: 87816 kB' 'SUnreclaim: 251536 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.399 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.399 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # continue 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.400 14:59:45 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.400 14:59:45 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.400 14:59:45 -- setup/common.sh@33 -- # echo 0 00:04:45.400 14:59:45 -- setup/common.sh@33 -- # return 0 00:04:45.400 14:59:45 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.400 14:59:45 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.400 14:59:45 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.400 14:59:45 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.400 14:59:45 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:45.400 node0=1024 expecting 1024 00:04:45.400 14:59:45 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:45.400 00:04:45.400 real 0m2.444s 00:04:45.400 user 0m0.678s 00:04:45.400 sys 0m0.901s 00:04:45.400 14:59:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.400 14:59:45 -- common/autotest_common.sh@10 -- # set +x 00:04:45.400 ************************************ 00:04:45.400 END TEST default_setup 00:04:45.400 ************************************ 00:04:45.400 14:59:45 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:45.400 14:59:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.400 14:59:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.400 14:59:45 -- common/autotest_common.sh@10 -- # set +x 00:04:45.400 ************************************ 00:04:45.400 START TEST per_node_1G_alloc 00:04:45.400 ************************************ 00:04:45.400 14:59:45 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:45.400 14:59:45 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:45.400 14:59:45 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:45.400 14:59:45 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:45.400 14:59:45 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:45.400 14:59:45 -- setup/hugepages.sh@51 -- # shift 00:04:45.400 14:59:45 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:45.400 14:59:45 -- setup/hugepages.sh@52 -- # local node_ids 00:04:45.400 14:59:45 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.400 14:59:45 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:45.400 14:59:45 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:45.400 14:59:45 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:45.400 14:59:45 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.400 14:59:45 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:45.400 14:59:45 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.401 14:59:45 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.401 14:59:45 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.401 14:59:45 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:45.401 14:59:45 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:45.401 14:59:45 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:45.401 14:59:45 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:45.401 14:59:45 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:45.401 14:59:45 -- setup/hugepages.sh@73 -- # return 0 00:04:45.401 14:59:45 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:45.401 14:59:45 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:45.401 14:59:45 -- setup/hugepages.sh@146 -- # setup output 00:04:45.401 14:59:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.401 14:59:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:46.778 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.778 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:46.778 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.778 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.778 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.778 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.778 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.778 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.778 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.778 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.778 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.778 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.778 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.778 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.778 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.778 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.778 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.778 14:59:46 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:46.778 14:59:46 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:46.778 14:59:46 -- setup/hugepages.sh@89 -- # local node 00:04:46.778 14:59:46 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:46.778 14:59:46 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:46.778 14:59:46 -- setup/hugepages.sh@92 -- # local surp 00:04:46.778 14:59:46 -- setup/hugepages.sh@93 -- # local resv 00:04:46.778 14:59:46 -- setup/hugepages.sh@94 -- # local anon 00:04:46.779 14:59:46 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:46.779 14:59:46 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:46.779 14:59:46 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:46.779 14:59:46 -- setup/common.sh@18 -- # local node= 00:04:46.779 14:59:46 -- setup/common.sh@19 -- # local var val 00:04:46.779 14:59:46 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.779 14:59:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.779 14:59:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.779 14:59:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.779 14:59:46 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.779 14:59:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44196612 kB' 'MemAvailable: 47943188 kB' 'Buffers: 2708 kB' 'Cached: 11782924 kB' 'SwapCached: 0 kB' 'Active: 8520952 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128912 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491096 kB' 'Mapped: 182112 kB' 'Shmem: 7641084 kB' 'KReclaimable: 191212 kB' 'Slab: 646616 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455404 kB' 'KernelStack: 12784 kB' 'PageTables: 7736 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255724 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.779 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.779 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.780 14:59:46 -- setup/common.sh@33 -- # echo 0 00:04:46.780 14:59:46 -- setup/common.sh@33 -- # return 0 00:04:46.780 14:59:46 -- setup/hugepages.sh@97 -- # anon=0 00:04:46.780 14:59:46 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:46.780 14:59:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.780 14:59:46 -- setup/common.sh@18 -- # local node= 00:04:46.780 14:59:46 -- setup/common.sh@19 -- # local var val 00:04:46.780 14:59:46 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.780 14:59:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.780 14:59:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.780 14:59:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.780 14:59:46 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.780 14:59:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44199356 kB' 'MemAvailable: 47945932 kB' 'Buffers: 2708 kB' 'Cached: 11782924 kB' 'SwapCached: 0 kB' 'Active: 8521492 kB' 'Inactive: 3752508 kB' 'Active(anon): 8129452 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491668 kB' 'Mapped: 182112 kB' 'Shmem: 7641084 kB' 'KReclaimable: 191212 kB' 'Slab: 646660 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455448 kB' 'KernelStack: 12752 kB' 'PageTables: 7640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.780 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.780 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.781 14:59:46 -- setup/common.sh@33 -- # echo 0 00:04:46.781 14:59:46 -- setup/common.sh@33 -- # return 0 00:04:46.781 14:59:46 -- setup/hugepages.sh@99 -- # surp=0 00:04:46.781 14:59:46 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:46.781 14:59:46 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:46.781 14:59:46 -- setup/common.sh@18 -- # local node= 00:04:46.781 14:59:46 -- setup/common.sh@19 -- # local var val 00:04:46.781 14:59:46 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.781 14:59:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.781 14:59:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.781 14:59:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.781 14:59:46 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.781 14:59:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44199728 kB' 'MemAvailable: 47946304 kB' 'Buffers: 2708 kB' 'Cached: 11782936 kB' 'SwapCached: 0 kB' 'Active: 8520356 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128316 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490472 kB' 'Mapped: 182084 kB' 'Shmem: 7641096 kB' 'KReclaimable: 191212 kB' 'Slab: 646728 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455516 kB' 'KernelStack: 12768 kB' 'PageTables: 7680 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.781 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.781 14:59:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:46 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:46 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.782 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.782 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # continue 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.783 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.783 14:59:47 -- setup/common.sh@33 -- # echo 0 00:04:46.783 14:59:47 -- setup/common.sh@33 -- # return 0 00:04:46.783 14:59:47 -- setup/hugepages.sh@100 -- # resv=0 00:04:46.783 14:59:47 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:46.783 nr_hugepages=1024 00:04:46.783 14:59:47 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:46.783 resv_hugepages=0 00:04:46.783 14:59:47 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:46.783 surplus_hugepages=0 00:04:46.783 14:59:47 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:46.783 anon_hugepages=0 00:04:46.783 14:59:47 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:46.783 14:59:47 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:46.783 14:59:47 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:46.783 14:59:47 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:46.783 14:59:47 -- setup/common.sh@18 -- # local node= 00:04:46.783 14:59:47 -- setup/common.sh@19 -- # local var val 00:04:46.783 14:59:47 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.783 14:59:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.783 14:59:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.783 14:59:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.783 14:59:47 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.783 14:59:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.783 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.783 14:59:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44200396 kB' 'MemAvailable: 47946972 kB' 'Buffers: 2708 kB' 'Cached: 11782952 kB' 'SwapCached: 0 kB' 'Active: 8520672 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128632 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490804 kB' 'Mapped: 182084 kB' 'Shmem: 7641112 kB' 'KReclaimable: 191212 kB' 'Slab: 646728 kB' 'SReclaimable: 191212 kB' 'SUnreclaim: 455516 kB' 'KernelStack: 12752 kB' 'PageTables: 7636 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9255764 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.043 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.043 14:59:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:47.044 14:59:47 -- setup/common.sh@33 -- # echo 1024 00:04:47.044 14:59:47 -- setup/common.sh@33 -- # return 0 00:04:47.044 14:59:47 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:47.044 14:59:47 -- setup/hugepages.sh@112 -- # get_nodes 00:04:47.044 14:59:47 -- setup/hugepages.sh@27 -- # local node 00:04:47.044 14:59:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.044 14:59:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:47.044 14:59:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:47.044 14:59:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:47.044 14:59:47 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:47.044 14:59:47 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:47.044 14:59:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.044 14:59:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.044 14:59:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:47.044 14:59:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.044 14:59:47 -- setup/common.sh@18 -- # local node=0 00:04:47.044 14:59:47 -- setup/common.sh@19 -- # local var val 00:04:47.044 14:59:47 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.044 14:59:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.044 14:59:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:47.044 14:59:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:47.044 14:59:47 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.044 14:59:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21868840 kB' 'MemUsed: 10957016 kB' 'SwapCached: 0 kB' 'Active: 5138544 kB' 'Inactive: 3561576 kB' 'Active(anon): 4946264 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8553924 kB' 'Mapped: 59332 kB' 'AnonPages: 149440 kB' 'Shmem: 4800068 kB' 'KernelStack: 6344 kB' 'PageTables: 3684 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87816 kB' 'Slab: 339204 kB' 'SReclaimable: 87816 kB' 'SUnreclaim: 251388 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.044 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.044 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@33 -- # echo 0 00:04:47.045 14:59:47 -- setup/common.sh@33 -- # return 0 00:04:47.045 14:59:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.045 14:59:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:47.045 14:59:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:47.045 14:59:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:47.045 14:59:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:47.045 14:59:47 -- setup/common.sh@18 -- # local node=1 00:04:47.045 14:59:47 -- setup/common.sh@19 -- # local var val 00:04:47.045 14:59:47 -- setup/common.sh@20 -- # local mem_f mem 00:04:47.045 14:59:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:47.045 14:59:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:47.045 14:59:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:47.045 14:59:47 -- setup/common.sh@28 -- # mapfile -t mem 00:04:47.045 14:59:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 22331304 kB' 'MemUsed: 5378504 kB' 'SwapCached: 0 kB' 'Active: 3382236 kB' 'Inactive: 190932 kB' 'Active(anon): 3182476 kB' 'Inactive(anon): 0 kB' 'Active(file): 199760 kB' 'Inactive(file): 190932 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3231752 kB' 'Mapped: 122752 kB' 'AnonPages: 341484 kB' 'Shmem: 2841060 kB' 'KernelStack: 6456 kB' 'PageTables: 4096 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 103396 kB' 'Slab: 307524 kB' 'SReclaimable: 103396 kB' 'SUnreclaim: 204128 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.045 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.045 14:59:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # continue 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # IFS=': ' 00:04:47.046 14:59:47 -- setup/common.sh@31 -- # read -r var val _ 00:04:47.046 14:59:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:47.046 14:59:47 -- setup/common.sh@33 -- # echo 0 00:04:47.046 14:59:47 -- setup/common.sh@33 -- # return 0 00:04:47.046 14:59:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:47.046 14:59:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.046 14:59:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.046 14:59:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.046 14:59:47 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:47.046 node0=512 expecting 512 00:04:47.046 14:59:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:47.046 14:59:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:47.046 14:59:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:47.046 14:59:47 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:47.046 node1=512 expecting 512 00:04:47.046 14:59:47 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:47.046 00:04:47.046 real 0m1.514s 00:04:47.046 user 0m0.629s 00:04:47.046 sys 0m0.851s 00:04:47.046 14:59:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.046 14:59:47 -- common/autotest_common.sh@10 -- # set +x 00:04:47.046 ************************************ 00:04:47.046 END TEST per_node_1G_alloc 00:04:47.046 ************************************ 00:04:47.046 14:59:47 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:47.046 14:59:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.046 14:59:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.046 14:59:47 -- common/autotest_common.sh@10 -- # set +x 00:04:47.046 ************************************ 00:04:47.046 START TEST even_2G_alloc 00:04:47.046 ************************************ 00:04:47.046 14:59:47 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:47.046 14:59:47 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:47.046 14:59:47 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:47.046 14:59:47 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:47.046 14:59:47 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:47.046 14:59:47 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:47.046 14:59:47 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:47.046 14:59:47 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:47.046 14:59:47 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:47.046 14:59:47 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:47.047 14:59:47 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:47.047 14:59:47 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:47.047 14:59:47 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:47.047 14:59:47 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:47.047 14:59:47 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:47.047 14:59:47 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:47.047 14:59:47 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:47.047 14:59:47 -- setup/hugepages.sh@83 -- # : 512 00:04:47.047 14:59:47 -- setup/hugepages.sh@84 -- # : 1 00:04:47.047 14:59:47 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:47.047 14:59:47 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:47.047 14:59:47 -- setup/hugepages.sh@83 -- # : 0 00:04:47.047 14:59:47 -- setup/hugepages.sh@84 -- # : 0 00:04:47.047 14:59:47 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:47.047 14:59:47 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:47.047 14:59:47 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:47.047 14:59:47 -- setup/hugepages.sh@153 -- # setup output 00:04:47.047 14:59:47 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.047 14:59:47 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:48.428 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.428 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:48.428 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.428 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.428 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.428 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.428 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.428 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.428 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.428 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:48.428 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:48.428 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:48.428 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:48.428 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:48.428 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:48.428 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:48.428 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.428 14:59:48 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:48.428 14:59:48 -- setup/hugepages.sh@89 -- # local node 00:04:48.428 14:59:48 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:48.428 14:59:48 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:48.428 14:59:48 -- setup/hugepages.sh@92 -- # local surp 00:04:48.428 14:59:48 -- setup/hugepages.sh@93 -- # local resv 00:04:48.428 14:59:48 -- setup/hugepages.sh@94 -- # local anon 00:04:48.428 14:59:48 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:48.428 14:59:48 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:48.428 14:59:48 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:48.428 14:59:48 -- setup/common.sh@18 -- # local node= 00:04:48.428 14:59:48 -- setup/common.sh@19 -- # local var val 00:04:48.428 14:59:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.428 14:59:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.428 14:59:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.428 14:59:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.428 14:59:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.428 14:59:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.428 14:59:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44202648 kB' 'MemAvailable: 47949220 kB' 'Buffers: 2708 kB' 'Cached: 11783016 kB' 'SwapCached: 0 kB' 'Active: 8524304 kB' 'Inactive: 3752508 kB' 'Active(anon): 8132264 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 493420 kB' 'Mapped: 181732 kB' 'Shmem: 7641176 kB' 'KReclaimable: 191204 kB' 'Slab: 646972 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455768 kB' 'KernelStack: 12736 kB' 'PageTables: 7440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9249020 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.428 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.428 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.429 14:59:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.429 14:59:48 -- setup/common.sh@33 -- # echo 0 00:04:48.429 14:59:48 -- setup/common.sh@33 -- # return 0 00:04:48.429 14:59:48 -- setup/hugepages.sh@97 -- # anon=0 00:04:48.429 14:59:48 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:48.429 14:59:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.429 14:59:48 -- setup/common.sh@18 -- # local node= 00:04:48.429 14:59:48 -- setup/common.sh@19 -- # local var val 00:04:48.429 14:59:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.429 14:59:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.429 14:59:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.429 14:59:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.429 14:59:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.429 14:59:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.429 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44210516 kB' 'MemAvailable: 47957088 kB' 'Buffers: 2708 kB' 'Cached: 11783020 kB' 'SwapCached: 0 kB' 'Active: 8519280 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127240 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489308 kB' 'Mapped: 181732 kB' 'Shmem: 7641180 kB' 'KReclaimable: 191204 kB' 'Slab: 646972 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455768 kB' 'KernelStack: 12688 kB' 'PageTables: 7288 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9243848 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.430 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.430 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.431 14:59:48 -- setup/common.sh@33 -- # echo 0 00:04:48.431 14:59:48 -- setup/common.sh@33 -- # return 0 00:04:48.431 14:59:48 -- setup/hugepages.sh@99 -- # surp=0 00:04:48.431 14:59:48 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:48.431 14:59:48 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:48.431 14:59:48 -- setup/common.sh@18 -- # local node= 00:04:48.431 14:59:48 -- setup/common.sh@19 -- # local var val 00:04:48.431 14:59:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.431 14:59:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.431 14:59:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.431 14:59:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.431 14:59:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.431 14:59:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44209960 kB' 'MemAvailable: 47956532 kB' 'Buffers: 2708 kB' 'Cached: 11783032 kB' 'SwapCached: 0 kB' 'Active: 8519392 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127352 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489356 kB' 'Mapped: 181244 kB' 'Shmem: 7641192 kB' 'KReclaimable: 191204 kB' 'Slab: 646972 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455768 kB' 'KernelStack: 12768 kB' 'PageTables: 7436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9243864 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.431 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.431 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.432 14:59:48 -- setup/common.sh@33 -- # echo 0 00:04:48.432 14:59:48 -- setup/common.sh@33 -- # return 0 00:04:48.432 14:59:48 -- setup/hugepages.sh@100 -- # resv=0 00:04:48.432 14:59:48 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:48.432 nr_hugepages=1024 00:04:48.432 14:59:48 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:48.432 resv_hugepages=0 00:04:48.432 14:59:48 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:48.432 surplus_hugepages=0 00:04:48.432 14:59:48 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:48.432 anon_hugepages=0 00:04:48.432 14:59:48 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.432 14:59:48 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:48.432 14:59:48 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:48.432 14:59:48 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:48.432 14:59:48 -- setup/common.sh@18 -- # local node= 00:04:48.432 14:59:48 -- setup/common.sh@19 -- # local var val 00:04:48.432 14:59:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.432 14:59:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.432 14:59:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.432 14:59:48 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.432 14:59:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.432 14:59:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.432 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.432 14:59:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44209296 kB' 'MemAvailable: 47955868 kB' 'Buffers: 2708 kB' 'Cached: 11783044 kB' 'SwapCached: 0 kB' 'Active: 8519076 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127036 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489044 kB' 'Mapped: 181080 kB' 'Shmem: 7641204 kB' 'KReclaimable: 191204 kB' 'Slab: 647000 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455796 kB' 'KernelStack: 12768 kB' 'PageTables: 7440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9243876 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.433 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.433 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.434 14:59:48 -- setup/common.sh@33 -- # echo 1024 00:04:48.434 14:59:48 -- setup/common.sh@33 -- # return 0 00:04:48.434 14:59:48 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.434 14:59:48 -- setup/hugepages.sh@112 -- # get_nodes 00:04:48.434 14:59:48 -- setup/hugepages.sh@27 -- # local node 00:04:48.434 14:59:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.434 14:59:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:48.434 14:59:48 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.434 14:59:48 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:48.434 14:59:48 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:48.434 14:59:48 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:48.434 14:59:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.434 14:59:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.434 14:59:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:48.434 14:59:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.434 14:59:48 -- setup/common.sh@18 -- # local node=0 00:04:48.434 14:59:48 -- setup/common.sh@19 -- # local var val 00:04:48.434 14:59:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.434 14:59:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.434 14:59:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:48.434 14:59:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:48.434 14:59:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.434 14:59:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21859548 kB' 'MemUsed: 10966308 kB' 'SwapCached: 0 kB' 'Active: 5136764 kB' 'Inactive: 3561576 kB' 'Active(anon): 4944484 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8553960 kB' 'Mapped: 58576 kB' 'AnonPages: 147508 kB' 'Shmem: 4800104 kB' 'KernelStack: 6312 kB' 'PageTables: 3376 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87808 kB' 'Slab: 339376 kB' 'SReclaimable: 87808 kB' 'SUnreclaim: 251568 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.434 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.434 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.435 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.435 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.435 14:59:48 -- setup/common.sh@33 -- # echo 0 00:04:48.435 14:59:48 -- setup/common.sh@33 -- # return 0 00:04:48.435 14:59:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.435 14:59:48 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.435 14:59:48 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.435 14:59:48 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:48.435 14:59:48 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.435 14:59:48 -- setup/common.sh@18 -- # local node=1 00:04:48.435 14:59:48 -- setup/common.sh@19 -- # local var val 00:04:48.435 14:59:48 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.694 14:59:48 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.694 14:59:48 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:48.694 14:59:48 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:48.694 14:59:48 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.694 14:59:48 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 22350928 kB' 'MemUsed: 5358880 kB' 'SwapCached: 0 kB' 'Active: 3382612 kB' 'Inactive: 190932 kB' 'Active(anon): 3182852 kB' 'Inactive(anon): 0 kB' 'Active(file): 199760 kB' 'Inactive(file): 190932 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3231820 kB' 'Mapped: 122504 kB' 'AnonPages: 341804 kB' 'Shmem: 2841128 kB' 'KernelStack: 6456 kB' 'PageTables: 4064 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 103396 kB' 'Slab: 307624 kB' 'SReclaimable: 103396 kB' 'SUnreclaim: 204228 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.694 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.694 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # continue 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.695 14:59:48 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.695 14:59:48 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.695 14:59:48 -- setup/common.sh@33 -- # echo 0 00:04:48.695 14:59:48 -- setup/common.sh@33 -- # return 0 00:04:48.695 14:59:48 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.695 14:59:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.695 14:59:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.695 14:59:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.695 14:59:48 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:48.695 node0=512 expecting 512 00:04:48.695 14:59:48 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.695 14:59:48 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.695 14:59:48 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.695 14:59:48 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:48.695 node1=512 expecting 512 00:04:48.695 14:59:48 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:48.695 00:04:48.695 real 0m1.580s 00:04:48.695 user 0m0.667s 00:04:48.695 sys 0m0.881s 00:04:48.695 14:59:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.695 14:59:48 -- common/autotest_common.sh@10 -- # set +x 00:04:48.695 ************************************ 00:04:48.695 END TEST even_2G_alloc 00:04:48.695 ************************************ 00:04:48.695 14:59:48 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:48.695 14:59:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.695 14:59:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.695 14:59:48 -- common/autotest_common.sh@10 -- # set +x 00:04:48.695 ************************************ 00:04:48.695 START TEST odd_alloc 00:04:48.695 ************************************ 00:04:48.695 14:59:48 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:48.695 14:59:48 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:48.695 14:59:48 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:48.695 14:59:48 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:48.695 14:59:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:48.695 14:59:48 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:48.695 14:59:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:48.695 14:59:48 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:48.695 14:59:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:48.695 14:59:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:48.695 14:59:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:48.695 14:59:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:48.695 14:59:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:48.695 14:59:48 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:48.695 14:59:48 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:48.695 14:59:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.695 14:59:48 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:48.695 14:59:48 -- setup/hugepages.sh@83 -- # : 513 00:04:48.696 14:59:48 -- setup/hugepages.sh@84 -- # : 1 00:04:48.696 14:59:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.696 14:59:48 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:48.696 14:59:48 -- setup/hugepages.sh@83 -- # : 0 00:04:48.696 14:59:48 -- setup/hugepages.sh@84 -- # : 0 00:04:48.696 14:59:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:48.696 14:59:48 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:48.696 14:59:48 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:48.696 14:59:48 -- setup/hugepages.sh@160 -- # setup output 00:04:48.696 14:59:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.696 14:59:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:50.076 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:50.076 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.076 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.076 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.076 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.076 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.076 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.076 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.076 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.076 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:50.076 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:50.076 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:50.076 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:50.076 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:50.076 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:50.076 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:50.076 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:50.076 14:59:50 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:50.076 14:59:50 -- setup/hugepages.sh@89 -- # local node 00:04:50.076 14:59:50 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:50.076 14:59:50 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:50.076 14:59:50 -- setup/hugepages.sh@92 -- # local surp 00:04:50.076 14:59:50 -- setup/hugepages.sh@93 -- # local resv 00:04:50.076 14:59:50 -- setup/hugepages.sh@94 -- # local anon 00:04:50.076 14:59:50 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:50.076 14:59:50 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:50.076 14:59:50 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:50.076 14:59:50 -- setup/common.sh@18 -- # local node= 00:04:50.076 14:59:50 -- setup/common.sh@19 -- # local var val 00:04:50.076 14:59:50 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.076 14:59:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.076 14:59:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.076 14:59:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.076 14:59:50 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.076 14:59:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44200356 kB' 'MemAvailable: 47946928 kB' 'Buffers: 2708 kB' 'Cached: 11783112 kB' 'SwapCached: 0 kB' 'Active: 8520212 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128172 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490420 kB' 'Mapped: 181136 kB' 'Shmem: 7641272 kB' 'KReclaimable: 191204 kB' 'Slab: 646428 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455224 kB' 'KernelStack: 12768 kB' 'PageTables: 7396 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 9244060 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.076 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.076 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:50.077 14:59:50 -- setup/common.sh@33 -- # echo 0 00:04:50.077 14:59:50 -- setup/common.sh@33 -- # return 0 00:04:50.077 14:59:50 -- setup/hugepages.sh@97 -- # anon=0 00:04:50.077 14:59:50 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:50.077 14:59:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.077 14:59:50 -- setup/common.sh@18 -- # local node= 00:04:50.077 14:59:50 -- setup/common.sh@19 -- # local var val 00:04:50.077 14:59:50 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.077 14:59:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.077 14:59:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.077 14:59:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.077 14:59:50 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.077 14:59:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44202100 kB' 'MemAvailable: 47948672 kB' 'Buffers: 2708 kB' 'Cached: 11783112 kB' 'SwapCached: 0 kB' 'Active: 8520752 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128712 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491000 kB' 'Mapped: 181212 kB' 'Shmem: 7641272 kB' 'KReclaimable: 191204 kB' 'Slab: 646444 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455240 kB' 'KernelStack: 12800 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 9244072 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.077 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.077 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.078 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.078 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.078 14:59:50 -- setup/common.sh@33 -- # echo 0 00:04:50.078 14:59:50 -- setup/common.sh@33 -- # return 0 00:04:50.078 14:59:50 -- setup/hugepages.sh@99 -- # surp=0 00:04:50.078 14:59:50 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:50.078 14:59:50 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:50.078 14:59:50 -- setup/common.sh@18 -- # local node= 00:04:50.078 14:59:50 -- setup/common.sh@19 -- # local var val 00:04:50.078 14:59:50 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.078 14:59:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.079 14:59:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.079 14:59:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.079 14:59:50 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.079 14:59:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44202372 kB' 'MemAvailable: 47948944 kB' 'Buffers: 2708 kB' 'Cached: 11783120 kB' 'SwapCached: 0 kB' 'Active: 8519780 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127740 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489964 kB' 'Mapped: 181184 kB' 'Shmem: 7641280 kB' 'KReclaimable: 191204 kB' 'Slab: 646436 kB' 'SReclaimable: 191204 kB' 'SUnreclaim: 455232 kB' 'KernelStack: 12752 kB' 'PageTables: 7308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 9244088 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.079 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.079 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:50.080 14:59:50 -- setup/common.sh@33 -- # echo 0 00:04:50.080 14:59:50 -- setup/common.sh@33 -- # return 0 00:04:50.080 14:59:50 -- setup/hugepages.sh@100 -- # resv=0 00:04:50.080 14:59:50 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:50.080 nr_hugepages=1025 00:04:50.080 14:59:50 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:50.080 resv_hugepages=0 00:04:50.080 14:59:50 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:50.080 surplus_hugepages=0 00:04:50.080 14:59:50 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:50.080 anon_hugepages=0 00:04:50.080 14:59:50 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:50.080 14:59:50 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:50.080 14:59:50 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:50.080 14:59:50 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:50.080 14:59:50 -- setup/common.sh@18 -- # local node= 00:04:50.080 14:59:50 -- setup/common.sh@19 -- # local var val 00:04:50.080 14:59:50 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.080 14:59:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.080 14:59:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:50.080 14:59:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:50.080 14:59:50 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.080 14:59:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44211192 kB' 'MemAvailable: 47957716 kB' 'Buffers: 2708 kB' 'Cached: 11783140 kB' 'SwapCached: 0 kB' 'Active: 8519676 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127636 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489860 kB' 'Mapped: 181108 kB' 'Shmem: 7641300 kB' 'KReclaimable: 191108 kB' 'Slab: 646352 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455244 kB' 'KernelStack: 12800 kB' 'PageTables: 7440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 9244104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.080 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.080 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.081 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.081 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:50.081 14:59:50 -- setup/common.sh@33 -- # echo 1025 00:04:50.081 14:59:50 -- setup/common.sh@33 -- # return 0 00:04:50.081 14:59:50 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:50.081 14:59:50 -- setup/hugepages.sh@112 -- # get_nodes 00:04:50.081 14:59:50 -- setup/hugepages.sh@27 -- # local node 00:04:50.081 14:59:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.081 14:59:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:50.081 14:59:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:50.081 14:59:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:50.082 14:59:50 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:50.082 14:59:50 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:50.082 14:59:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.082 14:59:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.082 14:59:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:50.082 14:59:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.082 14:59:50 -- setup/common.sh@18 -- # local node=0 00:04:50.082 14:59:50 -- setup/common.sh@19 -- # local var val 00:04:50.082 14:59:50 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.082 14:59:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.082 14:59:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:50.082 14:59:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:50.082 14:59:50 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.082 14:59:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21865448 kB' 'MemUsed: 10960408 kB' 'SwapCached: 0 kB' 'Active: 5136704 kB' 'Inactive: 3561576 kB' 'Active(anon): 4944424 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8553980 kB' 'Mapped: 58584 kB' 'AnonPages: 147560 kB' 'Shmem: 4800124 kB' 'KernelStack: 6344 kB' 'PageTables: 3384 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87712 kB' 'Slab: 338948 kB' 'SReclaimable: 87712 kB' 'SUnreclaim: 251236 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.082 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.082 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@33 -- # echo 0 00:04:50.083 14:59:50 -- setup/common.sh@33 -- # return 0 00:04:50.083 14:59:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.083 14:59:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:50.083 14:59:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:50.083 14:59:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:50.083 14:59:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:50.083 14:59:50 -- setup/common.sh@18 -- # local node=1 00:04:50.083 14:59:50 -- setup/common.sh@19 -- # local var val 00:04:50.083 14:59:50 -- setup/common.sh@20 -- # local mem_f mem 00:04:50.083 14:59:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:50.083 14:59:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:50.083 14:59:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:50.083 14:59:50 -- setup/common.sh@28 -- # mapfile -t mem 00:04:50.083 14:59:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 22345496 kB' 'MemUsed: 5364312 kB' 'SwapCached: 0 kB' 'Active: 3382916 kB' 'Inactive: 190932 kB' 'Active(anon): 3183156 kB' 'Inactive(anon): 0 kB' 'Active(file): 199760 kB' 'Inactive(file): 190932 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3231884 kB' 'Mapped: 122524 kB' 'AnonPages: 342164 kB' 'Shmem: 2841192 kB' 'KernelStack: 6456 kB' 'PageTables: 4056 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 103396 kB' 'Slab: 307404 kB' 'SReclaimable: 103396 kB' 'SUnreclaim: 204008 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.083 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.083 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # continue 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # IFS=': ' 00:04:50.084 14:59:50 -- setup/common.sh@31 -- # read -r var val _ 00:04:50.084 14:59:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:50.084 14:59:50 -- setup/common.sh@33 -- # echo 0 00:04:50.084 14:59:50 -- setup/common.sh@33 -- # return 0 00:04:50.084 14:59:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.084 14:59:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.084 14:59:50 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:50.084 node0=512 expecting 513 00:04:50.084 14:59:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:50.084 14:59:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:50.084 14:59:50 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:50.084 node1=513 expecting 512 00:04:50.084 14:59:50 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:50.084 00:04:50.084 real 0m1.551s 00:04:50.084 user 0m0.631s 00:04:50.084 sys 0m0.890s 00:04:50.084 14:59:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.084 14:59:50 -- common/autotest_common.sh@10 -- # set +x 00:04:50.084 ************************************ 00:04:50.084 END TEST odd_alloc 00:04:50.084 ************************************ 00:04:50.084 14:59:50 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:50.084 14:59:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:50.084 14:59:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:50.084 14:59:50 -- common/autotest_common.sh@10 -- # set +x 00:04:50.084 ************************************ 00:04:50.084 START TEST custom_alloc 00:04:50.084 ************************************ 00:04:50.084 14:59:50 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:50.084 14:59:50 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:50.084 14:59:50 -- setup/hugepages.sh@169 -- # local node 00:04:50.084 14:59:50 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:50.084 14:59:50 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:50.084 14:59:50 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:50.084 14:59:50 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:50.084 14:59:50 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:50.084 14:59:50 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:50.084 14:59:50 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:50.084 14:59:50 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:50.084 14:59:50 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:50.084 14:59:50 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:50.084 14:59:50 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:50.084 14:59:50 -- setup/hugepages.sh@83 -- # : 256 00:04:50.084 14:59:50 -- setup/hugepages.sh@84 -- # : 1 00:04:50.084 14:59:50 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:50.084 14:59:50 -- setup/hugepages.sh@83 -- # : 0 00:04:50.084 14:59:50 -- setup/hugepages.sh@84 -- # : 0 00:04:50.084 14:59:50 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:50.084 14:59:50 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:50.084 14:59:50 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:50.084 14:59:50 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:50.084 14:59:50 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:50.084 14:59:50 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:50.084 14:59:50 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:50.084 14:59:50 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:50.084 14:59:50 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:50.084 14:59:50 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:50.084 14:59:50 -- setup/hugepages.sh@78 -- # return 0 00:04:50.084 14:59:50 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:50.084 14:59:50 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:50.084 14:59:50 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:50.084 14:59:50 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:50.084 14:59:50 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:50.084 14:59:50 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:50.084 14:59:50 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:50.084 14:59:50 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:50.084 14:59:50 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:50.084 14:59:50 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:50.084 14:59:50 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:50.084 14:59:50 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:50.084 14:59:50 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:50.084 14:59:50 -- setup/hugepages.sh@78 -- # return 0 00:04:50.084 14:59:50 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:50.084 14:59:50 -- setup/hugepages.sh@187 -- # setup output 00:04:50.084 14:59:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:50.084 14:59:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:51.464 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:51.464 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:51.464 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:51.464 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:51.464 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:51.464 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:51.464 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:51.464 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:51.464 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:51.464 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:51.464 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:51.464 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:51.464 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:51.464 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:51.464 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:51.464 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:51.464 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:51.464 14:59:51 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:51.464 14:59:51 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:51.464 14:59:51 -- setup/hugepages.sh@89 -- # local node 00:04:51.464 14:59:51 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:51.464 14:59:51 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:51.464 14:59:51 -- setup/hugepages.sh@92 -- # local surp 00:04:51.464 14:59:51 -- setup/hugepages.sh@93 -- # local resv 00:04:51.464 14:59:51 -- setup/hugepages.sh@94 -- # local anon 00:04:51.464 14:59:51 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:51.464 14:59:51 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:51.464 14:59:51 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:51.464 14:59:51 -- setup/common.sh@18 -- # local node= 00:04:51.464 14:59:51 -- setup/common.sh@19 -- # local var val 00:04:51.464 14:59:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.465 14:59:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.465 14:59:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.465 14:59:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.465 14:59:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.465 14:59:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43145732 kB' 'MemAvailable: 46892256 kB' 'Buffers: 2708 kB' 'Cached: 11783208 kB' 'SwapCached: 0 kB' 'Active: 8519368 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127328 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489212 kB' 'Mapped: 181188 kB' 'Shmem: 7641368 kB' 'KReclaimable: 191108 kB' 'Slab: 646296 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455188 kB' 'KernelStack: 12816 kB' 'PageTables: 7492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 9244304 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198456 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.465 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.465 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:51.466 14:59:51 -- setup/common.sh@33 -- # echo 0 00:04:51.466 14:59:51 -- setup/common.sh@33 -- # return 0 00:04:51.466 14:59:51 -- setup/hugepages.sh@97 -- # anon=0 00:04:51.466 14:59:51 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:51.466 14:59:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.466 14:59:51 -- setup/common.sh@18 -- # local node= 00:04:51.466 14:59:51 -- setup/common.sh@19 -- # local var val 00:04:51.466 14:59:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.466 14:59:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.466 14:59:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.466 14:59:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.466 14:59:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.466 14:59:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43147932 kB' 'MemAvailable: 46894456 kB' 'Buffers: 2708 kB' 'Cached: 11783216 kB' 'SwapCached: 0 kB' 'Active: 8519188 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127148 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489024 kB' 'Mapped: 181176 kB' 'Shmem: 7641376 kB' 'KReclaimable: 191108 kB' 'Slab: 646320 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455212 kB' 'KernelStack: 12832 kB' 'PageTables: 7516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 9244428 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.466 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.466 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.467 14:59:51 -- setup/common.sh@33 -- # echo 0 00:04:51.467 14:59:51 -- setup/common.sh@33 -- # return 0 00:04:51.467 14:59:51 -- setup/hugepages.sh@99 -- # surp=0 00:04:51.467 14:59:51 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:51.467 14:59:51 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:51.467 14:59:51 -- setup/common.sh@18 -- # local node= 00:04:51.467 14:59:51 -- setup/common.sh@19 -- # local var val 00:04:51.467 14:59:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.467 14:59:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.467 14:59:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.467 14:59:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.467 14:59:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.467 14:59:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43151188 kB' 'MemAvailable: 46897712 kB' 'Buffers: 2708 kB' 'Cached: 11783220 kB' 'SwapCached: 0 kB' 'Active: 8518652 kB' 'Inactive: 3752508 kB' 'Active(anon): 8126612 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488476 kB' 'Mapped: 181096 kB' 'Shmem: 7641380 kB' 'KReclaimable: 191108 kB' 'Slab: 646252 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455144 kB' 'KernelStack: 12832 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 9244332 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.467 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.467 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.468 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.468 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:51.469 14:59:51 -- setup/common.sh@33 -- # echo 0 00:04:51.469 14:59:51 -- setup/common.sh@33 -- # return 0 00:04:51.469 14:59:51 -- setup/hugepages.sh@100 -- # resv=0 00:04:51.469 14:59:51 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:51.469 nr_hugepages=1536 00:04:51.469 14:59:51 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:51.469 resv_hugepages=0 00:04:51.469 14:59:51 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:51.469 surplus_hugepages=0 00:04:51.469 14:59:51 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:51.469 anon_hugepages=0 00:04:51.469 14:59:51 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:51.469 14:59:51 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:51.469 14:59:51 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:51.469 14:59:51 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:51.469 14:59:51 -- setup/common.sh@18 -- # local node= 00:04:51.469 14:59:51 -- setup/common.sh@19 -- # local var val 00:04:51.469 14:59:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.469 14:59:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.469 14:59:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:51.469 14:59:51 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:51.469 14:59:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.469 14:59:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.469 14:59:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 43151764 kB' 'MemAvailable: 46898288 kB' 'Buffers: 2708 kB' 'Cached: 11783236 kB' 'SwapCached: 0 kB' 'Active: 8519088 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127048 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 488964 kB' 'Mapped: 181096 kB' 'Shmem: 7641396 kB' 'KReclaimable: 191108 kB' 'Slab: 646252 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455144 kB' 'KernelStack: 12816 kB' 'PageTables: 7448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 9244348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.469 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.469 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.730 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.730 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:51.731 14:59:51 -- setup/common.sh@33 -- # echo 1536 00:04:51.731 14:59:51 -- setup/common.sh@33 -- # return 0 00:04:51.731 14:59:51 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:51.731 14:59:51 -- setup/hugepages.sh@112 -- # get_nodes 00:04:51.731 14:59:51 -- setup/hugepages.sh@27 -- # local node 00:04:51.731 14:59:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.731 14:59:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:51.731 14:59:51 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:51.731 14:59:51 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:51.731 14:59:51 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:51.731 14:59:51 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:51.731 14:59:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:51.731 14:59:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:51.731 14:59:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:51.731 14:59:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.731 14:59:51 -- setup/common.sh@18 -- # local node=0 00:04:51.731 14:59:51 -- setup/common.sh@19 -- # local var val 00:04:51.731 14:59:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.731 14:59:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.731 14:59:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:51.731 14:59:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:51.731 14:59:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.731 14:59:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 21857076 kB' 'MemUsed: 10968780 kB' 'SwapCached: 0 kB' 'Active: 5136096 kB' 'Inactive: 3561576 kB' 'Active(anon): 4943816 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8554068 kB' 'Mapped: 58588 kB' 'AnonPages: 146812 kB' 'Shmem: 4800212 kB' 'KernelStack: 6344 kB' 'PageTables: 3292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87712 kB' 'Slab: 338820 kB' 'SReclaimable: 87712 kB' 'SUnreclaim: 251108 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.731 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.731 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@33 -- # echo 0 00:04:51.732 14:59:51 -- setup/common.sh@33 -- # return 0 00:04:51.732 14:59:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:51.732 14:59:51 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:51.732 14:59:51 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:51.732 14:59:51 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:51.732 14:59:51 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:51.732 14:59:51 -- setup/common.sh@18 -- # local node=1 00:04:51.732 14:59:51 -- setup/common.sh@19 -- # local var val 00:04:51.732 14:59:51 -- setup/common.sh@20 -- # local mem_f mem 00:04:51.732 14:59:51 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:51.732 14:59:51 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:51.732 14:59:51 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:51.732 14:59:51 -- setup/common.sh@28 -- # mapfile -t mem 00:04:51.732 14:59:51 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 21294916 kB' 'MemUsed: 6414892 kB' 'SwapCached: 0 kB' 'Active: 3382800 kB' 'Inactive: 190932 kB' 'Active(anon): 3183040 kB' 'Inactive(anon): 0 kB' 'Active(file): 199760 kB' 'Inactive(file): 190932 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3231892 kB' 'Mapped: 122508 kB' 'AnonPages: 341864 kB' 'Shmem: 2841200 kB' 'KernelStack: 6472 kB' 'PageTables: 4152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 103396 kB' 'Slab: 307432 kB' 'SReclaimable: 103396 kB' 'SUnreclaim: 204036 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.732 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.732 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # continue 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # IFS=': ' 00:04:51.733 14:59:51 -- setup/common.sh@31 -- # read -r var val _ 00:04:51.733 14:59:51 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:51.733 14:59:51 -- setup/common.sh@33 -- # echo 0 00:04:51.733 14:59:51 -- setup/common.sh@33 -- # return 0 00:04:51.733 14:59:51 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:51.733 14:59:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:51.733 14:59:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:51.733 14:59:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:51.733 14:59:51 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:51.733 node0=512 expecting 512 00:04:51.733 14:59:51 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:51.733 14:59:51 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:51.733 14:59:51 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:51.733 14:59:51 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:51.733 node1=1024 expecting 1024 00:04:51.733 14:59:51 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:51.733 00:04:51.733 real 0m1.481s 00:04:51.733 user 0m0.637s 00:04:51.733 sys 0m0.808s 00:04:51.733 14:59:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.733 14:59:51 -- common/autotest_common.sh@10 -- # set +x 00:04:51.733 ************************************ 00:04:51.733 END TEST custom_alloc 00:04:51.733 ************************************ 00:04:51.733 14:59:51 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:51.733 14:59:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.733 14:59:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.733 14:59:51 -- common/autotest_common.sh@10 -- # set +x 00:04:51.733 ************************************ 00:04:51.733 START TEST no_shrink_alloc 00:04:51.733 ************************************ 00:04:51.733 14:59:51 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:51.733 14:59:51 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:51.733 14:59:51 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:51.733 14:59:51 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:51.733 14:59:51 -- setup/hugepages.sh@51 -- # shift 00:04:51.733 14:59:51 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:51.733 14:59:51 -- setup/hugepages.sh@52 -- # local node_ids 00:04:51.733 14:59:51 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:51.733 14:59:51 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:51.733 14:59:51 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:51.733 14:59:51 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:51.733 14:59:51 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:51.733 14:59:51 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:51.733 14:59:51 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:51.733 14:59:51 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:51.733 14:59:51 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:51.733 14:59:51 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:51.733 14:59:51 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:51.733 14:59:51 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:51.733 14:59:51 -- setup/hugepages.sh@73 -- # return 0 00:04:51.733 14:59:51 -- setup/hugepages.sh@198 -- # setup output 00:04:51.733 14:59:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:51.733 14:59:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:53.114 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.114 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:53.114 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.114 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.114 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.114 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.114 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.114 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.114 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.114 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:53.114 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:53.114 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:53.114 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:53.114 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:53.115 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:53.115 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:53.115 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:53.115 14:59:53 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:53.115 14:59:53 -- setup/hugepages.sh@89 -- # local node 00:04:53.115 14:59:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:53.115 14:59:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:53.115 14:59:53 -- setup/hugepages.sh@92 -- # local surp 00:04:53.115 14:59:53 -- setup/hugepages.sh@93 -- # local resv 00:04:53.115 14:59:53 -- setup/hugepages.sh@94 -- # local anon 00:04:53.115 14:59:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:53.115 14:59:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:53.115 14:59:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:53.115 14:59:53 -- setup/common.sh@18 -- # local node= 00:04:53.115 14:59:53 -- setup/common.sh@19 -- # local var val 00:04:53.115 14:59:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.115 14:59:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.115 14:59:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.115 14:59:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.115 14:59:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.115 14:59:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44216856 kB' 'MemAvailable: 47963380 kB' 'Buffers: 2708 kB' 'Cached: 11783300 kB' 'SwapCached: 0 kB' 'Active: 8519440 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127400 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489292 kB' 'Mapped: 181196 kB' 'Shmem: 7641460 kB' 'KReclaimable: 191108 kB' 'Slab: 646256 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455148 kB' 'KernelStack: 12832 kB' 'PageTables: 7520 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9244528 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198440 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.115 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.115 14:59:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:53.116 14:59:53 -- setup/common.sh@33 -- # echo 0 00:04:53.116 14:59:53 -- setup/common.sh@33 -- # return 0 00:04:53.116 14:59:53 -- setup/hugepages.sh@97 -- # anon=0 00:04:53.116 14:59:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:53.116 14:59:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.116 14:59:53 -- setup/common.sh@18 -- # local node= 00:04:53.116 14:59:53 -- setup/common.sh@19 -- # local var val 00:04:53.116 14:59:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.116 14:59:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.116 14:59:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.116 14:59:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.116 14:59:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.116 14:59:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44218724 kB' 'MemAvailable: 47965248 kB' 'Buffers: 2708 kB' 'Cached: 11783300 kB' 'SwapCached: 0 kB' 'Active: 8520424 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128384 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489864 kB' 'Mapped: 181196 kB' 'Shmem: 7641460 kB' 'KReclaimable: 191108 kB' 'Slab: 646256 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455148 kB' 'KernelStack: 12880 kB' 'PageTables: 7672 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9247568 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.116 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.116 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.117 14:59:53 -- setup/common.sh@33 -- # echo 0 00:04:53.117 14:59:53 -- setup/common.sh@33 -- # return 0 00:04:53.117 14:59:53 -- setup/hugepages.sh@99 -- # surp=0 00:04:53.117 14:59:53 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:53.117 14:59:53 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:53.117 14:59:53 -- setup/common.sh@18 -- # local node= 00:04:53.117 14:59:53 -- setup/common.sh@19 -- # local var val 00:04:53.117 14:59:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.117 14:59:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.117 14:59:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.117 14:59:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.117 14:59:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.117 14:59:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44224396 kB' 'MemAvailable: 47970920 kB' 'Buffers: 2708 kB' 'Cached: 11783308 kB' 'SwapCached: 0 kB' 'Active: 8520296 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128256 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489752 kB' 'Mapped: 181104 kB' 'Shmem: 7641468 kB' 'KReclaimable: 191108 kB' 'Slab: 646240 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455132 kB' 'KernelStack: 12960 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9248608 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.117 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.117 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.118 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.118 14:59:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:53.119 14:59:53 -- setup/common.sh@33 -- # echo 0 00:04:53.119 14:59:53 -- setup/common.sh@33 -- # return 0 00:04:53.119 14:59:53 -- setup/hugepages.sh@100 -- # resv=0 00:04:53.119 14:59:53 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:53.119 nr_hugepages=1024 00:04:53.119 14:59:53 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:53.119 resv_hugepages=0 00:04:53.119 14:59:53 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:53.119 surplus_hugepages=0 00:04:53.119 14:59:53 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:53.119 anon_hugepages=0 00:04:53.119 14:59:53 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:53.119 14:59:53 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:53.119 14:59:53 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:53.119 14:59:53 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:53.119 14:59:53 -- setup/common.sh@18 -- # local node= 00:04:53.119 14:59:53 -- setup/common.sh@19 -- # local var val 00:04:53.119 14:59:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.119 14:59:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.119 14:59:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:53.119 14:59:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:53.119 14:59:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.119 14:59:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44223228 kB' 'MemAvailable: 47969752 kB' 'Buffers: 2708 kB' 'Cached: 11783328 kB' 'SwapCached: 0 kB' 'Active: 8520592 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128552 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490468 kB' 'Mapped: 181120 kB' 'Shmem: 7641488 kB' 'KReclaimable: 191108 kB' 'Slab: 646240 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455132 kB' 'KernelStack: 13200 kB' 'PageTables: 8524 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9247232 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198664 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.119 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.119 14:59:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:53.120 14:59:53 -- setup/common.sh@33 -- # echo 1024 00:04:53.120 14:59:53 -- setup/common.sh@33 -- # return 0 00:04:53.120 14:59:53 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:53.120 14:59:53 -- setup/hugepages.sh@112 -- # get_nodes 00:04:53.120 14:59:53 -- setup/hugepages.sh@27 -- # local node 00:04:53.120 14:59:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:53.120 14:59:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:53.120 14:59:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:53.120 14:59:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:53.120 14:59:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:53.120 14:59:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:53.120 14:59:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:53.120 14:59:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:53.120 14:59:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:53.120 14:59:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:53.120 14:59:53 -- setup/common.sh@18 -- # local node=0 00:04:53.120 14:59:53 -- setup/common.sh@19 -- # local var val 00:04:53.120 14:59:53 -- setup/common.sh@20 -- # local mem_f mem 00:04:53.120 14:59:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:53.120 14:59:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:53.120 14:59:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:53.120 14:59:53 -- setup/common.sh@28 -- # mapfile -t mem 00:04:53.120 14:59:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20815756 kB' 'MemUsed: 12010100 kB' 'SwapCached: 0 kB' 'Active: 5136508 kB' 'Inactive: 3561576 kB' 'Active(anon): 4944228 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8554148 kB' 'Mapped: 58612 kB' 'AnonPages: 147228 kB' 'Shmem: 4800292 kB' 'KernelStack: 6344 kB' 'PageTables: 3300 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87712 kB' 'Slab: 338816 kB' 'SReclaimable: 87712 kB' 'SUnreclaim: 251104 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.120 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.120 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # continue 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # IFS=': ' 00:04:53.121 14:59:53 -- setup/common.sh@31 -- # read -r var val _ 00:04:53.121 14:59:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:53.121 14:59:53 -- setup/common.sh@33 -- # echo 0 00:04:53.121 14:59:53 -- setup/common.sh@33 -- # return 0 00:04:53.380 14:59:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:53.380 14:59:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:53.380 14:59:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:53.380 14:59:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:53.380 14:59:53 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:53.380 node0=1024 expecting 1024 00:04:53.380 14:59:53 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:53.380 14:59:53 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:53.380 14:59:53 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:53.380 14:59:53 -- setup/hugepages.sh@202 -- # setup output 00:04:53.380 14:59:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:53.380 14:59:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:54.317 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:54.317 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:54.317 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:54.317 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:54.317 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:54.317 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:54.317 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:54.317 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:54.317 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:54.317 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:54.317 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:54.317 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:54.317 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:54.317 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:54.317 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:54.317 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:54.317 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:54.579 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:54.579 14:59:54 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:54.579 14:59:54 -- setup/hugepages.sh@89 -- # local node 00:04:54.579 14:59:54 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:54.579 14:59:54 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:54.579 14:59:54 -- setup/hugepages.sh@92 -- # local surp 00:04:54.579 14:59:54 -- setup/hugepages.sh@93 -- # local resv 00:04:54.579 14:59:54 -- setup/hugepages.sh@94 -- # local anon 00:04:54.579 14:59:54 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:54.579 14:59:54 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:54.579 14:59:54 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:54.579 14:59:54 -- setup/common.sh@18 -- # local node= 00:04:54.579 14:59:54 -- setup/common.sh@19 -- # local var val 00:04:54.579 14:59:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.579 14:59:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.579 14:59:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.579 14:59:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.579 14:59:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.579 14:59:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 14:59:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44216096 kB' 'MemAvailable: 47962620 kB' 'Buffers: 2708 kB' 'Cached: 11783380 kB' 'SwapCached: 0 kB' 'Active: 8521252 kB' 'Inactive: 3752508 kB' 'Active(anon): 8129212 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491016 kB' 'Mapped: 181464 kB' 'Shmem: 7641540 kB' 'KReclaimable: 191108 kB' 'Slab: 646564 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455456 kB' 'KernelStack: 12864 kB' 'PageTables: 7536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9244740 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198504 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.579 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.579 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.580 14:59:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:54.580 14:59:54 -- setup/common.sh@33 -- # echo 0 00:04:54.580 14:59:54 -- setup/common.sh@33 -- # return 0 00:04:54.580 14:59:54 -- setup/hugepages.sh@97 -- # anon=0 00:04:54.580 14:59:54 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:54.580 14:59:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:54.580 14:59:54 -- setup/common.sh@18 -- # local node= 00:04:54.580 14:59:54 -- setup/common.sh@19 -- # local var val 00:04:54.580 14:59:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.580 14:59:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.580 14:59:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.580 14:59:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.580 14:59:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.580 14:59:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.580 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44221452 kB' 'MemAvailable: 47967976 kB' 'Buffers: 2708 kB' 'Cached: 11783380 kB' 'SwapCached: 0 kB' 'Active: 8521348 kB' 'Inactive: 3752508 kB' 'Active(anon): 8129308 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 491080 kB' 'Mapped: 181188 kB' 'Shmem: 7641540 kB' 'KReclaimable: 191108 kB' 'Slab: 646700 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455592 kB' 'KernelStack: 12832 kB' 'PageTables: 7428 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9244752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.581 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.581 14:59:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.582 14:59:54 -- setup/common.sh@33 -- # echo 0 00:04:54.582 14:59:54 -- setup/common.sh@33 -- # return 0 00:04:54.582 14:59:54 -- setup/hugepages.sh@99 -- # surp=0 00:04:54.582 14:59:54 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:54.582 14:59:54 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:54.582 14:59:54 -- setup/common.sh@18 -- # local node= 00:04:54.582 14:59:54 -- setup/common.sh@19 -- # local var val 00:04:54.582 14:59:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.582 14:59:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.582 14:59:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.582 14:59:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.582 14:59:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.582 14:59:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44221016 kB' 'MemAvailable: 47967540 kB' 'Buffers: 2708 kB' 'Cached: 11783392 kB' 'SwapCached: 0 kB' 'Active: 8520336 kB' 'Inactive: 3752508 kB' 'Active(anon): 8128296 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489992 kB' 'Mapped: 181188 kB' 'Shmem: 7641552 kB' 'KReclaimable: 191108 kB' 'Slab: 646700 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455592 kB' 'KernelStack: 12800 kB' 'PageTables: 7304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9244768 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.582 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.582 14:59:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.583 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:54.583 14:59:54 -- setup/common.sh@33 -- # echo 0 00:04:54.583 14:59:54 -- setup/common.sh@33 -- # return 0 00:04:54.583 14:59:54 -- setup/hugepages.sh@100 -- # resv=0 00:04:54.583 14:59:54 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:54.583 nr_hugepages=1024 00:04:54.583 14:59:54 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:54.583 resv_hugepages=0 00:04:54.583 14:59:54 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:54.583 surplus_hugepages=0 00:04:54.583 14:59:54 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:54.583 anon_hugepages=0 00:04:54.583 14:59:54 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:54.583 14:59:54 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:54.583 14:59:54 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:54.583 14:59:54 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:54.583 14:59:54 -- setup/common.sh@18 -- # local node= 00:04:54.583 14:59:54 -- setup/common.sh@19 -- # local var val 00:04:54.583 14:59:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.583 14:59:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.583 14:59:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:54.583 14:59:54 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:54.583 14:59:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.583 14:59:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.583 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44221772 kB' 'MemAvailable: 47968296 kB' 'Buffers: 2708 kB' 'Cached: 11783408 kB' 'SwapCached: 0 kB' 'Active: 8519852 kB' 'Inactive: 3752508 kB' 'Active(anon): 8127812 kB' 'Inactive(anon): 0 kB' 'Active(file): 392040 kB' 'Inactive(file): 3752508 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489456 kB' 'Mapped: 181112 kB' 'Shmem: 7641568 kB' 'KReclaimable: 191108 kB' 'Slab: 646700 kB' 'SReclaimable: 191108 kB' 'SUnreclaim: 455592 kB' 'KernelStack: 12768 kB' 'PageTables: 7204 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 9244784 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198472 kB' 'VmallocChunk: 0 kB' 'Percpu: 33600 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1326684 kB' 'DirectMap2M: 10127360 kB' 'DirectMap1G: 58720256 kB' 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.584 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.584 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:54.585 14:59:54 -- setup/common.sh@33 -- # echo 1024 00:04:54.585 14:59:54 -- setup/common.sh@33 -- # return 0 00:04:54.585 14:59:54 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:54.585 14:59:54 -- setup/hugepages.sh@112 -- # get_nodes 00:04:54.585 14:59:54 -- setup/hugepages.sh@27 -- # local node 00:04:54.585 14:59:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:54.585 14:59:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:54.585 14:59:54 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:54.585 14:59:54 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:54.585 14:59:54 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:54.585 14:59:54 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:54.585 14:59:54 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:54.585 14:59:54 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:54.585 14:59:54 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:54.585 14:59:54 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:54.585 14:59:54 -- setup/common.sh@18 -- # local node=0 00:04:54.585 14:59:54 -- setup/common.sh@19 -- # local var val 00:04:54.585 14:59:54 -- setup/common.sh@20 -- # local mem_f mem 00:04:54.585 14:59:54 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:54.585 14:59:54 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:54.585 14:59:54 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:54.585 14:59:54 -- setup/common.sh@28 -- # mapfile -t mem 00:04:54.585 14:59:54 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 20813664 kB' 'MemUsed: 12012192 kB' 'SwapCached: 0 kB' 'Active: 5136032 kB' 'Inactive: 3561576 kB' 'Active(anon): 4943752 kB' 'Inactive(anon): 0 kB' 'Active(file): 192280 kB' 'Inactive(file): 3561576 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8554220 kB' 'Mapped: 58604 kB' 'AnonPages: 146584 kB' 'Shmem: 4800364 kB' 'KernelStack: 6328 kB' 'PageTables: 3292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 87712 kB' 'Slab: 339092 kB' 'SReclaimable: 87712 kB' 'SUnreclaim: 251380 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.585 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.585 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.586 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.586 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.846 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.846 14:59:54 -- setup/common.sh@32 -- # continue 00:04:54.846 14:59:54 -- setup/common.sh@31 -- # IFS=': ' 00:04:54.846 14:59:54 -- setup/common.sh@31 -- # read -r var val _ 00:04:54.846 14:59:54 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:54.846 14:59:54 -- setup/common.sh@33 -- # echo 0 00:04:54.846 14:59:54 -- setup/common.sh@33 -- # return 0 00:04:54.846 14:59:54 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:54.846 14:59:54 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:54.846 14:59:54 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:54.846 14:59:54 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:54.846 14:59:54 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:54.846 node0=1024 expecting 1024 00:04:54.846 14:59:54 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:54.846 00:04:54.846 real 0m3.021s 00:04:54.846 user 0m1.205s 00:04:54.846 sys 0m1.752s 00:04:54.846 14:59:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.846 14:59:54 -- common/autotest_common.sh@10 -- # set +x 00:04:54.846 ************************************ 00:04:54.846 END TEST no_shrink_alloc 00:04:54.846 ************************************ 00:04:54.846 14:59:54 -- setup/hugepages.sh@217 -- # clear_hp 00:04:54.846 14:59:54 -- setup/hugepages.sh@37 -- # local node hp 00:04:54.846 14:59:54 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:54.846 14:59:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.846 14:59:54 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.846 14:59:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.846 14:59:54 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.846 14:59:54 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:54.846 14:59:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.846 14:59:54 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.846 14:59:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:54.846 14:59:54 -- setup/hugepages.sh@41 -- # echo 0 00:04:54.846 14:59:54 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:54.846 14:59:54 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:54.846 00:04:54.846 real 0m11.954s 00:04:54.846 user 0m4.641s 00:04:54.846 sys 0m6.286s 00:04:54.846 14:59:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.846 14:59:54 -- common/autotest_common.sh@10 -- # set +x 00:04:54.846 ************************************ 00:04:54.846 END TEST hugepages 00:04:54.846 ************************************ 00:04:54.846 14:59:54 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:54.846 14:59:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:54.846 14:59:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.846 14:59:54 -- common/autotest_common.sh@10 -- # set +x 00:04:54.846 ************************************ 00:04:54.846 START TEST driver 00:04:54.846 ************************************ 00:04:54.846 14:59:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:54.846 * Looking for test storage... 00:04:54.846 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:54.846 14:59:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:54.846 14:59:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:54.846 14:59:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:54.846 14:59:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:54.846 14:59:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:54.846 14:59:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:54.846 14:59:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:54.846 14:59:55 -- scripts/common.sh@335 -- # IFS=.-: 00:04:54.846 14:59:55 -- scripts/common.sh@335 -- # read -ra ver1 00:04:54.846 14:59:55 -- scripts/common.sh@336 -- # IFS=.-: 00:04:54.846 14:59:55 -- scripts/common.sh@336 -- # read -ra ver2 00:04:54.846 14:59:55 -- scripts/common.sh@337 -- # local 'op=<' 00:04:54.846 14:59:55 -- scripts/common.sh@339 -- # ver1_l=2 00:04:54.846 14:59:55 -- scripts/common.sh@340 -- # ver2_l=1 00:04:54.846 14:59:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:54.846 14:59:55 -- scripts/common.sh@343 -- # case "$op" in 00:04:54.846 14:59:55 -- scripts/common.sh@344 -- # : 1 00:04:54.846 14:59:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:54.846 14:59:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:54.846 14:59:55 -- scripts/common.sh@364 -- # decimal 1 00:04:54.846 14:59:55 -- scripts/common.sh@352 -- # local d=1 00:04:54.846 14:59:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:54.846 14:59:55 -- scripts/common.sh@354 -- # echo 1 00:04:54.846 14:59:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:54.846 14:59:55 -- scripts/common.sh@365 -- # decimal 2 00:04:54.846 14:59:55 -- scripts/common.sh@352 -- # local d=2 00:04:54.846 14:59:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:54.846 14:59:55 -- scripts/common.sh@354 -- # echo 2 00:04:54.846 14:59:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:54.846 14:59:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:54.846 14:59:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:54.846 14:59:55 -- scripts/common.sh@367 -- # return 0 00:04:54.846 14:59:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:54.846 14:59:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:54.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.846 --rc genhtml_branch_coverage=1 00:04:54.846 --rc genhtml_function_coverage=1 00:04:54.846 --rc genhtml_legend=1 00:04:54.846 --rc geninfo_all_blocks=1 00:04:54.846 --rc geninfo_unexecuted_blocks=1 00:04:54.846 00:04:54.846 ' 00:04:54.846 14:59:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:54.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.846 --rc genhtml_branch_coverage=1 00:04:54.846 --rc genhtml_function_coverage=1 00:04:54.846 --rc genhtml_legend=1 00:04:54.846 --rc geninfo_all_blocks=1 00:04:54.846 --rc geninfo_unexecuted_blocks=1 00:04:54.846 00:04:54.846 ' 00:04:54.846 14:59:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:54.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.846 --rc genhtml_branch_coverage=1 00:04:54.846 --rc genhtml_function_coverage=1 00:04:54.846 --rc genhtml_legend=1 00:04:54.846 --rc geninfo_all_blocks=1 00:04:54.846 --rc geninfo_unexecuted_blocks=1 00:04:54.846 00:04:54.846 ' 00:04:54.846 14:59:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:54.846 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:54.846 --rc genhtml_branch_coverage=1 00:04:54.846 --rc genhtml_function_coverage=1 00:04:54.846 --rc genhtml_legend=1 00:04:54.846 --rc geninfo_all_blocks=1 00:04:54.846 --rc geninfo_unexecuted_blocks=1 00:04:54.847 00:04:54.847 ' 00:04:54.847 14:59:55 -- setup/driver.sh@68 -- # setup reset 00:04:54.847 14:59:55 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:54.847 14:59:55 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:58.146 14:59:57 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:58.146 14:59:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.146 14:59:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.146 14:59:57 -- common/autotest_common.sh@10 -- # set +x 00:04:58.146 ************************************ 00:04:58.146 START TEST guess_driver 00:04:58.146 ************************************ 00:04:58.146 14:59:57 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:58.146 14:59:57 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:58.146 14:59:57 -- setup/driver.sh@47 -- # local fail=0 00:04:58.146 14:59:57 -- setup/driver.sh@49 -- # pick_driver 00:04:58.146 14:59:57 -- setup/driver.sh@36 -- # vfio 00:04:58.146 14:59:57 -- setup/driver.sh@21 -- # local iommu_grups 00:04:58.146 14:59:57 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:58.146 14:59:57 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:58.146 14:59:57 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:58.146 14:59:57 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:58.146 14:59:57 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:58.146 14:59:57 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:58.146 14:59:57 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:58.146 14:59:57 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:58.146 14:59:57 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:58.147 14:59:57 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:58.147 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:58.147 14:59:57 -- setup/driver.sh@30 -- # return 0 00:04:58.147 14:59:57 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:58.147 14:59:57 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:58.147 14:59:57 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:58.147 14:59:57 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:58.147 Looking for driver=vfio-pci 00:04:58.147 14:59:57 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.147 14:59:57 -- setup/driver.sh@45 -- # setup output config 00:04:58.147 14:59:57 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:58.147 14:59:57 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:58.715 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.715 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.715 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.715 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.715 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.715 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.975 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.975 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:58.975 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:58.976 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:58.976 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:59.917 14:59:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:59.917 14:59:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:59.917 14:59:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:59.917 15:00:00 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:59.917 15:00:00 -- setup/driver.sh@65 -- # setup reset 00:04:59.917 15:00:00 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:59.917 15:00:00 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:02.450 00:05:02.450 real 0m4.988s 00:05:02.450 user 0m1.093s 00:05:02.450 sys 0m2.024s 00:05:02.450 15:00:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.450 15:00:02 -- common/autotest_common.sh@10 -- # set +x 00:05:02.450 ************************************ 00:05:02.450 END TEST guess_driver 00:05:02.450 ************************************ 00:05:02.709 00:05:02.709 real 0m7.812s 00:05:02.709 user 0m1.793s 00:05:02.709 sys 0m3.183s 00:05:02.709 15:00:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:02.709 15:00:02 -- common/autotest_common.sh@10 -- # set +x 00:05:02.709 ************************************ 00:05:02.709 END TEST driver 00:05:02.709 ************************************ 00:05:02.709 15:00:02 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:02.709 15:00:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:02.709 15:00:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:02.709 15:00:02 -- common/autotest_common.sh@10 -- # set +x 00:05:02.709 ************************************ 00:05:02.709 START TEST devices 00:05:02.709 ************************************ 00:05:02.709 15:00:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:05:02.709 * Looking for test storage... 00:05:02.709 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:05:02.709 15:00:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:02.709 15:00:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:02.709 15:00:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:02.709 15:00:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:02.709 15:00:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:02.709 15:00:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:02.709 15:00:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:02.709 15:00:02 -- scripts/common.sh@335 -- # IFS=.-: 00:05:02.709 15:00:02 -- scripts/common.sh@335 -- # read -ra ver1 00:05:02.709 15:00:02 -- scripts/common.sh@336 -- # IFS=.-: 00:05:02.709 15:00:02 -- scripts/common.sh@336 -- # read -ra ver2 00:05:02.709 15:00:02 -- scripts/common.sh@337 -- # local 'op=<' 00:05:02.709 15:00:02 -- scripts/common.sh@339 -- # ver1_l=2 00:05:02.709 15:00:02 -- scripts/common.sh@340 -- # ver2_l=1 00:05:02.709 15:00:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:02.709 15:00:02 -- scripts/common.sh@343 -- # case "$op" in 00:05:02.709 15:00:02 -- scripts/common.sh@344 -- # : 1 00:05:02.709 15:00:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:02.709 15:00:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:02.709 15:00:02 -- scripts/common.sh@364 -- # decimal 1 00:05:02.709 15:00:02 -- scripts/common.sh@352 -- # local d=1 00:05:02.709 15:00:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:02.709 15:00:02 -- scripts/common.sh@354 -- # echo 1 00:05:02.709 15:00:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:02.709 15:00:02 -- scripts/common.sh@365 -- # decimal 2 00:05:02.709 15:00:02 -- scripts/common.sh@352 -- # local d=2 00:05:02.709 15:00:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:02.709 15:00:02 -- scripts/common.sh@354 -- # echo 2 00:05:02.709 15:00:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:02.710 15:00:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:02.710 15:00:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:02.710 15:00:02 -- scripts/common.sh@367 -- # return 0 00:05:02.710 15:00:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:02.710 15:00:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:02.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.710 --rc genhtml_branch_coverage=1 00:05:02.710 --rc genhtml_function_coverage=1 00:05:02.710 --rc genhtml_legend=1 00:05:02.710 --rc geninfo_all_blocks=1 00:05:02.710 --rc geninfo_unexecuted_blocks=1 00:05:02.710 00:05:02.710 ' 00:05:02.710 15:00:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:02.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.710 --rc genhtml_branch_coverage=1 00:05:02.710 --rc genhtml_function_coverage=1 00:05:02.710 --rc genhtml_legend=1 00:05:02.710 --rc geninfo_all_blocks=1 00:05:02.710 --rc geninfo_unexecuted_blocks=1 00:05:02.710 00:05:02.710 ' 00:05:02.710 15:00:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:02.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.710 --rc genhtml_branch_coverage=1 00:05:02.710 --rc genhtml_function_coverage=1 00:05:02.710 --rc genhtml_legend=1 00:05:02.710 --rc geninfo_all_blocks=1 00:05:02.710 --rc geninfo_unexecuted_blocks=1 00:05:02.710 00:05:02.710 ' 00:05:02.710 15:00:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:02.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:02.710 --rc genhtml_branch_coverage=1 00:05:02.710 --rc genhtml_function_coverage=1 00:05:02.710 --rc genhtml_legend=1 00:05:02.710 --rc geninfo_all_blocks=1 00:05:02.710 --rc geninfo_unexecuted_blocks=1 00:05:02.710 00:05:02.710 ' 00:05:02.710 15:00:02 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:05:02.710 15:00:02 -- setup/devices.sh@192 -- # setup reset 00:05:02.710 15:00:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:05:02.710 15:00:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:04.617 15:00:04 -- setup/devices.sh@194 -- # get_zoned_devs 00:05:04.617 15:00:04 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:05:04.617 15:00:04 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:05:04.617 15:00:04 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:05:04.617 15:00:04 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:05:04.617 15:00:04 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:05:04.617 15:00:04 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:05:04.617 15:00:04 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:05:04.617 15:00:04 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:05:04.617 15:00:04 -- setup/devices.sh@196 -- # blocks=() 00:05:04.617 15:00:04 -- setup/devices.sh@196 -- # declare -a blocks 00:05:04.617 15:00:04 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:05:04.617 15:00:04 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:05:04.617 15:00:04 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:05:04.617 15:00:04 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:05:04.617 15:00:04 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:05:04.617 15:00:04 -- setup/devices.sh@201 -- # ctrl=nvme0 00:05:04.617 15:00:04 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:05:04.617 15:00:04 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:05:04.617 15:00:04 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:05:04.617 15:00:04 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:05:04.617 15:00:04 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:05:04.617 No valid GPT data, bailing 00:05:04.617 15:00:04 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:05:04.617 15:00:04 -- scripts/common.sh@393 -- # pt= 00:05:04.617 15:00:04 -- scripts/common.sh@394 -- # return 1 00:05:04.617 15:00:04 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:05:04.617 15:00:04 -- setup/common.sh@76 -- # local dev=nvme0n1 00:05:04.617 15:00:04 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:05:04.617 15:00:04 -- setup/common.sh@80 -- # echo 1000204886016 00:05:04.617 15:00:04 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:05:04.617 15:00:04 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:05:04.617 15:00:04 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:05:04.617 15:00:04 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:05:04.617 15:00:04 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:05:04.617 15:00:04 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:05:04.617 15:00:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:04.617 15:00:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:04.617 15:00:04 -- common/autotest_common.sh@10 -- # set +x 00:05:04.617 ************************************ 00:05:04.617 START TEST nvme_mount 00:05:04.617 ************************************ 00:05:04.617 15:00:04 -- common/autotest_common.sh@1114 -- # nvme_mount 00:05:04.617 15:00:04 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:05:04.617 15:00:04 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:05:04.617 15:00:04 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:04.617 15:00:04 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:04.617 15:00:04 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:05:04.617 15:00:04 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:04.617 15:00:04 -- setup/common.sh@40 -- # local part_no=1 00:05:04.617 15:00:04 -- setup/common.sh@41 -- # local size=1073741824 00:05:04.617 15:00:04 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:04.617 15:00:04 -- setup/common.sh@44 -- # parts=() 00:05:04.617 15:00:04 -- setup/common.sh@44 -- # local parts 00:05:04.617 15:00:04 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:04.618 15:00:04 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:04.618 15:00:04 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:04.618 15:00:04 -- setup/common.sh@46 -- # (( part++ )) 00:05:04.618 15:00:04 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:04.618 15:00:04 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:04.618 15:00:04 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:04.618 15:00:04 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:05:05.556 Creating new GPT entries in memory. 00:05:05.556 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:05.556 other utilities. 00:05:05.556 15:00:05 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:05.556 15:00:05 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:05.556 15:00:05 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:05.556 15:00:05 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:05.556 15:00:05 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:06.495 Creating new GPT entries in memory. 00:05:06.495 The operation has completed successfully. 00:05:06.495 15:00:06 -- setup/common.sh@57 -- # (( part++ )) 00:05:06.495 15:00:06 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.495 15:00:06 -- setup/common.sh@62 -- # wait 574326 00:05:06.495 15:00:06 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.495 15:00:06 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:06.495 15:00:06 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.495 15:00:06 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:06.495 15:00:06 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:06.495 15:00:06 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.495 15:00:06 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:06.495 15:00:06 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:06.495 15:00:06 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:06.495 15:00:06 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:06.495 15:00:06 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:06.495 15:00:06 -- setup/devices.sh@53 -- # local found=0 00:05:06.495 15:00:06 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:06.495 15:00:06 -- setup/devices.sh@56 -- # : 00:05:06.495 15:00:06 -- setup/devices.sh@59 -- # local pci status 00:05:06.495 15:00:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:06.495 15:00:06 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:06.495 15:00:06 -- setup/devices.sh@47 -- # setup output config 00:05:06.495 15:00:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:06.495 15:00:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:07.874 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.874 15:00:07 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:07.874 15:00:07 -- setup/devices.sh@63 -- # found=1 00:05:07.874 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.874 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:07.875 15:00:07 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:07.875 15:00:07 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:07.875 15:00:07 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.875 15:00:07 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:07.875 15:00:07 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:07.875 15:00:07 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:07.875 15:00:07 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.875 15:00:07 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:07.875 15:00:07 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:07.875 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:07.875 15:00:07 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:07.875 15:00:07 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:08.134 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:08.134 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:08.134 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:08.134 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:08.134 15:00:08 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:08.134 15:00:08 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:08.134 15:00:08 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.134 15:00:08 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:08.134 15:00:08 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:08.134 15:00:08 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.134 15:00:08 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:08.134 15:00:08 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:08.134 15:00:08 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:08.134 15:00:08 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:08.134 15:00:08 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:08.134 15:00:08 -- setup/devices.sh@53 -- # local found=0 00:05:08.134 15:00:08 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:08.134 15:00:08 -- setup/devices.sh@56 -- # : 00:05:08.134 15:00:08 -- setup/devices.sh@59 -- # local pci status 00:05:08.134 15:00:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.134 15:00:08 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:08.134 15:00:08 -- setup/devices.sh@47 -- # setup output config 00:05:08.134 15:00:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:08.134 15:00:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:09.515 15:00:09 -- setup/devices.sh@63 -- # found=1 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:09.515 15:00:09 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:09.515 15:00:09 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.515 15:00:09 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:09.515 15:00:09 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:09.515 15:00:09 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:09.515 15:00:09 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:09.515 15:00:09 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.515 15:00:09 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:09.515 15:00:09 -- setup/devices.sh@50 -- # local mount_point= 00:05:09.515 15:00:09 -- setup/devices.sh@51 -- # local test_file= 00:05:09.515 15:00:09 -- setup/devices.sh@53 -- # local found=0 00:05:09.515 15:00:09 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:09.515 15:00:09 -- setup/devices.sh@59 -- # local pci status 00:05:09.515 15:00:09 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.515 15:00:09 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.515 15:00:09 -- setup/devices.sh@47 -- # setup output config 00:05:09.515 15:00:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.515 15:00:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.452 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.452 15:00:10 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:10.452 15:00:10 -- setup/devices.sh@63 -- # found=1 00:05:10.452 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.452 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.452 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.452 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.452 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.452 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.452 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.711 15:00:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:10.711 15:00:10 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:10.711 15:00:10 -- setup/devices.sh@68 -- # return 0 00:05:10.711 15:00:10 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:10.711 15:00:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:10.711 15:00:10 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:10.711 15:00:10 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:10.711 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:10.711 00:05:10.711 real 0m6.428s 00:05:10.711 user 0m1.481s 00:05:10.711 sys 0m2.531s 00:05:10.711 15:00:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.711 15:00:10 -- common/autotest_common.sh@10 -- # set +x 00:05:10.711 ************************************ 00:05:10.711 END TEST nvme_mount 00:05:10.711 ************************************ 00:05:10.970 15:00:10 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:10.970 15:00:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.970 15:00:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.970 15:00:10 -- common/autotest_common.sh@10 -- # set +x 00:05:10.970 ************************************ 00:05:10.970 START TEST dm_mount 00:05:10.970 ************************************ 00:05:10.970 15:00:10 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:10.970 15:00:10 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:10.970 15:00:10 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:10.970 15:00:10 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:10.970 15:00:10 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:10.970 15:00:10 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:10.970 15:00:10 -- setup/common.sh@40 -- # local part_no=2 00:05:10.970 15:00:10 -- setup/common.sh@41 -- # local size=1073741824 00:05:10.970 15:00:10 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:10.970 15:00:10 -- setup/common.sh@44 -- # parts=() 00:05:10.970 15:00:10 -- setup/common.sh@44 -- # local parts 00:05:10.971 15:00:10 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:10.971 15:00:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:10.971 15:00:10 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:10.971 15:00:10 -- setup/common.sh@46 -- # (( part++ )) 00:05:10.971 15:00:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:10.971 15:00:10 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:10.971 15:00:10 -- setup/common.sh@46 -- # (( part++ )) 00:05:10.971 15:00:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:10.971 15:00:10 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:10.971 15:00:10 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:10.971 15:00:10 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:11.911 Creating new GPT entries in memory. 00:05:11.911 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:11.911 other utilities. 00:05:11.911 15:00:11 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:11.911 15:00:11 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:11.911 15:00:11 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:11.911 15:00:11 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:11.911 15:00:11 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:12.862 Creating new GPT entries in memory. 00:05:12.862 The operation has completed successfully. 00:05:12.862 15:00:12 -- setup/common.sh@57 -- # (( part++ )) 00:05:12.862 15:00:12 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:12.862 15:00:12 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:12.862 15:00:12 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:12.862 15:00:12 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:13.800 The operation has completed successfully. 00:05:13.800 15:00:14 -- setup/common.sh@57 -- # (( part++ )) 00:05:13.800 15:00:14 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:13.800 15:00:14 -- setup/common.sh@62 -- # wait 577295 00:05:14.060 15:00:14 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:14.060 15:00:14 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:14.060 15:00:14 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:14.060 15:00:14 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:14.060 15:00:14 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:14.060 15:00:14 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:14.060 15:00:14 -- setup/devices.sh@161 -- # break 00:05:14.060 15:00:14 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:14.060 15:00:14 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:14.060 15:00:14 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:14.060 15:00:14 -- setup/devices.sh@166 -- # dm=dm-0 00:05:14.060 15:00:14 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:14.060 15:00:14 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:14.060 15:00:14 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:14.060 15:00:14 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:14.060 15:00:14 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:14.060 15:00:14 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:14.060 15:00:14 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:14.060 15:00:14 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:14.060 15:00:14 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:14.060 15:00:14 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:14.060 15:00:14 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:14.060 15:00:14 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:14.060 15:00:14 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:14.060 15:00:14 -- setup/devices.sh@53 -- # local found=0 00:05:14.060 15:00:14 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:14.060 15:00:14 -- setup/devices.sh@56 -- # : 00:05:14.060 15:00:14 -- setup/devices.sh@59 -- # local pci status 00:05:14.060 15:00:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:14.060 15:00:14 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:14.060 15:00:14 -- setup/devices.sh@47 -- # setup output config 00:05:14.060 15:00:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:14.060 15:00:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:15.519 15:00:15 -- setup/devices.sh@63 -- # found=1 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:15.519 15:00:15 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:15.519 15:00:15 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.519 15:00:15 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:15.519 15:00:15 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:15.519 15:00:15 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:15.519 15:00:15 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:15.519 15:00:15 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:15.519 15:00:15 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:15.519 15:00:15 -- setup/devices.sh@50 -- # local mount_point= 00:05:15.519 15:00:15 -- setup/devices.sh@51 -- # local test_file= 00:05:15.519 15:00:15 -- setup/devices.sh@53 -- # local found=0 00:05:15.519 15:00:15 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:15.519 15:00:15 -- setup/devices.sh@59 -- # local pci status 00:05:15.519 15:00:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:15.519 15:00:15 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:15.519 15:00:15 -- setup/devices.sh@47 -- # setup output config 00:05:15.519 15:00:15 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:15.519 15:00:15 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:16.508 15:00:16 -- setup/devices.sh@63 -- # found=1 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.508 15:00:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:16.508 15:00:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:16.768 15:00:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:16.768 15:00:16 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:16.768 15:00:16 -- setup/devices.sh@68 -- # return 0 00:05:16.768 15:00:16 -- setup/devices.sh@187 -- # cleanup_dm 00:05:16.768 15:00:16 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:16.768 15:00:16 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:16.768 15:00:16 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:16.768 15:00:16 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:16.768 15:00:16 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:16.768 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:16.768 15:00:16 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:16.768 15:00:16 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:16.768 00:05:16.768 real 0m6.045s 00:05:16.768 user 0m1.071s 00:05:16.768 sys 0m1.833s 00:05:16.768 15:00:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:16.768 15:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:16.768 ************************************ 00:05:16.768 END TEST dm_mount 00:05:16.768 ************************************ 00:05:17.026 15:00:17 -- setup/devices.sh@1 -- # cleanup 00:05:17.026 15:00:17 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:17.026 15:00:17 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:17.026 15:00:17 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.026 15:00:17 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:17.026 15:00:17 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:17.026 15:00:17 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:17.285 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:17.285 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:17.285 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:17.285 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:17.285 15:00:17 -- setup/devices.sh@12 -- # cleanup_dm 00:05:17.285 15:00:17 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:17.285 15:00:17 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:17.285 15:00:17 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:17.285 15:00:17 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:17.285 15:00:17 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:17.285 15:00:17 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:17.285 00:05:17.285 real 0m14.592s 00:05:17.285 user 0m3.306s 00:05:17.285 sys 0m5.507s 00:05:17.285 15:00:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.285 15:00:17 -- common/autotest_common.sh@10 -- # set +x 00:05:17.285 ************************************ 00:05:17.285 END TEST devices 00:05:17.285 ************************************ 00:05:17.285 00:05:17.285 real 0m45.824s 00:05:17.285 user 0m13.323s 00:05:17.285 sys 0m20.948s 00:05:17.285 15:00:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:17.285 15:00:17 -- common/autotest_common.sh@10 -- # set +x 00:05:17.285 ************************************ 00:05:17.285 END TEST setup.sh 00:05:17.285 ************************************ 00:05:17.285 15:00:17 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:18.663 Hugepages 00:05:18.663 node hugesize free / total 00:05:18.663 node0 1048576kB 0 / 0 00:05:18.663 node0 2048kB 2048 / 2048 00:05:18.663 node1 1048576kB 0 / 0 00:05:18.663 node1 2048kB 0 / 0 00:05:18.663 00:05:18.663 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:18.663 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:18.663 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:18.663 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:18.663 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:18.663 15:00:18 -- spdk/autotest.sh@128 -- # uname -s 00:05:18.663 15:00:18 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:18.663 15:00:18 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:18.663 15:00:18 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:20.043 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:20.043 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:20.043 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.979 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:20.979 15:00:21 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:21.918 15:00:22 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:21.918 15:00:22 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:21.918 15:00:22 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:21.918 15:00:22 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:21.918 15:00:22 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:21.918 15:00:22 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:21.918 15:00:22 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:21.918 15:00:22 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:21.918 15:00:22 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:22.176 15:00:22 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:22.176 15:00:22 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:22.176 15:00:22 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:23.111 Waiting for block devices as requested 00:05:23.371 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:23.371 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:23.629 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:23.629 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:23.629 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:23.629 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:23.888 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:23.888 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:23.888 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:24.146 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:24.146 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:24.146 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:24.146 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:24.403 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:24.403 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:24.403 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:24.403 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:24.661 15:00:24 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:24.661 15:00:24 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:24.661 15:00:24 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:24.661 15:00:24 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:24.661 15:00:24 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:24.661 15:00:24 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:24.662 15:00:24 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:24.662 15:00:24 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:24.662 15:00:24 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:24.662 15:00:24 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:24.662 15:00:24 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:24.662 15:00:24 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:24.662 15:00:24 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:24.662 15:00:24 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:24.662 15:00:24 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:24.662 15:00:24 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:24.662 15:00:24 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:24.662 15:00:24 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:24.662 15:00:24 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:24.662 15:00:24 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:24.662 15:00:24 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:24.662 15:00:24 -- common/autotest_common.sh@1552 -- # continue 00:05:24.662 15:00:24 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:24.662 15:00:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:24.662 15:00:24 -- common/autotest_common.sh@10 -- # set +x 00:05:24.662 15:00:24 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:24.662 15:00:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:24.662 15:00:24 -- common/autotest_common.sh@10 -- # set +x 00:05:24.662 15:00:24 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:26.038 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:26.038 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:26.038 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:26.972 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:27.231 15:00:27 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:27.231 15:00:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:27.231 15:00:27 -- common/autotest_common.sh@10 -- # set +x 00:05:27.231 15:00:27 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:27.231 15:00:27 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:27.231 15:00:27 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:27.231 15:00:27 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:27.231 15:00:27 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:27.231 15:00:27 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:27.231 15:00:27 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:27.231 15:00:27 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:27.231 15:00:27 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:27.231 15:00:27 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:27.231 15:00:27 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:27.231 15:00:27 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:27.231 15:00:27 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:27.231 15:00:27 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:27.231 15:00:27 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:27.231 15:00:27 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:27.231 15:00:27 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:27.231 15:00:27 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:27.231 15:00:27 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:27.231 15:00:27 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:27.231 15:00:27 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=582741 00:05:27.231 15:00:27 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:27.231 15:00:27 -- common/autotest_common.sh@1593 -- # waitforlisten 582741 00:05:27.231 15:00:27 -- common/autotest_common.sh@829 -- # '[' -z 582741 ']' 00:05:27.231 15:00:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:27.231 15:00:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:27.231 15:00:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:27.231 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:27.231 15:00:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:27.231 15:00:27 -- common/autotest_common.sh@10 -- # set +x 00:05:27.231 [2024-11-28 15:00:27.380997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:27.231 [2024-11-28 15:00:27.381090] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid582741 ] 00:05:27.231 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.231 [2024-11-28 15:00:27.437510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:27.489 [2024-11-28 15:00:27.517047] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:27.489 [2024-11-28 15:00:27.517246] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:28.456 15:00:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.456 15:00:28 -- common/autotest_common.sh@862 -- # return 0 00:05:28.456 15:00:28 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:28.456 15:00:28 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:28.456 15:00:28 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:31.740 nvme0n1 00:05:31.740 15:00:31 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:31.740 [2024-11-28 15:00:31.623674] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:31.740 [2024-11-28 15:00:31.623719] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:31.740 request: 00:05:31.740 { 00:05:31.740 "nvme_ctrlr_name": "nvme0", 00:05:31.740 "password": "test", 00:05:31.740 "method": "bdev_nvme_opal_revert", 00:05:31.740 "req_id": 1 00:05:31.740 } 00:05:31.740 Got JSON-RPC error response 00:05:31.740 response: 00:05:31.740 { 00:05:31.740 "code": -32603, 00:05:31.740 "message": "Internal error" 00:05:31.740 } 00:05:31.740 15:00:31 -- common/autotest_common.sh@1599 -- # true 00:05:31.740 15:00:31 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:31.740 15:00:31 -- common/autotest_common.sh@1603 -- # killprocess 582741 00:05:31.740 15:00:31 -- common/autotest_common.sh@936 -- # '[' -z 582741 ']' 00:05:31.740 15:00:31 -- common/autotest_common.sh@940 -- # kill -0 582741 00:05:31.740 15:00:31 -- common/autotest_common.sh@941 -- # uname 00:05:31.740 15:00:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:31.740 15:00:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 582741 00:05:31.740 15:00:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:31.740 15:00:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:31.740 15:00:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 582741' 00:05:31.740 killing process with pid 582741 00:05:31.740 15:00:31 -- common/autotest_common.sh@955 -- # kill 582741 00:05:31.740 15:00:31 -- common/autotest_common.sh@960 -- # wait 582741 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.740 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.741 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:31.742 EAL: Unexpected size 0 of DMA remapping cleared instead of 2097152 00:05:33.642 15:00:33 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:33.642 15:00:33 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:33.642 15:00:33 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:33.642 15:00:33 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:33.642 15:00:33 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:33.642 15:00:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:33.642 15:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:33.642 15:00:33 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:33.642 15:00:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.642 15:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:33.642 ************************************ 00:05:33.642 START TEST env 00:05:33.642 ************************************ 00:05:33.642 15:00:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:33.642 * Looking for test storage... 00:05:33.642 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:33.642 15:00:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.642 15:00:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.642 15:00:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.642 15:00:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.642 15:00:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.642 15:00:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.642 15:00:33 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.642 15:00:33 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.642 15:00:33 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.642 15:00:33 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.642 15:00:33 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.642 15:00:33 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.642 15:00:33 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.642 15:00:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.642 15:00:33 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.642 15:00:33 -- scripts/common.sh@344 -- # : 1 00:05:33.642 15:00:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.642 15:00:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.642 15:00:33 -- scripts/common.sh@364 -- # decimal 1 00:05:33.642 15:00:33 -- scripts/common.sh@352 -- # local d=1 00:05:33.642 15:00:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.642 15:00:33 -- scripts/common.sh@354 -- # echo 1 00:05:33.642 15:00:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.642 15:00:33 -- scripts/common.sh@365 -- # decimal 2 00:05:33.642 15:00:33 -- scripts/common.sh@352 -- # local d=2 00:05:33.642 15:00:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.642 15:00:33 -- scripts/common.sh@354 -- # echo 2 00:05:33.642 15:00:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.642 15:00:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.642 15:00:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.642 15:00:33 -- scripts/common.sh@367 -- # return 0 00:05:33.642 15:00:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.642 --rc genhtml_branch_coverage=1 00:05:33.642 --rc genhtml_function_coverage=1 00:05:33.642 --rc genhtml_legend=1 00:05:33.642 --rc geninfo_all_blocks=1 00:05:33.642 --rc geninfo_unexecuted_blocks=1 00:05:33.642 00:05:33.642 ' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.642 --rc genhtml_branch_coverage=1 00:05:33.642 --rc genhtml_function_coverage=1 00:05:33.642 --rc genhtml_legend=1 00:05:33.642 --rc geninfo_all_blocks=1 00:05:33.642 --rc geninfo_unexecuted_blocks=1 00:05:33.642 00:05:33.642 ' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.642 --rc genhtml_branch_coverage=1 00:05:33.642 --rc genhtml_function_coverage=1 00:05:33.642 --rc genhtml_legend=1 00:05:33.642 --rc geninfo_all_blocks=1 00:05:33.642 --rc geninfo_unexecuted_blocks=1 00:05:33.642 00:05:33.642 ' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.642 --rc genhtml_branch_coverage=1 00:05:33.642 --rc genhtml_function_coverage=1 00:05:33.642 --rc genhtml_legend=1 00:05:33.642 --rc geninfo_all_blocks=1 00:05:33.642 --rc geninfo_unexecuted_blocks=1 00:05:33.642 00:05:33.642 ' 00:05:33.642 15:00:33 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:33.642 15:00:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.642 15:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:33.642 ************************************ 00:05:33.642 START TEST env_memory 00:05:33.642 ************************************ 00:05:33.642 15:00:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:33.642 00:05:33.642 00:05:33.642 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.642 http://cunit.sourceforge.net/ 00:05:33.642 00:05:33.642 00:05:33.642 Suite: memory 00:05:33.642 Test: alloc and free memory map ...[2024-11-28 15:00:33.643708] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:33.642 passed 00:05:33.642 Test: mem map translation ...[2024-11-28 15:00:33.664454] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:33.642 [2024-11-28 15:00:33.664474] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:33.642 [2024-11-28 15:00:33.664528] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:33.642 [2024-11-28 15:00:33.664540] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:33.642 passed 00:05:33.642 Test: mem map registration ...[2024-11-28 15:00:33.707113] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:33.642 [2024-11-28 15:00:33.707153] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:33.642 passed 00:05:33.642 Test: mem map adjacent registrations ...passed 00:05:33.642 00:05:33.642 Run Summary: Type Total Ran Passed Failed Inactive 00:05:33.642 suites 1 1 n/a 0 0 00:05:33.642 tests 4 4 4 0 0 00:05:33.642 asserts 152 152 152 0 n/a 00:05:33.642 00:05:33.642 Elapsed time = 0.142 seconds 00:05:33.642 00:05:33.642 real 0m0.149s 00:05:33.642 user 0m0.141s 00:05:33.642 sys 0m0.007s 00:05:33.642 15:00:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.642 15:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:33.642 ************************************ 00:05:33.642 END TEST env_memory 00:05:33.642 ************************************ 00:05:33.642 15:00:33 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:33.642 15:00:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.642 15:00:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.642 15:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:33.642 ************************************ 00:05:33.642 START TEST env_vtophys 00:05:33.642 ************************************ 00:05:33.642 15:00:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:33.642 EAL: lib.eal log level changed from notice to debug 00:05:33.642 EAL: Detected lcore 0 as core 0 on socket 0 00:05:33.642 EAL: Detected lcore 1 as core 1 on socket 0 00:05:33.642 EAL: Detected lcore 2 as core 2 on socket 0 00:05:33.642 EAL: Detected lcore 3 as core 3 on socket 0 00:05:33.642 EAL: Detected lcore 4 as core 4 on socket 0 00:05:33.642 EAL: Detected lcore 5 as core 5 on socket 0 00:05:33.643 EAL: Detected lcore 6 as core 8 on socket 0 00:05:33.643 EAL: Detected lcore 7 as core 9 on socket 0 00:05:33.643 EAL: Detected lcore 8 as core 10 on socket 0 00:05:33.643 EAL: Detected lcore 9 as core 11 on socket 0 00:05:33.643 EAL: Detected lcore 10 as core 12 on socket 0 00:05:33.643 EAL: Detected lcore 11 as core 13 on socket 0 00:05:33.643 EAL: Detected lcore 12 as core 0 on socket 1 00:05:33.643 EAL: Detected lcore 13 as core 1 on socket 1 00:05:33.643 EAL: Detected lcore 14 as core 2 on socket 1 00:05:33.643 EAL: Detected lcore 15 as core 3 on socket 1 00:05:33.643 EAL: Detected lcore 16 as core 4 on socket 1 00:05:33.643 EAL: Detected lcore 17 as core 5 on socket 1 00:05:33.643 EAL: Detected lcore 18 as core 8 on socket 1 00:05:33.643 EAL: Detected lcore 19 as core 9 on socket 1 00:05:33.643 EAL: Detected lcore 20 as core 10 on socket 1 00:05:33.643 EAL: Detected lcore 21 as core 11 on socket 1 00:05:33.643 EAL: Detected lcore 22 as core 12 on socket 1 00:05:33.643 EAL: Detected lcore 23 as core 13 on socket 1 00:05:33.643 EAL: Detected lcore 24 as core 0 on socket 0 00:05:33.643 EAL: Detected lcore 25 as core 1 on socket 0 00:05:33.643 EAL: Detected lcore 26 as core 2 on socket 0 00:05:33.643 EAL: Detected lcore 27 as core 3 on socket 0 00:05:33.643 EAL: Detected lcore 28 as core 4 on socket 0 00:05:33.643 EAL: Detected lcore 29 as core 5 on socket 0 00:05:33.643 EAL: Detected lcore 30 as core 8 on socket 0 00:05:33.643 EAL: Detected lcore 31 as core 9 on socket 0 00:05:33.643 EAL: Detected lcore 32 as core 10 on socket 0 00:05:33.643 EAL: Detected lcore 33 as core 11 on socket 0 00:05:33.643 EAL: Detected lcore 34 as core 12 on socket 0 00:05:33.643 EAL: Detected lcore 35 as core 13 on socket 0 00:05:33.643 EAL: Detected lcore 36 as core 0 on socket 1 00:05:33.643 EAL: Detected lcore 37 as core 1 on socket 1 00:05:33.643 EAL: Detected lcore 38 as core 2 on socket 1 00:05:33.643 EAL: Detected lcore 39 as core 3 on socket 1 00:05:33.643 EAL: Detected lcore 40 as core 4 on socket 1 00:05:33.643 EAL: Detected lcore 41 as core 5 on socket 1 00:05:33.643 EAL: Detected lcore 42 as core 8 on socket 1 00:05:33.643 EAL: Detected lcore 43 as core 9 on socket 1 00:05:33.643 EAL: Detected lcore 44 as core 10 on socket 1 00:05:33.643 EAL: Detected lcore 45 as core 11 on socket 1 00:05:33.643 EAL: Detected lcore 46 as core 12 on socket 1 00:05:33.643 EAL: Detected lcore 47 as core 13 on socket 1 00:05:33.643 EAL: Maximum logical cores by configuration: 128 00:05:33.643 EAL: Detected CPU lcores: 48 00:05:33.643 EAL: Detected NUMA nodes: 2 00:05:33.643 EAL: Checking presence of .so 'librte_eal.so.23.0' 00:05:33.643 EAL: Detected shared linkage of DPDK 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so.23.0 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so.23.0 00:05:33.643 EAL: Registered [vdev] bus. 00:05:33.643 EAL: bus.vdev log level changed from disabled to notice 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so.23.0 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so.23.0 00:05:33.643 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:33.643 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_pci.so 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_bus_vdev.so 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_mempool_ring.so 00:05:33.643 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-23.0/librte_net_i40e.so 00:05:33.643 EAL: No shared files mode enabled, IPC will be disabled 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: Bus pci wants IOVA as 'DC' 00:05:33.643 EAL: Bus vdev wants IOVA as 'DC' 00:05:33.643 EAL: Buses did not request a specific IOVA mode. 00:05:33.643 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:33.643 EAL: Selected IOVA mode 'VA' 00:05:33.643 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.643 EAL: Probing VFIO support... 00:05:33.643 EAL: IOMMU type 1 (Type 1) is supported 00:05:33.643 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:33.643 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:33.643 EAL: VFIO support initialized 00:05:33.643 EAL: Ask a virtual area of 0x2e000 bytes 00:05:33.643 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:33.643 EAL: Setting up physically contiguous memory... 00:05:33.643 EAL: Setting maximum number of open files to 524288 00:05:33.643 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:33.643 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:33.643 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:33.643 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:33.643 EAL: Ask a virtual area of 0x61000 bytes 00:05:33.643 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:33.643 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:33.643 EAL: Ask a virtual area of 0x400000000 bytes 00:05:33.643 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:33.643 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:33.643 EAL: Hugepages will be freed exactly as allocated. 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: TSC frequency is ~2700000 KHz 00:05:33.643 EAL: Main lcore 0 is ready (tid=7feec2505a00;cpuset=[0]) 00:05:33.643 EAL: Trying to obtain current memory policy. 00:05:33.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.643 EAL: Restoring previous memory policy: 0 00:05:33.643 EAL: request: mp_malloc_sync 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: Heap on socket 0 was expanded by 2MB 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:33.643 EAL: Mem event callback 'spdk:(nil)' registered 00:05:33.643 00:05:33.643 00:05:33.643 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.643 http://cunit.sourceforge.net/ 00:05:33.643 00:05:33.643 00:05:33.643 Suite: components_suite 00:05:33.643 Test: vtophys_malloc_test ...passed 00:05:33.643 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:33.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.643 EAL: Restoring previous memory policy: 4 00:05:33.643 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.643 EAL: request: mp_malloc_sync 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: Heap on socket 0 was expanded by 4MB 00:05:33.643 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.643 EAL: request: mp_malloc_sync 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: Heap on socket 0 was shrunk by 4MB 00:05:33.643 EAL: Trying to obtain current memory policy. 00:05:33.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.643 EAL: Restoring previous memory policy: 4 00:05:33.643 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.643 EAL: request: mp_malloc_sync 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: Heap on socket 0 was expanded by 6MB 00:05:33.643 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.643 EAL: request: mp_malloc_sync 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.643 EAL: Heap on socket 0 was shrunk by 6MB 00:05:33.643 EAL: Trying to obtain current memory policy. 00:05:33.643 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.643 EAL: Restoring previous memory policy: 4 00:05:33.643 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.643 EAL: request: mp_malloc_sync 00:05:33.643 EAL: No shared files mode enabled, IPC is disabled 00:05:33.644 EAL: Heap on socket 0 was expanded by 10MB 00:05:33.644 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.644 EAL: request: mp_malloc_sync 00:05:33.644 EAL: No shared files mode enabled, IPC is disabled 00:05:33.644 EAL: Heap on socket 0 was shrunk by 10MB 00:05:33.644 EAL: Trying to obtain current memory policy. 00:05:33.644 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.644 EAL: Restoring previous memory policy: 4 00:05:33.644 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.644 EAL: request: mp_malloc_sync 00:05:33.644 EAL: No shared files mode enabled, IPC is disabled 00:05:33.644 EAL: Heap on socket 0 was expanded by 18MB 00:05:33.644 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.644 EAL: request: mp_malloc_sync 00:05:33.644 EAL: No shared files mode enabled, IPC is disabled 00:05:33.644 EAL: Heap on socket 0 was shrunk by 18MB 00:05:33.644 EAL: Trying to obtain current memory policy. 00:05:33.644 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.902 EAL: Restoring previous memory policy: 4 00:05:33.902 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.902 EAL: request: mp_malloc_sync 00:05:33.902 EAL: No shared files mode enabled, IPC is disabled 00:05:33.902 EAL: Heap on socket 0 was expanded by 34MB 00:05:33.902 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.902 EAL: request: mp_malloc_sync 00:05:33.902 EAL: No shared files mode enabled, IPC is disabled 00:05:33.902 EAL: Heap on socket 0 was shrunk by 34MB 00:05:33.902 EAL: Trying to obtain current memory policy. 00:05:33.902 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.902 EAL: Restoring previous memory policy: 4 00:05:33.902 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.902 EAL: request: mp_malloc_sync 00:05:33.903 EAL: No shared files mode enabled, IPC is disabled 00:05:33.903 EAL: Heap on socket 0 was expanded by 66MB 00:05:33.903 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.903 EAL: request: mp_malloc_sync 00:05:33.903 EAL: No shared files mode enabled, IPC is disabled 00:05:33.903 EAL: Heap on socket 0 was shrunk by 66MB 00:05:33.903 EAL: Trying to obtain current memory policy. 00:05:33.903 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.903 EAL: Restoring previous memory policy: 4 00:05:33.903 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.903 EAL: request: mp_malloc_sync 00:05:33.903 EAL: No shared files mode enabled, IPC is disabled 00:05:33.903 EAL: Heap on socket 0 was expanded by 130MB 00:05:33.903 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.903 EAL: request: mp_malloc_sync 00:05:33.903 EAL: No shared files mode enabled, IPC is disabled 00:05:33.903 EAL: Heap on socket 0 was shrunk by 130MB 00:05:33.903 EAL: Trying to obtain current memory policy. 00:05:33.903 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:33.903 EAL: Restoring previous memory policy: 4 00:05:33.903 EAL: Calling mem event callback 'spdk:(nil)' 00:05:33.903 EAL: request: mp_malloc_sync 00:05:33.903 EAL: No shared files mode enabled, IPC is disabled 00:05:33.903 EAL: Heap on socket 0 was expanded by 258MB 00:05:33.903 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.161 EAL: request: mp_malloc_sync 00:05:34.161 EAL: No shared files mode enabled, IPC is disabled 00:05:34.161 EAL: Heap on socket 0 was shrunk by 258MB 00:05:34.161 EAL: Trying to obtain current memory policy. 00:05:34.161 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.161 EAL: Restoring previous memory policy: 4 00:05:34.161 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.161 EAL: request: mp_malloc_sync 00:05:34.161 EAL: No shared files mode enabled, IPC is disabled 00:05:34.161 EAL: Heap on socket 0 was expanded by 514MB 00:05:34.419 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.419 EAL: request: mp_malloc_sync 00:05:34.419 EAL: No shared files mode enabled, IPC is disabled 00:05:34.419 EAL: Heap on socket 0 was shrunk by 514MB 00:05:34.419 EAL: Trying to obtain current memory policy. 00:05:34.419 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:34.677 EAL: Restoring previous memory policy: 4 00:05:34.677 EAL: Calling mem event callback 'spdk:(nil)' 00:05:34.677 EAL: request: mp_malloc_sync 00:05:34.677 EAL: No shared files mode enabled, IPC is disabled 00:05:34.677 EAL: Heap on socket 0 was expanded by 1026MB 00:05:34.935 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.193 EAL: request: mp_malloc_sync 00:05:35.193 EAL: No shared files mode enabled, IPC is disabled 00:05:35.193 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:35.193 passed 00:05:35.193 00:05:35.193 Run Summary: Type Total Ran Passed Failed Inactive 00:05:35.193 suites 1 1 n/a 0 0 00:05:35.193 tests 2 2 2 0 0 00:05:35.193 asserts 497 497 497 0 n/a 00:05:35.193 00:05:35.193 Elapsed time = 1.309 seconds 00:05:35.193 EAL: Calling mem event callback 'spdk:(nil)' 00:05:35.193 EAL: request: mp_malloc_sync 00:05:35.193 EAL: No shared files mode enabled, IPC is disabled 00:05:35.193 EAL: Heap on socket 0 was shrunk by 2MB 00:05:35.193 EAL: No shared files mode enabled, IPC is disabled 00:05:35.193 EAL: No shared files mode enabled, IPC is disabled 00:05:35.193 EAL: No shared files mode enabled, IPC is disabled 00:05:35.193 00:05:35.193 real 0m1.419s 00:05:35.193 user 0m0.834s 00:05:35.193 sys 0m0.550s 00:05:35.193 15:00:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.193 15:00:35 -- common/autotest_common.sh@10 -- # set +x 00:05:35.193 ************************************ 00:05:35.193 END TEST env_vtophys 00:05:35.193 ************************************ 00:05:35.193 15:00:35 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:35.193 15:00:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.193 15:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.193 15:00:35 -- common/autotest_common.sh@10 -- # set +x 00:05:35.193 ************************************ 00:05:35.193 START TEST env_pci 00:05:35.193 ************************************ 00:05:35.194 15:00:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:35.194 00:05:35.194 00:05:35.194 CUnit - A unit testing framework for C - Version 2.1-3 00:05:35.194 http://cunit.sourceforge.net/ 00:05:35.194 00:05:35.194 00:05:35.194 Suite: pci 00:05:35.194 Test: pci_hook ...[2024-11-28 15:00:35.248263] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 583778 has claimed it 00:05:35.194 EAL: Cannot find device (10000:00:01.0) 00:05:35.194 EAL: Failed to attach device on primary process 00:05:35.194 passed 00:05:35.194 00:05:35.194 Run Summary: Type Total Ran Passed Failed Inactive 00:05:35.194 suites 1 1 n/a 0 0 00:05:35.194 tests 1 1 1 0 0 00:05:35.194 asserts 25 25 25 0 n/a 00:05:35.194 00:05:35.194 Elapsed time = 0.021 seconds 00:05:35.194 00:05:35.194 real 0m0.033s 00:05:35.194 user 0m0.010s 00:05:35.194 sys 0m0.023s 00:05:35.194 15:00:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.194 15:00:35 -- common/autotest_common.sh@10 -- # set +x 00:05:35.194 ************************************ 00:05:35.194 END TEST env_pci 00:05:35.194 ************************************ 00:05:35.194 15:00:35 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:35.194 15:00:35 -- env/env.sh@15 -- # uname 00:05:35.194 15:00:35 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:35.194 15:00:35 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:35.194 15:00:35 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:35.194 15:00:35 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:35.194 15:00:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.194 15:00:35 -- common/autotest_common.sh@10 -- # set +x 00:05:35.194 ************************************ 00:05:35.194 START TEST env_dpdk_post_init 00:05:35.194 ************************************ 00:05:35.194 15:00:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:35.194 EAL: Detected CPU lcores: 48 00:05:35.194 EAL: Detected NUMA nodes: 2 00:05:35.194 EAL: Detected shared linkage of DPDK 00:05:35.194 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:35.194 EAL: Selected IOVA mode 'VA' 00:05:35.194 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.194 EAL: VFIO support initialized 00:05:35.194 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:35.194 EAL: Using IOMMU type 1 (Type 1) 00:05:35.194 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:35.194 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:35.194 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:35.453 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:36.392 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:39.670 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:39.670 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:39.670 Starting DPDK initialization... 00:05:39.670 Starting SPDK post initialization... 00:05:39.670 SPDK NVMe probe 00:05:39.670 Attaching to 0000:88:00.0 00:05:39.670 Attached to 0000:88:00.0 00:05:39.670 Cleaning up... 00:05:39.670 00:05:39.670 real 0m4.389s 00:05:39.670 user 0m3.288s 00:05:39.670 sys 0m0.163s 00:05:39.670 15:00:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.670 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:39.670 ************************************ 00:05:39.670 END TEST env_dpdk_post_init 00:05:39.670 ************************************ 00:05:39.670 15:00:39 -- env/env.sh@26 -- # uname 00:05:39.670 15:00:39 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:39.670 15:00:39 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:39.670 15:00:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.670 15:00:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.670 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:39.670 ************************************ 00:05:39.670 START TEST env_mem_callbacks 00:05:39.670 ************************************ 00:05:39.670 15:00:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:39.670 EAL: Detected CPU lcores: 48 00:05:39.670 EAL: Detected NUMA nodes: 2 00:05:39.670 EAL: Detected shared linkage of DPDK 00:05:39.670 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:39.670 EAL: Selected IOVA mode 'VA' 00:05:39.670 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.670 EAL: VFIO support initialized 00:05:39.670 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:39.670 00:05:39.670 00:05:39.670 CUnit - A unit testing framework for C - Version 2.1-3 00:05:39.670 http://cunit.sourceforge.net/ 00:05:39.670 00:05:39.670 00:05:39.670 Suite: memory 00:05:39.670 Test: test ... 00:05:39.670 register 0x200000200000 2097152 00:05:39.670 malloc 3145728 00:05:39.670 register 0x200000400000 4194304 00:05:39.670 buf 0x200000500000 len 3145728 PASSED 00:05:39.670 malloc 64 00:05:39.670 buf 0x2000004fff40 len 64 PASSED 00:05:39.670 malloc 4194304 00:05:39.670 register 0x200000800000 6291456 00:05:39.670 buf 0x200000a00000 len 4194304 PASSED 00:05:39.670 free 0x200000500000 3145728 00:05:39.670 free 0x2000004fff40 64 00:05:39.670 unregister 0x200000400000 4194304 PASSED 00:05:39.670 free 0x200000a00000 4194304 00:05:39.670 unregister 0x200000800000 6291456 PASSED 00:05:39.670 malloc 8388608 00:05:39.670 register 0x200000400000 10485760 00:05:39.670 buf 0x200000600000 len 8388608 PASSED 00:05:39.670 free 0x200000600000 8388608 00:05:39.670 unregister 0x200000400000 10485760 PASSED 00:05:39.670 passed 00:05:39.670 00:05:39.670 Run Summary: Type Total Ran Passed Failed Inactive 00:05:39.670 suites 1 1 n/a 0 0 00:05:39.670 tests 1 1 1 0 0 00:05:39.670 asserts 15 15 15 0 n/a 00:05:39.670 00:05:39.670 Elapsed time = 0.004 seconds 00:05:39.670 00:05:39.670 real 0m0.047s 00:05:39.670 user 0m0.014s 00:05:39.670 sys 0m0.032s 00:05:39.670 15:00:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.670 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:39.670 ************************************ 00:05:39.670 END TEST env_mem_callbacks 00:05:39.670 ************************************ 00:05:39.670 00:05:39.670 real 0m6.323s 00:05:39.670 user 0m4.438s 00:05:39.671 sys 0m0.941s 00:05:39.671 15:00:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.671 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:39.671 ************************************ 00:05:39.671 END TEST env 00:05:39.671 ************************************ 00:05:39.671 15:00:39 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:39.671 15:00:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:39.671 15:00:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.671 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:39.671 ************************************ 00:05:39.671 START TEST rpc 00:05:39.671 ************************************ 00:05:39.671 15:00:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:39.671 * Looking for test storage... 00:05:39.671 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:39.671 15:00:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:39.671 15:00:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:39.671 15:00:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:39.929 15:00:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:39.929 15:00:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:39.929 15:00:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:39.929 15:00:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:39.929 15:00:39 -- scripts/common.sh@335 -- # IFS=.-: 00:05:39.929 15:00:39 -- scripts/common.sh@335 -- # read -ra ver1 00:05:39.929 15:00:39 -- scripts/common.sh@336 -- # IFS=.-: 00:05:39.929 15:00:39 -- scripts/common.sh@336 -- # read -ra ver2 00:05:39.929 15:00:39 -- scripts/common.sh@337 -- # local 'op=<' 00:05:39.929 15:00:39 -- scripts/common.sh@339 -- # ver1_l=2 00:05:39.929 15:00:39 -- scripts/common.sh@340 -- # ver2_l=1 00:05:39.929 15:00:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:39.929 15:00:39 -- scripts/common.sh@343 -- # case "$op" in 00:05:39.929 15:00:39 -- scripts/common.sh@344 -- # : 1 00:05:39.929 15:00:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:39.929 15:00:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:39.929 15:00:39 -- scripts/common.sh@364 -- # decimal 1 00:05:39.929 15:00:39 -- scripts/common.sh@352 -- # local d=1 00:05:39.929 15:00:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:39.929 15:00:39 -- scripts/common.sh@354 -- # echo 1 00:05:39.929 15:00:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:39.929 15:00:39 -- scripts/common.sh@365 -- # decimal 2 00:05:39.929 15:00:39 -- scripts/common.sh@352 -- # local d=2 00:05:39.929 15:00:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:39.929 15:00:39 -- scripts/common.sh@354 -- # echo 2 00:05:39.929 15:00:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:39.929 15:00:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:39.929 15:00:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:39.929 15:00:39 -- scripts/common.sh@367 -- # return 0 00:05:39.929 15:00:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:39.929 15:00:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:39.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.929 --rc genhtml_branch_coverage=1 00:05:39.929 --rc genhtml_function_coverage=1 00:05:39.929 --rc genhtml_legend=1 00:05:39.929 --rc geninfo_all_blocks=1 00:05:39.929 --rc geninfo_unexecuted_blocks=1 00:05:39.929 00:05:39.929 ' 00:05:39.929 15:00:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:39.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.929 --rc genhtml_branch_coverage=1 00:05:39.929 --rc genhtml_function_coverage=1 00:05:39.929 --rc genhtml_legend=1 00:05:39.929 --rc geninfo_all_blocks=1 00:05:39.929 --rc geninfo_unexecuted_blocks=1 00:05:39.929 00:05:39.929 ' 00:05:39.929 15:00:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:39.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.929 --rc genhtml_branch_coverage=1 00:05:39.929 --rc genhtml_function_coverage=1 00:05:39.929 --rc genhtml_legend=1 00:05:39.929 --rc geninfo_all_blocks=1 00:05:39.929 --rc geninfo_unexecuted_blocks=1 00:05:39.929 00:05:39.929 ' 00:05:39.929 15:00:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:39.929 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:39.929 --rc genhtml_branch_coverage=1 00:05:39.929 --rc genhtml_function_coverage=1 00:05:39.929 --rc genhtml_legend=1 00:05:39.929 --rc geninfo_all_blocks=1 00:05:39.929 --rc geninfo_unexecuted_blocks=1 00:05:39.929 00:05:39.929 ' 00:05:39.929 15:00:39 -- rpc/rpc.sh@65 -- # spdk_pid=584452 00:05:39.929 15:00:39 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:39.929 15:00:39 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:39.929 15:00:39 -- rpc/rpc.sh@67 -- # waitforlisten 584452 00:05:39.929 15:00:39 -- common/autotest_common.sh@829 -- # '[' -z 584452 ']' 00:05:39.929 15:00:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:39.929 15:00:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:39.929 15:00:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:39.929 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:39.929 15:00:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:39.929 15:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:39.929 [2024-11-28 15:00:40.005361] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:39.929 [2024-11-28 15:00:40.005483] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid584452 ] 00:05:39.929 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.929 [2024-11-28 15:00:40.066979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.929 [2024-11-28 15:00:40.150891] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:39.929 [2024-11-28 15:00:40.151041] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:39.930 [2024-11-28 15:00:40.151057] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 584452' to capture a snapshot of events at runtime. 00:05:39.930 [2024-11-28 15:00:40.151069] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid584452 for offline analysis/debug. 00:05:39.930 [2024-11-28 15:00:40.151130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.864 15:00:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:40.864 15:00:40 -- common/autotest_common.sh@862 -- # return 0 00:05:40.864 15:00:40 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.864 15:00:40 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:40.864 15:00:40 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:40.864 15:00:40 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:40.864 15:00:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:40.864 15:00:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.864 15:00:40 -- common/autotest_common.sh@10 -- # set +x 00:05:40.864 ************************************ 00:05:40.864 START TEST rpc_integrity 00:05:40.864 ************************************ 00:05:40.864 15:00:40 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:40.864 15:00:40 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:40.864 15:00:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.864 15:00:40 -- common/autotest_common.sh@10 -- # set +x 00:05:40.864 15:00:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.864 15:00:40 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:40.864 15:00:40 -- rpc/rpc.sh@13 -- # jq length 00:05:40.864 15:00:41 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:40.864 15:00:41 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:40.864 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.864 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:40.864 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.864 15:00:41 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:40.864 15:00:41 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:40.864 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.864 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:40.864 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.864 15:00:41 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:40.864 { 00:05:40.864 "name": "Malloc0", 00:05:40.864 "aliases": [ 00:05:40.864 "9e9a647d-fa09-4e87-9248-fb27e6fe54ce" 00:05:40.864 ], 00:05:40.864 "product_name": "Malloc disk", 00:05:40.864 "block_size": 512, 00:05:40.864 "num_blocks": 16384, 00:05:40.864 "uuid": "9e9a647d-fa09-4e87-9248-fb27e6fe54ce", 00:05:40.864 "assigned_rate_limits": { 00:05:40.864 "rw_ios_per_sec": 0, 00:05:40.864 "rw_mbytes_per_sec": 0, 00:05:40.864 "r_mbytes_per_sec": 0, 00:05:40.865 "w_mbytes_per_sec": 0 00:05:40.865 }, 00:05:40.865 "claimed": false, 00:05:40.865 "zoned": false, 00:05:40.865 "supported_io_types": { 00:05:40.865 "read": true, 00:05:40.865 "write": true, 00:05:40.865 "unmap": true, 00:05:40.865 "write_zeroes": true, 00:05:40.865 "flush": true, 00:05:40.865 "reset": true, 00:05:40.865 "compare": false, 00:05:40.865 "compare_and_write": false, 00:05:40.865 "abort": true, 00:05:40.865 "nvme_admin": false, 00:05:40.865 "nvme_io": false 00:05:40.865 }, 00:05:40.865 "memory_domains": [ 00:05:40.865 { 00:05:40.865 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:40.865 "dma_device_type": 2 00:05:40.865 } 00:05:40.865 ], 00:05:40.865 "driver_specific": {} 00:05:40.865 } 00:05:40.865 ]' 00:05:40.865 15:00:41 -- rpc/rpc.sh@17 -- # jq length 00:05:40.865 15:00:41 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:40.865 15:00:41 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:40.865 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.865 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:40.865 [2024-11-28 15:00:41.082317] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:40.865 [2024-11-28 15:00:41.082363] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:40.865 [2024-11-28 15:00:41.082399] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x150fb20 00:05:40.865 [2024-11-28 15:00:41.082412] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:40.865 [2024-11-28 15:00:41.083641] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:40.865 [2024-11-28 15:00:41.083666] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:40.865 Passthru0 00:05:40.865 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:40.865 15:00:41 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:40.865 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:40.865 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:41.122 { 00:05:41.122 "name": "Malloc0", 00:05:41.122 "aliases": [ 00:05:41.122 "9e9a647d-fa09-4e87-9248-fb27e6fe54ce" 00:05:41.122 ], 00:05:41.122 "product_name": "Malloc disk", 00:05:41.122 "block_size": 512, 00:05:41.122 "num_blocks": 16384, 00:05:41.122 "uuid": "9e9a647d-fa09-4e87-9248-fb27e6fe54ce", 00:05:41.122 "assigned_rate_limits": { 00:05:41.122 "rw_ios_per_sec": 0, 00:05:41.122 "rw_mbytes_per_sec": 0, 00:05:41.122 "r_mbytes_per_sec": 0, 00:05:41.122 "w_mbytes_per_sec": 0 00:05:41.122 }, 00:05:41.122 "claimed": true, 00:05:41.122 "claim_type": "exclusive_write", 00:05:41.122 "zoned": false, 00:05:41.122 "supported_io_types": { 00:05:41.122 "read": true, 00:05:41.122 "write": true, 00:05:41.122 "unmap": true, 00:05:41.122 "write_zeroes": true, 00:05:41.122 "flush": true, 00:05:41.122 "reset": true, 00:05:41.122 "compare": false, 00:05:41.122 "compare_and_write": false, 00:05:41.122 "abort": true, 00:05:41.122 "nvme_admin": false, 00:05:41.122 "nvme_io": false 00:05:41.122 }, 00:05:41.122 "memory_domains": [ 00:05:41.122 { 00:05:41.122 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.122 "dma_device_type": 2 00:05:41.122 } 00:05:41.122 ], 00:05:41.122 "driver_specific": {} 00:05:41.122 }, 00:05:41.122 { 00:05:41.122 "name": "Passthru0", 00:05:41.122 "aliases": [ 00:05:41.122 "db206e13-6abb-59a6-ae1f-de44f9d6ea05" 00:05:41.122 ], 00:05:41.122 "product_name": "passthru", 00:05:41.122 "block_size": 512, 00:05:41.122 "num_blocks": 16384, 00:05:41.122 "uuid": "db206e13-6abb-59a6-ae1f-de44f9d6ea05", 00:05:41.122 "assigned_rate_limits": { 00:05:41.122 "rw_ios_per_sec": 0, 00:05:41.122 "rw_mbytes_per_sec": 0, 00:05:41.122 "r_mbytes_per_sec": 0, 00:05:41.122 "w_mbytes_per_sec": 0 00:05:41.122 }, 00:05:41.122 "claimed": false, 00:05:41.122 "zoned": false, 00:05:41.122 "supported_io_types": { 00:05:41.122 "read": true, 00:05:41.122 "write": true, 00:05:41.122 "unmap": true, 00:05:41.122 "write_zeroes": true, 00:05:41.122 "flush": true, 00:05:41.122 "reset": true, 00:05:41.122 "compare": false, 00:05:41.122 "compare_and_write": false, 00:05:41.122 "abort": true, 00:05:41.122 "nvme_admin": false, 00:05:41.122 "nvme_io": false 00:05:41.122 }, 00:05:41.122 "memory_domains": [ 00:05:41.122 { 00:05:41.122 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.122 "dma_device_type": 2 00:05:41.122 } 00:05:41.122 ], 00:05:41.122 "driver_specific": { 00:05:41.122 "passthru": { 00:05:41.122 "name": "Passthru0", 00:05:41.122 "base_bdev_name": "Malloc0" 00:05:41.122 } 00:05:41.122 } 00:05:41.122 } 00:05:41.122 ]' 00:05:41.122 15:00:41 -- rpc/rpc.sh@21 -- # jq length 00:05:41.122 15:00:41 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:41.122 15:00:41 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:41.122 15:00:41 -- rpc/rpc.sh@26 -- # jq length 00:05:41.122 15:00:41 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:41.122 00:05:41.122 real 0m0.213s 00:05:41.122 user 0m0.136s 00:05:41.122 sys 0m0.018s 00:05:41.122 15:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 ************************************ 00:05:41.122 END TEST rpc_integrity 00:05:41.122 ************************************ 00:05:41.122 15:00:41 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:41.122 15:00:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.122 15:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 ************************************ 00:05:41.122 START TEST rpc_plugins 00:05:41.122 ************************************ 00:05:41.122 15:00:41 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:41.122 15:00:41 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:41.122 15:00:41 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:41.122 { 00:05:41.122 "name": "Malloc1", 00:05:41.122 "aliases": [ 00:05:41.122 "8e5ae30e-c7d9-4f18-b183-d15bd4b196c7" 00:05:41.122 ], 00:05:41.122 "product_name": "Malloc disk", 00:05:41.122 "block_size": 4096, 00:05:41.122 "num_blocks": 256, 00:05:41.122 "uuid": "8e5ae30e-c7d9-4f18-b183-d15bd4b196c7", 00:05:41.122 "assigned_rate_limits": { 00:05:41.122 "rw_ios_per_sec": 0, 00:05:41.122 "rw_mbytes_per_sec": 0, 00:05:41.122 "r_mbytes_per_sec": 0, 00:05:41.122 "w_mbytes_per_sec": 0 00:05:41.122 }, 00:05:41.122 "claimed": false, 00:05:41.122 "zoned": false, 00:05:41.122 "supported_io_types": { 00:05:41.122 "read": true, 00:05:41.122 "write": true, 00:05:41.122 "unmap": true, 00:05:41.122 "write_zeroes": true, 00:05:41.122 "flush": true, 00:05:41.122 "reset": true, 00:05:41.122 "compare": false, 00:05:41.122 "compare_and_write": false, 00:05:41.122 "abort": true, 00:05:41.122 "nvme_admin": false, 00:05:41.122 "nvme_io": false 00:05:41.122 }, 00:05:41.122 "memory_domains": [ 00:05:41.122 { 00:05:41.122 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.122 "dma_device_type": 2 00:05:41.122 } 00:05:41.122 ], 00:05:41.122 "driver_specific": {} 00:05:41.122 } 00:05:41.122 ]' 00:05:41.122 15:00:41 -- rpc/rpc.sh@32 -- # jq length 00:05:41.122 15:00:41 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:41.122 15:00:41 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:41.122 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.122 15:00:41 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:41.122 15:00:41 -- rpc/rpc.sh@36 -- # jq length 00:05:41.122 15:00:41 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:41.122 00:05:41.122 real 0m0.107s 00:05:41.122 user 0m0.070s 00:05:41.122 sys 0m0.007s 00:05:41.122 15:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.122 ************************************ 00:05:41.122 END TEST rpc_plugins 00:05:41.122 ************************************ 00:05:41.122 15:00:41 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:41.122 15:00:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.122 15:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.122 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.123 ************************************ 00:05:41.123 START TEST rpc_trace_cmd_test 00:05:41.123 ************************************ 00:05:41.123 15:00:41 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:41.123 15:00:41 -- rpc/rpc.sh@40 -- # local info 00:05:41.123 15:00:41 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:41.123 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.123 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.379 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.379 15:00:41 -- rpc/rpc.sh@42 -- # info='{ 00:05:41.379 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid584452", 00:05:41.379 "tpoint_group_mask": "0x8", 00:05:41.379 "iscsi_conn": { 00:05:41.379 "mask": "0x2", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "scsi": { 00:05:41.379 "mask": "0x4", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "bdev": { 00:05:41.379 "mask": "0x8", 00:05:41.379 "tpoint_mask": "0xffffffffffffffff" 00:05:41.379 }, 00:05:41.379 "nvmf_rdma": { 00:05:41.379 "mask": "0x10", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "nvmf_tcp": { 00:05:41.379 "mask": "0x20", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "ftl": { 00:05:41.379 "mask": "0x40", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "blobfs": { 00:05:41.379 "mask": "0x80", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "dsa": { 00:05:41.379 "mask": "0x200", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "thread": { 00:05:41.379 "mask": "0x400", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "nvme_pcie": { 00:05:41.379 "mask": "0x800", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "iaa": { 00:05:41.379 "mask": "0x1000", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "nvme_tcp": { 00:05:41.379 "mask": "0x2000", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 }, 00:05:41.379 "bdev_nvme": { 00:05:41.379 "mask": "0x4000", 00:05:41.379 "tpoint_mask": "0x0" 00:05:41.379 } 00:05:41.379 }' 00:05:41.379 15:00:41 -- rpc/rpc.sh@43 -- # jq length 00:05:41.379 15:00:41 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:41.379 15:00:41 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:41.379 15:00:41 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:41.379 15:00:41 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:41.379 15:00:41 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:41.379 15:00:41 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:41.379 15:00:41 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:41.379 15:00:41 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:41.379 15:00:41 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:41.379 00:05:41.379 real 0m0.197s 00:05:41.379 user 0m0.178s 00:05:41.379 sys 0m0.011s 00:05:41.379 15:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.379 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.379 ************************************ 00:05:41.379 END TEST rpc_trace_cmd_test 00:05:41.379 ************************************ 00:05:41.379 15:00:41 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:41.379 15:00:41 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:41.379 15:00:41 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:41.379 15:00:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.379 15:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.379 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.379 ************************************ 00:05:41.379 START TEST rpc_daemon_integrity 00:05:41.379 ************************************ 00:05:41.379 15:00:41 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:41.379 15:00:41 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:41.379 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.379 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.379 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.379 15:00:41 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:41.379 15:00:41 -- rpc/rpc.sh@13 -- # jq length 00:05:41.379 15:00:41 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:41.379 15:00:41 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:41.379 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.379 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.637 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.637 15:00:41 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:41.637 15:00:41 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:41.637 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.637 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.637 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.637 15:00:41 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:41.637 { 00:05:41.637 "name": "Malloc2", 00:05:41.637 "aliases": [ 00:05:41.637 "255a954f-76eb-415d-beef-052c9bcfa14f" 00:05:41.637 ], 00:05:41.637 "product_name": "Malloc disk", 00:05:41.637 "block_size": 512, 00:05:41.637 "num_blocks": 16384, 00:05:41.637 "uuid": "255a954f-76eb-415d-beef-052c9bcfa14f", 00:05:41.637 "assigned_rate_limits": { 00:05:41.637 "rw_ios_per_sec": 0, 00:05:41.637 "rw_mbytes_per_sec": 0, 00:05:41.637 "r_mbytes_per_sec": 0, 00:05:41.637 "w_mbytes_per_sec": 0 00:05:41.637 }, 00:05:41.637 "claimed": false, 00:05:41.637 "zoned": false, 00:05:41.637 "supported_io_types": { 00:05:41.637 "read": true, 00:05:41.637 "write": true, 00:05:41.637 "unmap": true, 00:05:41.637 "write_zeroes": true, 00:05:41.637 "flush": true, 00:05:41.637 "reset": true, 00:05:41.637 "compare": false, 00:05:41.637 "compare_and_write": false, 00:05:41.637 "abort": true, 00:05:41.637 "nvme_admin": false, 00:05:41.637 "nvme_io": false 00:05:41.637 }, 00:05:41.637 "memory_domains": [ 00:05:41.637 { 00:05:41.637 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.637 "dma_device_type": 2 00:05:41.637 } 00:05:41.637 ], 00:05:41.637 "driver_specific": {} 00:05:41.637 } 00:05:41.637 ]' 00:05:41.637 15:00:41 -- rpc/rpc.sh@17 -- # jq length 00:05:41.637 15:00:41 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:41.637 15:00:41 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:41.637 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.637 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.637 [2024-11-28 15:00:41.668030] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:41.637 [2024-11-28 15:00:41.668085] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:41.637 [2024-11-28 15:00:41.668122] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x150eec0 00:05:41.637 [2024-11-28 15:00:41.668138] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:41.637 [2024-11-28 15:00:41.669264] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:41.637 [2024-11-28 15:00:41.669289] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:41.637 Passthru0 00:05:41.637 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.637 15:00:41 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:41.637 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.637 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.637 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.637 15:00:41 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:41.637 { 00:05:41.637 "name": "Malloc2", 00:05:41.637 "aliases": [ 00:05:41.637 "255a954f-76eb-415d-beef-052c9bcfa14f" 00:05:41.637 ], 00:05:41.637 "product_name": "Malloc disk", 00:05:41.637 "block_size": 512, 00:05:41.637 "num_blocks": 16384, 00:05:41.637 "uuid": "255a954f-76eb-415d-beef-052c9bcfa14f", 00:05:41.637 "assigned_rate_limits": { 00:05:41.637 "rw_ios_per_sec": 0, 00:05:41.637 "rw_mbytes_per_sec": 0, 00:05:41.637 "r_mbytes_per_sec": 0, 00:05:41.637 "w_mbytes_per_sec": 0 00:05:41.637 }, 00:05:41.637 "claimed": true, 00:05:41.637 "claim_type": "exclusive_write", 00:05:41.637 "zoned": false, 00:05:41.637 "supported_io_types": { 00:05:41.637 "read": true, 00:05:41.637 "write": true, 00:05:41.637 "unmap": true, 00:05:41.637 "write_zeroes": true, 00:05:41.637 "flush": true, 00:05:41.637 "reset": true, 00:05:41.637 "compare": false, 00:05:41.637 "compare_and_write": false, 00:05:41.637 "abort": true, 00:05:41.638 "nvme_admin": false, 00:05:41.638 "nvme_io": false 00:05:41.638 }, 00:05:41.638 "memory_domains": [ 00:05:41.638 { 00:05:41.638 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.638 "dma_device_type": 2 00:05:41.638 } 00:05:41.638 ], 00:05:41.638 "driver_specific": {} 00:05:41.638 }, 00:05:41.638 { 00:05:41.638 "name": "Passthru0", 00:05:41.638 "aliases": [ 00:05:41.638 "ce292a7c-2e28-5279-91da-699ee102ae19" 00:05:41.638 ], 00:05:41.638 "product_name": "passthru", 00:05:41.638 "block_size": 512, 00:05:41.638 "num_blocks": 16384, 00:05:41.638 "uuid": "ce292a7c-2e28-5279-91da-699ee102ae19", 00:05:41.638 "assigned_rate_limits": { 00:05:41.638 "rw_ios_per_sec": 0, 00:05:41.638 "rw_mbytes_per_sec": 0, 00:05:41.638 "r_mbytes_per_sec": 0, 00:05:41.638 "w_mbytes_per_sec": 0 00:05:41.638 }, 00:05:41.638 "claimed": false, 00:05:41.638 "zoned": false, 00:05:41.638 "supported_io_types": { 00:05:41.638 "read": true, 00:05:41.638 "write": true, 00:05:41.638 "unmap": true, 00:05:41.638 "write_zeroes": true, 00:05:41.638 "flush": true, 00:05:41.638 "reset": true, 00:05:41.638 "compare": false, 00:05:41.638 "compare_and_write": false, 00:05:41.638 "abort": true, 00:05:41.638 "nvme_admin": false, 00:05:41.638 "nvme_io": false 00:05:41.638 }, 00:05:41.638 "memory_domains": [ 00:05:41.638 { 00:05:41.638 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:41.638 "dma_device_type": 2 00:05:41.638 } 00:05:41.638 ], 00:05:41.638 "driver_specific": { 00:05:41.638 "passthru": { 00:05:41.638 "name": "Passthru0", 00:05:41.638 "base_bdev_name": "Malloc2" 00:05:41.638 } 00:05:41.638 } 00:05:41.638 } 00:05:41.638 ]' 00:05:41.638 15:00:41 -- rpc/rpc.sh@21 -- # jq length 00:05:41.638 15:00:41 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:41.638 15:00:41 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:41.638 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.638 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.638 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.638 15:00:41 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:41.638 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.638 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.638 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.638 15:00:41 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:41.638 15:00:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:41.638 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.638 15:00:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:41.638 15:00:41 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:41.638 15:00:41 -- rpc/rpc.sh@26 -- # jq length 00:05:41.638 15:00:41 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:41.638 00:05:41.638 real 0m0.205s 00:05:41.638 user 0m0.133s 00:05:41.638 sys 0m0.016s 00:05:41.638 15:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.638 15:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:41.638 ************************************ 00:05:41.638 END TEST rpc_daemon_integrity 00:05:41.638 ************************************ 00:05:41.638 15:00:41 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:41.638 15:00:41 -- rpc/rpc.sh@84 -- # killprocess 584452 00:05:41.638 15:00:41 -- common/autotest_common.sh@936 -- # '[' -z 584452 ']' 00:05:41.638 15:00:41 -- common/autotest_common.sh@940 -- # kill -0 584452 00:05:41.638 15:00:41 -- common/autotest_common.sh@941 -- # uname 00:05:41.638 15:00:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:41.638 15:00:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 584452 00:05:41.638 15:00:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:41.638 15:00:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:41.638 15:00:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 584452' 00:05:41.638 killing process with pid 584452 00:05:41.638 15:00:41 -- common/autotest_common.sh@955 -- # kill 584452 00:05:41.638 15:00:41 -- common/autotest_common.sh@960 -- # wait 584452 00:05:42.203 00:05:42.203 real 0m2.406s 00:05:42.203 user 0m3.044s 00:05:42.203 sys 0m0.580s 00:05:42.203 15:00:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.203 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.203 ************************************ 00:05:42.203 END TEST rpc 00:05:42.203 ************************************ 00:05:42.203 15:00:42 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:42.203 15:00:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.204 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.204 ************************************ 00:05:42.204 START TEST rpc_client 00:05:42.204 ************************************ 00:05:42.204 15:00:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:42.204 * Looking for test storage... 00:05:42.204 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:42.204 15:00:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:42.204 15:00:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:42.204 15:00:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:42.204 15:00:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:42.204 15:00:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:42.204 15:00:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:42.204 15:00:42 -- scripts/common.sh@335 -- # IFS=.-: 00:05:42.204 15:00:42 -- scripts/common.sh@335 -- # read -ra ver1 00:05:42.204 15:00:42 -- scripts/common.sh@336 -- # IFS=.-: 00:05:42.204 15:00:42 -- scripts/common.sh@336 -- # read -ra ver2 00:05:42.204 15:00:42 -- scripts/common.sh@337 -- # local 'op=<' 00:05:42.204 15:00:42 -- scripts/common.sh@339 -- # ver1_l=2 00:05:42.204 15:00:42 -- scripts/common.sh@340 -- # ver2_l=1 00:05:42.204 15:00:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:42.204 15:00:42 -- scripts/common.sh@343 -- # case "$op" in 00:05:42.204 15:00:42 -- scripts/common.sh@344 -- # : 1 00:05:42.204 15:00:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:42.204 15:00:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:42.204 15:00:42 -- scripts/common.sh@364 -- # decimal 1 00:05:42.204 15:00:42 -- scripts/common.sh@352 -- # local d=1 00:05:42.204 15:00:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:42.204 15:00:42 -- scripts/common.sh@354 -- # echo 1 00:05:42.204 15:00:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:42.204 15:00:42 -- scripts/common.sh@365 -- # decimal 2 00:05:42.204 15:00:42 -- scripts/common.sh@352 -- # local d=2 00:05:42.204 15:00:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:42.204 15:00:42 -- scripts/common.sh@354 -- # echo 2 00:05:42.204 15:00:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:42.204 15:00:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:42.204 15:00:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:42.204 15:00:42 -- scripts/common.sh@367 -- # return 0 00:05:42.204 15:00:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.204 --rc genhtml_branch_coverage=1 00:05:42.204 --rc genhtml_function_coverage=1 00:05:42.204 --rc genhtml_legend=1 00:05:42.204 --rc geninfo_all_blocks=1 00:05:42.204 --rc geninfo_unexecuted_blocks=1 00:05:42.204 00:05:42.204 ' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.204 --rc genhtml_branch_coverage=1 00:05:42.204 --rc genhtml_function_coverage=1 00:05:42.204 --rc genhtml_legend=1 00:05:42.204 --rc geninfo_all_blocks=1 00:05:42.204 --rc geninfo_unexecuted_blocks=1 00:05:42.204 00:05:42.204 ' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.204 --rc genhtml_branch_coverage=1 00:05:42.204 --rc genhtml_function_coverage=1 00:05:42.204 --rc genhtml_legend=1 00:05:42.204 --rc geninfo_all_blocks=1 00:05:42.204 --rc geninfo_unexecuted_blocks=1 00:05:42.204 00:05:42.204 ' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:42.204 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.204 --rc genhtml_branch_coverage=1 00:05:42.204 --rc genhtml_function_coverage=1 00:05:42.204 --rc genhtml_legend=1 00:05:42.204 --rc geninfo_all_blocks=1 00:05:42.204 --rc geninfo_unexecuted_blocks=1 00:05:42.204 00:05:42.204 ' 00:05:42.204 15:00:42 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:42.204 OK 00:05:42.204 15:00:42 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:42.204 00:05:42.204 real 0m0.158s 00:05:42.204 user 0m0.100s 00:05:42.204 sys 0m0.068s 00:05:42.204 15:00:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.204 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.204 ************************************ 00:05:42.204 END TEST rpc_client 00:05:42.204 ************************************ 00:05:42.204 15:00:42 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:42.204 15:00:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.204 15:00:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.204 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.204 ************************************ 00:05:42.204 START TEST json_config 00:05:42.204 ************************************ 00:05:42.204 15:00:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:42.463 15:00:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:42.463 15:00:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:42.463 15:00:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:42.463 15:00:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:42.463 15:00:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:42.463 15:00:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:42.463 15:00:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:42.463 15:00:42 -- scripts/common.sh@335 -- # IFS=.-: 00:05:42.463 15:00:42 -- scripts/common.sh@335 -- # read -ra ver1 00:05:42.463 15:00:42 -- scripts/common.sh@336 -- # IFS=.-: 00:05:42.463 15:00:42 -- scripts/common.sh@336 -- # read -ra ver2 00:05:42.463 15:00:42 -- scripts/common.sh@337 -- # local 'op=<' 00:05:42.463 15:00:42 -- scripts/common.sh@339 -- # ver1_l=2 00:05:42.463 15:00:42 -- scripts/common.sh@340 -- # ver2_l=1 00:05:42.463 15:00:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:42.463 15:00:42 -- scripts/common.sh@343 -- # case "$op" in 00:05:42.463 15:00:42 -- scripts/common.sh@344 -- # : 1 00:05:42.463 15:00:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:42.463 15:00:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:42.463 15:00:42 -- scripts/common.sh@364 -- # decimal 1 00:05:42.463 15:00:42 -- scripts/common.sh@352 -- # local d=1 00:05:42.463 15:00:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:42.463 15:00:42 -- scripts/common.sh@354 -- # echo 1 00:05:42.463 15:00:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:42.463 15:00:42 -- scripts/common.sh@365 -- # decimal 2 00:05:42.463 15:00:42 -- scripts/common.sh@352 -- # local d=2 00:05:42.463 15:00:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:42.463 15:00:42 -- scripts/common.sh@354 -- # echo 2 00:05:42.463 15:00:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:42.463 15:00:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:42.463 15:00:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:42.463 15:00:42 -- scripts/common.sh@367 -- # return 0 00:05:42.463 15:00:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:42.463 15:00:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:42.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.463 --rc genhtml_branch_coverage=1 00:05:42.463 --rc genhtml_function_coverage=1 00:05:42.463 --rc genhtml_legend=1 00:05:42.463 --rc geninfo_all_blocks=1 00:05:42.463 --rc geninfo_unexecuted_blocks=1 00:05:42.463 00:05:42.463 ' 00:05:42.463 15:00:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:42.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.463 --rc genhtml_branch_coverage=1 00:05:42.463 --rc genhtml_function_coverage=1 00:05:42.463 --rc genhtml_legend=1 00:05:42.463 --rc geninfo_all_blocks=1 00:05:42.463 --rc geninfo_unexecuted_blocks=1 00:05:42.463 00:05:42.463 ' 00:05:42.463 15:00:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:42.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.463 --rc genhtml_branch_coverage=1 00:05:42.463 --rc genhtml_function_coverage=1 00:05:42.463 --rc genhtml_legend=1 00:05:42.463 --rc geninfo_all_blocks=1 00:05:42.463 --rc geninfo_unexecuted_blocks=1 00:05:42.463 00:05:42.463 ' 00:05:42.463 15:00:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:42.463 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.463 --rc genhtml_branch_coverage=1 00:05:42.463 --rc genhtml_function_coverage=1 00:05:42.463 --rc genhtml_legend=1 00:05:42.463 --rc geninfo_all_blocks=1 00:05:42.463 --rc geninfo_unexecuted_blocks=1 00:05:42.463 00:05:42.463 ' 00:05:42.463 15:00:42 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:42.463 15:00:42 -- nvmf/common.sh@7 -- # uname -s 00:05:42.463 15:00:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:42.463 15:00:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:42.463 15:00:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:42.463 15:00:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:42.463 15:00:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:42.463 15:00:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:42.463 15:00:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:42.463 15:00:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:42.463 15:00:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:42.463 15:00:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:42.463 15:00:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:42.463 15:00:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:42.463 15:00:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:42.463 15:00:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:42.463 15:00:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:42.463 15:00:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:42.463 15:00:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:42.463 15:00:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:42.463 15:00:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:42.463 15:00:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.463 15:00:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.463 15:00:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.463 15:00:42 -- paths/export.sh@5 -- # export PATH 00:05:42.463 15:00:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:42.463 15:00:42 -- nvmf/common.sh@46 -- # : 0 00:05:42.463 15:00:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:42.463 15:00:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:42.463 15:00:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:42.463 15:00:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:42.463 15:00:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:42.463 15:00:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:42.463 15:00:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:42.463 15:00:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:42.463 15:00:42 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:42.463 15:00:42 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:42.463 15:00:42 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:42.463 15:00:42 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:42.463 15:00:42 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:42.463 15:00:42 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:42.463 15:00:42 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:42.463 15:00:42 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:42.463 15:00:42 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:42.463 15:00:42 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:42.463 15:00:42 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:42.463 15:00:42 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:42.463 15:00:42 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:42.463 15:00:42 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:42.463 15:00:42 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:42.463 INFO: JSON configuration test init 00:05:42.463 15:00:42 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:42.463 15:00:42 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:42.463 15:00:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:42.463 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.463 15:00:42 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:42.463 15:00:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:42.463 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.463 15:00:42 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:42.464 15:00:42 -- json_config/json_config.sh@98 -- # local app=target 00:05:42.464 15:00:42 -- json_config/json_config.sh@99 -- # shift 00:05:42.464 15:00:42 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:42.464 15:00:42 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:42.464 15:00:42 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:42.464 15:00:42 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:42.464 15:00:42 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:42.464 15:00:42 -- json_config/json_config.sh@111 -- # app_pid[$app]=584958 00:05:42.464 15:00:42 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:42.464 15:00:42 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:42.464 Waiting for target to run... 00:05:42.464 15:00:42 -- json_config/json_config.sh@114 -- # waitforlisten 584958 /var/tmp/spdk_tgt.sock 00:05:42.464 15:00:42 -- common/autotest_common.sh@829 -- # '[' -z 584958 ']' 00:05:42.464 15:00:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:42.464 15:00:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:42.464 15:00:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:42.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:42.464 15:00:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:42.464 15:00:42 -- common/autotest_common.sh@10 -- # set +x 00:05:42.464 [2024-11-28 15:00:42.619345] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:42.464 [2024-11-28 15:00:42.619460] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid584958 ] 00:05:42.464 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.030 [2024-11-28 15:00:43.133941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.030 [2024-11-28 15:00:43.205509] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:43.030 [2024-11-28 15:00:43.205671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.595 15:00:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:43.595 15:00:43 -- common/autotest_common.sh@862 -- # return 0 00:05:43.595 15:00:43 -- json_config/json_config.sh@115 -- # echo '' 00:05:43.595 00:05:43.595 15:00:43 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:43.595 15:00:43 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:43.595 15:00:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:43.595 15:00:43 -- common/autotest_common.sh@10 -- # set +x 00:05:43.595 15:00:43 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:43.595 15:00:43 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:43.595 15:00:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:43.595 15:00:43 -- common/autotest_common.sh@10 -- # set +x 00:05:43.595 15:00:43 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:43.595 15:00:43 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:43.595 15:00:43 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:46.878 15:00:46 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:46.878 15:00:46 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:46.878 15:00:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:46.878 15:00:46 -- common/autotest_common.sh@10 -- # set +x 00:05:46.878 15:00:46 -- json_config/json_config.sh@48 -- # local ret=0 00:05:46.878 15:00:46 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:46.878 15:00:46 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:46.878 15:00:46 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:46.878 15:00:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:46.878 15:00:46 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:46.878 15:00:46 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:46.878 15:00:46 -- json_config/json_config.sh@51 -- # local get_types 00:05:46.878 15:00:46 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:46.878 15:00:46 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:46.878 15:00:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:46.878 15:00:46 -- common/autotest_common.sh@10 -- # set +x 00:05:46.878 15:00:47 -- json_config/json_config.sh@58 -- # return 0 00:05:46.878 15:00:47 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:46.878 15:00:47 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:46.878 15:00:47 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:46.878 15:00:47 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:46.878 15:00:47 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:46.878 15:00:47 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:46.878 15:00:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:46.878 15:00:47 -- common/autotest_common.sh@10 -- # set +x 00:05:46.878 15:00:47 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:46.878 15:00:47 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:46.878 15:00:47 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:46.878 15:00:47 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:46.878 15:00:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:47.136 MallocForNvmf0 00:05:47.136 15:00:47 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:47.136 15:00:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:47.395 MallocForNvmf1 00:05:47.395 15:00:47 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:47.395 15:00:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:47.652 [2024-11-28 15:00:47.754698] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:47.652 15:00:47 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:47.652 15:00:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:47.911 15:00:48 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:47.911 15:00:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:48.169 15:00:48 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:48.169 15:00:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:48.428 15:00:48 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:48.428 15:00:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:48.686 [2024-11-28 15:00:48.762244] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:48.686 15:00:48 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:48.686 15:00:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.686 15:00:48 -- common/autotest_common.sh@10 -- # set +x 00:05:48.686 15:00:48 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:48.686 15:00:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.686 15:00:48 -- common/autotest_common.sh@10 -- # set +x 00:05:48.686 15:00:48 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:48.686 15:00:48 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:48.686 15:00:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:48.944 MallocBdevForConfigChangeCheck 00:05:48.944 15:00:49 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:48.944 15:00:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:48.944 15:00:49 -- common/autotest_common.sh@10 -- # set +x 00:05:48.944 15:00:49 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:48.944 15:00:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:49.510 15:00:49 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:49.510 INFO: shutting down applications... 00:05:49.510 15:00:49 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:49.510 15:00:49 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:49.510 15:00:49 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:49.510 15:00:49 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:50.884 Calling clear_iscsi_subsystem 00:05:50.884 Calling clear_nvmf_subsystem 00:05:50.884 Calling clear_nbd_subsystem 00:05:50.884 Calling clear_ublk_subsystem 00:05:50.884 Calling clear_vhost_blk_subsystem 00:05:50.884 Calling clear_vhost_scsi_subsystem 00:05:50.884 Calling clear_scheduler_subsystem 00:05:50.884 Calling clear_bdev_subsystem 00:05:50.884 Calling clear_accel_subsystem 00:05:50.884 Calling clear_vmd_subsystem 00:05:50.884 Calling clear_sock_subsystem 00:05:50.884 Calling clear_iobuf_subsystem 00:05:50.884 15:00:51 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:50.884 15:00:51 -- json_config/json_config.sh@396 -- # count=100 00:05:50.884 15:00:51 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:50.884 15:00:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.884 15:00:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:50.884 15:00:51 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:51.451 15:00:51 -- json_config/json_config.sh@398 -- # break 00:05:51.451 15:00:51 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:51.451 15:00:51 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:51.451 15:00:51 -- json_config/json_config.sh@120 -- # local app=target 00:05:51.451 15:00:51 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:51.451 15:00:51 -- json_config/json_config.sh@124 -- # [[ -n 584958 ]] 00:05:51.451 15:00:51 -- json_config/json_config.sh@127 -- # kill -SIGINT 584958 00:05:51.451 15:00:51 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:51.451 15:00:51 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:51.451 15:00:51 -- json_config/json_config.sh@130 -- # kill -0 584958 00:05:51.451 15:00:51 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:52.021 15:00:51 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:52.021 15:00:51 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:52.021 15:00:51 -- json_config/json_config.sh@130 -- # kill -0 584958 00:05:52.021 15:00:51 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:52.021 15:00:51 -- json_config/json_config.sh@132 -- # break 00:05:52.021 15:00:51 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:52.021 15:00:51 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:52.021 SPDK target shutdown done 00:05:52.021 15:00:51 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:52.021 INFO: relaunching applications... 00:05:52.021 15:00:51 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.021 15:00:51 -- json_config/json_config.sh@98 -- # local app=target 00:05:52.021 15:00:51 -- json_config/json_config.sh@99 -- # shift 00:05:52.021 15:00:51 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:52.021 15:00:51 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:52.021 15:00:51 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:52.021 15:00:51 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:52.021 15:00:51 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:52.021 15:00:51 -- json_config/json_config.sh@111 -- # app_pid[$app]=586193 00:05:52.021 15:00:51 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.021 15:00:51 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:52.021 Waiting for target to run... 00:05:52.021 15:00:51 -- json_config/json_config.sh@114 -- # waitforlisten 586193 /var/tmp/spdk_tgt.sock 00:05:52.021 15:00:51 -- common/autotest_common.sh@829 -- # '[' -z 586193 ']' 00:05:52.021 15:00:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:52.021 15:00:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.021 15:00:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:52.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:52.021 15:00:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.021 15:00:51 -- common/autotest_common.sh@10 -- # set +x 00:05:52.021 [2024-11-28 15:00:52.005665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:52.021 [2024-11-28 15:00:52.005781] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid586193 ] 00:05:52.021 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.279 [2024-11-28 15:00:52.503181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.538 [2024-11-28 15:00:52.575547] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:52.538 [2024-11-28 15:00:52.575708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.833 [2024-11-28 15:00:55.591906] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:55.833 [2024-11-28 15:00:55.624357] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:55.833 15:00:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:55.833 15:00:55 -- common/autotest_common.sh@862 -- # return 0 00:05:55.833 15:00:55 -- json_config/json_config.sh@115 -- # echo '' 00:05:55.833 00:05:55.833 15:00:55 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:55.833 15:00:55 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:55.833 INFO: Checking if target configuration is the same... 00:05:55.833 15:00:55 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:55.833 15:00:55 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:55.833 15:00:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:55.833 + '[' 2 -ne 2 ']' 00:05:55.833 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:55.833 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:55.833 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:55.833 +++ basename /dev/fd/62 00:05:55.833 ++ mktemp /tmp/62.XXX 00:05:55.833 + tmp_file_1=/tmp/62.HXr 00:05:55.833 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:55.833 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:55.833 + tmp_file_2=/tmp/spdk_tgt_config.json.1YL 00:05:55.833 + ret=0 00:05:55.833 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:56.091 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:56.350 + diff -u /tmp/62.HXr /tmp/spdk_tgt_config.json.1YL 00:05:56.350 + echo 'INFO: JSON config files are the same' 00:05:56.350 INFO: JSON config files are the same 00:05:56.350 + rm /tmp/62.HXr /tmp/spdk_tgt_config.json.1YL 00:05:56.350 + exit 0 00:05:56.350 15:00:56 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:56.350 15:00:56 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:56.350 INFO: changing configuration and checking if this can be detected... 00:05:56.350 15:00:56 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:56.350 15:00:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:56.350 15:00:56 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.350 15:00:56 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:56.350 15:00:56 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:56.350 + '[' 2 -ne 2 ']' 00:05:56.350 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:56.350 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:56.350 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:56.608 +++ basename /dev/fd/62 00:05:56.608 ++ mktemp /tmp/62.XXX 00:05:56.608 + tmp_file_1=/tmp/62.vOC 00:05:56.608 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:56.608 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:56.608 + tmp_file_2=/tmp/spdk_tgt_config.json.R5p 00:05:56.608 + ret=0 00:05:56.608 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:56.867 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:56.867 + diff -u /tmp/62.vOC /tmp/spdk_tgt_config.json.R5p 00:05:56.867 + ret=1 00:05:56.867 + echo '=== Start of file: /tmp/62.vOC ===' 00:05:56.867 + cat /tmp/62.vOC 00:05:56.867 + echo '=== End of file: /tmp/62.vOC ===' 00:05:56.867 + echo '' 00:05:56.867 + echo '=== Start of file: /tmp/spdk_tgt_config.json.R5p ===' 00:05:56.867 + cat /tmp/spdk_tgt_config.json.R5p 00:05:56.867 + echo '=== End of file: /tmp/spdk_tgt_config.json.R5p ===' 00:05:56.867 + echo '' 00:05:56.867 + rm /tmp/62.vOC /tmp/spdk_tgt_config.json.R5p 00:05:56.867 + exit 1 00:05:56.867 15:00:57 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:56.867 INFO: configuration change detected. 00:05:56.867 15:00:57 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:56.867 15:00:57 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:56.867 15:00:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.867 15:00:57 -- common/autotest_common.sh@10 -- # set +x 00:05:56.867 15:00:57 -- json_config/json_config.sh@360 -- # local ret=0 00:05:56.867 15:00:57 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:56.867 15:00:57 -- json_config/json_config.sh@370 -- # [[ -n 586193 ]] 00:05:56.867 15:00:57 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:56.867 15:00:57 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:56.867 15:00:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.867 15:00:57 -- common/autotest_common.sh@10 -- # set +x 00:05:56.867 15:00:57 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:56.867 15:00:57 -- json_config/json_config.sh@246 -- # uname -s 00:05:56.867 15:00:57 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:56.867 15:00:57 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:56.867 15:00:57 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:56.867 15:00:57 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:56.867 15:00:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:56.867 15:00:57 -- common/autotest_common.sh@10 -- # set +x 00:05:56.867 15:00:57 -- json_config/json_config.sh@376 -- # killprocess 586193 00:05:56.867 15:00:57 -- common/autotest_common.sh@936 -- # '[' -z 586193 ']' 00:05:56.867 15:00:57 -- common/autotest_common.sh@940 -- # kill -0 586193 00:05:56.867 15:00:57 -- common/autotest_common.sh@941 -- # uname 00:05:56.867 15:00:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:56.867 15:00:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 586193 00:05:56.867 15:00:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:56.867 15:00:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:56.867 15:00:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 586193' 00:05:56.867 killing process with pid 586193 00:05:56.867 15:00:57 -- common/autotest_common.sh@955 -- # kill 586193 00:05:56.867 15:00:57 -- common/autotest_common.sh@960 -- # wait 586193 00:05:58.768 15:00:58 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:58.768 15:00:58 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:58.768 15:00:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:58.768 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:05:58.768 15:00:58 -- json_config/json_config.sh@381 -- # return 0 00:05:58.768 15:00:58 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:58.768 INFO: Success 00:05:58.768 00:05:58.768 real 0m16.335s 00:05:58.768 user 0m18.607s 00:05:58.768 sys 0m2.233s 00:05:58.768 15:00:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:58.768 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:05:58.768 ************************************ 00:05:58.768 END TEST json_config 00:05:58.768 ************************************ 00:05:58.768 15:00:58 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:58.768 15:00:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:58.768 15:00:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:58.768 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:05:58.768 ************************************ 00:05:58.768 START TEST json_config_extra_key 00:05:58.768 ************************************ 00:05:58.768 15:00:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:58.768 15:00:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:58.768 15:00:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:58.768 15:00:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:58.768 15:00:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:58.768 15:00:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:58.768 15:00:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:58.768 15:00:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:58.768 15:00:58 -- scripts/common.sh@335 -- # IFS=.-: 00:05:58.768 15:00:58 -- scripts/common.sh@335 -- # read -ra ver1 00:05:58.768 15:00:58 -- scripts/common.sh@336 -- # IFS=.-: 00:05:58.768 15:00:58 -- scripts/common.sh@336 -- # read -ra ver2 00:05:58.768 15:00:58 -- scripts/common.sh@337 -- # local 'op=<' 00:05:58.768 15:00:58 -- scripts/common.sh@339 -- # ver1_l=2 00:05:58.768 15:00:58 -- scripts/common.sh@340 -- # ver2_l=1 00:05:58.768 15:00:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:58.768 15:00:58 -- scripts/common.sh@343 -- # case "$op" in 00:05:58.768 15:00:58 -- scripts/common.sh@344 -- # : 1 00:05:58.768 15:00:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:58.768 15:00:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:58.768 15:00:58 -- scripts/common.sh@364 -- # decimal 1 00:05:58.768 15:00:58 -- scripts/common.sh@352 -- # local d=1 00:05:58.768 15:00:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:58.768 15:00:58 -- scripts/common.sh@354 -- # echo 1 00:05:58.768 15:00:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:58.768 15:00:58 -- scripts/common.sh@365 -- # decimal 2 00:05:58.768 15:00:58 -- scripts/common.sh@352 -- # local d=2 00:05:58.768 15:00:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:58.768 15:00:58 -- scripts/common.sh@354 -- # echo 2 00:05:58.768 15:00:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:58.768 15:00:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:58.768 15:00:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:58.768 15:00:58 -- scripts/common.sh@367 -- # return 0 00:05:58.768 15:00:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:58.768 15:00:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:58.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.768 --rc genhtml_branch_coverage=1 00:05:58.768 --rc genhtml_function_coverage=1 00:05:58.768 --rc genhtml_legend=1 00:05:58.768 --rc geninfo_all_blocks=1 00:05:58.768 --rc geninfo_unexecuted_blocks=1 00:05:58.768 00:05:58.768 ' 00:05:58.768 15:00:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:58.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.768 --rc genhtml_branch_coverage=1 00:05:58.768 --rc genhtml_function_coverage=1 00:05:58.768 --rc genhtml_legend=1 00:05:58.768 --rc geninfo_all_blocks=1 00:05:58.768 --rc geninfo_unexecuted_blocks=1 00:05:58.768 00:05:58.768 ' 00:05:58.768 15:00:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:58.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.768 --rc genhtml_branch_coverage=1 00:05:58.768 --rc genhtml_function_coverage=1 00:05:58.768 --rc genhtml_legend=1 00:05:58.768 --rc geninfo_all_blocks=1 00:05:58.768 --rc geninfo_unexecuted_blocks=1 00:05:58.768 00:05:58.768 ' 00:05:58.768 15:00:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:58.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:58.769 --rc genhtml_branch_coverage=1 00:05:58.769 --rc genhtml_function_coverage=1 00:05:58.769 --rc genhtml_legend=1 00:05:58.769 --rc geninfo_all_blocks=1 00:05:58.769 --rc geninfo_unexecuted_blocks=1 00:05:58.769 00:05:58.769 ' 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:58.769 15:00:58 -- nvmf/common.sh@7 -- # uname -s 00:05:58.769 15:00:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:58.769 15:00:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:58.769 15:00:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:58.769 15:00:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:58.769 15:00:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:58.769 15:00:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:58.769 15:00:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:58.769 15:00:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:58.769 15:00:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:58.769 15:00:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:58.769 15:00:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:58.769 15:00:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:58.769 15:00:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:58.769 15:00:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:58.769 15:00:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:58.769 15:00:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:58.769 15:00:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:58.769 15:00:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:58.769 15:00:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:58.769 15:00:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.769 15:00:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.769 15:00:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.769 15:00:58 -- paths/export.sh@5 -- # export PATH 00:05:58.769 15:00:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:58.769 15:00:58 -- nvmf/common.sh@46 -- # : 0 00:05:58.769 15:00:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:58.769 15:00:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:58.769 15:00:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:58.769 15:00:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:58.769 15:00:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:58.769 15:00:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:58.769 15:00:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:58.769 15:00:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:58.769 INFO: launching applications... 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=587261 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:58.769 Waiting for target to run... 00:05:58.769 15:00:58 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 587261 /var/tmp/spdk_tgt.sock 00:05:58.769 15:00:58 -- common/autotest_common.sh@829 -- # '[' -z 587261 ']' 00:05:58.769 15:00:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:58.769 15:00:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:58.769 15:00:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:58.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:58.769 15:00:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:58.769 15:00:58 -- common/autotest_common.sh@10 -- # set +x 00:05:58.769 [2024-11-28 15:00:58.986889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:05:58.769 [2024-11-28 15:00:58.986958] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid587261 ] 00:05:59.028 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.286 [2024-11-28 15:00:59.335707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.286 [2024-11-28 15:00:59.390531] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:59.286 [2024-11-28 15:00:59.390683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.852 15:00:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.852 15:00:59 -- common/autotest_common.sh@862 -- # return 0 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:59.852 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:59.852 INFO: shutting down applications... 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 587261 ]] 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 587261 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@50 -- # kill -0 587261 00:05:59.852 15:00:59 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@50 -- # kill -0 587261 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@52 -- # break 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:06:00.418 SPDK target shutdown done 00:06:00.418 15:01:00 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:06:00.418 Success 00:06:00.418 00:06:00.418 real 0m1.667s 00:06:00.418 user 0m1.618s 00:06:00.418 sys 0m0.449s 00:06:00.418 15:01:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.418 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:06:00.418 ************************************ 00:06:00.418 END TEST json_config_extra_key 00:06:00.418 ************************************ 00:06:00.418 15:01:00 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:00.418 15:01:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:00.418 15:01:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.418 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:06:00.418 ************************************ 00:06:00.418 START TEST alias_rpc 00:06:00.418 ************************************ 00:06:00.419 15:01:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:06:00.419 * Looking for test storage... 00:06:00.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:06:00.419 15:01:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:00.419 15:01:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:00.419 15:01:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:00.419 15:01:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:00.419 15:01:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:00.419 15:01:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:00.419 15:01:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:00.419 15:01:00 -- scripts/common.sh@335 -- # IFS=.-: 00:06:00.419 15:01:00 -- scripts/common.sh@335 -- # read -ra ver1 00:06:00.419 15:01:00 -- scripts/common.sh@336 -- # IFS=.-: 00:06:00.419 15:01:00 -- scripts/common.sh@336 -- # read -ra ver2 00:06:00.419 15:01:00 -- scripts/common.sh@337 -- # local 'op=<' 00:06:00.419 15:01:00 -- scripts/common.sh@339 -- # ver1_l=2 00:06:00.419 15:01:00 -- scripts/common.sh@340 -- # ver2_l=1 00:06:00.419 15:01:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:00.419 15:01:00 -- scripts/common.sh@343 -- # case "$op" in 00:06:00.419 15:01:00 -- scripts/common.sh@344 -- # : 1 00:06:00.419 15:01:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:00.419 15:01:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:00.419 15:01:00 -- scripts/common.sh@364 -- # decimal 1 00:06:00.419 15:01:00 -- scripts/common.sh@352 -- # local d=1 00:06:00.419 15:01:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:00.419 15:01:00 -- scripts/common.sh@354 -- # echo 1 00:06:00.419 15:01:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:00.419 15:01:00 -- scripts/common.sh@365 -- # decimal 2 00:06:00.419 15:01:00 -- scripts/common.sh@352 -- # local d=2 00:06:00.419 15:01:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:00.419 15:01:00 -- scripts/common.sh@354 -- # echo 2 00:06:00.419 15:01:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:00.419 15:01:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:00.419 15:01:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:00.419 15:01:00 -- scripts/common.sh@367 -- # return 0 00:06:00.419 15:01:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:00.419 15:01:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.419 --rc genhtml_branch_coverage=1 00:06:00.419 --rc genhtml_function_coverage=1 00:06:00.419 --rc genhtml_legend=1 00:06:00.419 --rc geninfo_all_blocks=1 00:06:00.419 --rc geninfo_unexecuted_blocks=1 00:06:00.419 00:06:00.419 ' 00:06:00.419 15:01:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.419 --rc genhtml_branch_coverage=1 00:06:00.419 --rc genhtml_function_coverage=1 00:06:00.419 --rc genhtml_legend=1 00:06:00.419 --rc geninfo_all_blocks=1 00:06:00.419 --rc geninfo_unexecuted_blocks=1 00:06:00.419 00:06:00.419 ' 00:06:00.419 15:01:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.419 --rc genhtml_branch_coverage=1 00:06:00.419 --rc genhtml_function_coverage=1 00:06:00.419 --rc genhtml_legend=1 00:06:00.419 --rc geninfo_all_blocks=1 00:06:00.419 --rc geninfo_unexecuted_blocks=1 00:06:00.419 00:06:00.419 ' 00:06:00.419 15:01:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:00.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:00.419 --rc genhtml_branch_coverage=1 00:06:00.419 --rc genhtml_function_coverage=1 00:06:00.419 --rc genhtml_legend=1 00:06:00.419 --rc geninfo_all_blocks=1 00:06:00.419 --rc geninfo_unexecuted_blocks=1 00:06:00.419 00:06:00.419 ' 00:06:00.419 15:01:00 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:00.419 15:01:00 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=587457 00:06:00.419 15:01:00 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:00.419 15:01:00 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 587457 00:06:00.419 15:01:00 -- common/autotest_common.sh@829 -- # '[' -z 587457 ']' 00:06:00.419 15:01:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:00.419 15:01:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:00.419 15:01:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:00.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:00.419 15:01:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:00.419 15:01:00 -- common/autotest_common.sh@10 -- # set +x 00:06:00.678 [2024-11-28 15:01:00.679998] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:00.678 [2024-11-28 15:01:00.680089] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid587457 ] 00:06:00.678 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.678 [2024-11-28 15:01:00.739288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.678 [2024-11-28 15:01:00.824701] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:00.678 [2024-11-28 15:01:00.824852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.613 15:01:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:01.613 15:01:01 -- common/autotest_common.sh@862 -- # return 0 00:06:01.613 15:01:01 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:06:01.870 15:01:01 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 587457 00:06:01.870 15:01:01 -- common/autotest_common.sh@936 -- # '[' -z 587457 ']' 00:06:01.870 15:01:01 -- common/autotest_common.sh@940 -- # kill -0 587457 00:06:01.870 15:01:01 -- common/autotest_common.sh@941 -- # uname 00:06:01.870 15:01:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:01.870 15:01:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 587457 00:06:01.870 15:01:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:01.870 15:01:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:01.870 15:01:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 587457' 00:06:01.870 killing process with pid 587457 00:06:01.870 15:01:01 -- common/autotest_common.sh@955 -- # kill 587457 00:06:01.870 15:01:01 -- common/autotest_common.sh@960 -- # wait 587457 00:06:02.133 00:06:02.133 real 0m1.851s 00:06:02.133 user 0m2.156s 00:06:02.133 sys 0m0.466s 00:06:02.133 15:01:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.133 15:01:02 -- common/autotest_common.sh@10 -- # set +x 00:06:02.133 ************************************ 00:06:02.133 END TEST alias_rpc 00:06:02.133 ************************************ 00:06:02.133 15:01:02 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:06:02.133 15:01:02 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:02.133 15:01:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:02.133 15:01:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.133 15:01:02 -- common/autotest_common.sh@10 -- # set +x 00:06:02.133 ************************************ 00:06:02.133 START TEST spdkcli_tcp 00:06:02.133 ************************************ 00:06:02.133 15:01:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:06:02.392 * Looking for test storage... 00:06:02.392 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:06:02.392 15:01:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:02.392 15:01:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:02.392 15:01:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:02.392 15:01:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:02.392 15:01:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:02.392 15:01:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:02.392 15:01:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:02.392 15:01:02 -- scripts/common.sh@335 -- # IFS=.-: 00:06:02.392 15:01:02 -- scripts/common.sh@335 -- # read -ra ver1 00:06:02.392 15:01:02 -- scripts/common.sh@336 -- # IFS=.-: 00:06:02.392 15:01:02 -- scripts/common.sh@336 -- # read -ra ver2 00:06:02.392 15:01:02 -- scripts/common.sh@337 -- # local 'op=<' 00:06:02.392 15:01:02 -- scripts/common.sh@339 -- # ver1_l=2 00:06:02.392 15:01:02 -- scripts/common.sh@340 -- # ver2_l=1 00:06:02.392 15:01:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:02.392 15:01:02 -- scripts/common.sh@343 -- # case "$op" in 00:06:02.392 15:01:02 -- scripts/common.sh@344 -- # : 1 00:06:02.392 15:01:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:02.392 15:01:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:02.392 15:01:02 -- scripts/common.sh@364 -- # decimal 1 00:06:02.392 15:01:02 -- scripts/common.sh@352 -- # local d=1 00:06:02.392 15:01:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:02.392 15:01:02 -- scripts/common.sh@354 -- # echo 1 00:06:02.392 15:01:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:02.392 15:01:02 -- scripts/common.sh@365 -- # decimal 2 00:06:02.392 15:01:02 -- scripts/common.sh@352 -- # local d=2 00:06:02.392 15:01:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:02.392 15:01:02 -- scripts/common.sh@354 -- # echo 2 00:06:02.392 15:01:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:02.392 15:01:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:02.392 15:01:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:02.392 15:01:02 -- scripts/common.sh@367 -- # return 0 00:06:02.392 15:01:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:02.392 15:01:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:02.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.392 --rc genhtml_branch_coverage=1 00:06:02.392 --rc genhtml_function_coverage=1 00:06:02.392 --rc genhtml_legend=1 00:06:02.392 --rc geninfo_all_blocks=1 00:06:02.392 --rc geninfo_unexecuted_blocks=1 00:06:02.392 00:06:02.392 ' 00:06:02.392 15:01:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:02.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.392 --rc genhtml_branch_coverage=1 00:06:02.392 --rc genhtml_function_coverage=1 00:06:02.392 --rc genhtml_legend=1 00:06:02.392 --rc geninfo_all_blocks=1 00:06:02.392 --rc geninfo_unexecuted_blocks=1 00:06:02.392 00:06:02.392 ' 00:06:02.392 15:01:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:02.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.392 --rc genhtml_branch_coverage=1 00:06:02.392 --rc genhtml_function_coverage=1 00:06:02.392 --rc genhtml_legend=1 00:06:02.392 --rc geninfo_all_blocks=1 00:06:02.392 --rc geninfo_unexecuted_blocks=1 00:06:02.392 00:06:02.392 ' 00:06:02.392 15:01:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:02.392 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:02.392 --rc genhtml_branch_coverage=1 00:06:02.392 --rc genhtml_function_coverage=1 00:06:02.392 --rc genhtml_legend=1 00:06:02.392 --rc geninfo_all_blocks=1 00:06:02.392 --rc geninfo_unexecuted_blocks=1 00:06:02.392 00:06:02.392 ' 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:06:02.392 15:01:02 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:06:02.392 15:01:02 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:06:02.392 15:01:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:02.392 15:01:02 -- common/autotest_common.sh@10 -- # set +x 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=587790 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:06:02.392 15:01:02 -- spdkcli/tcp.sh@27 -- # waitforlisten 587790 00:06:02.392 15:01:02 -- common/autotest_common.sh@829 -- # '[' -z 587790 ']' 00:06:02.392 15:01:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:02.392 15:01:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:02.392 15:01:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:02.392 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:02.392 15:01:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:02.392 15:01:02 -- common/autotest_common.sh@10 -- # set +x 00:06:02.392 [2024-11-28 15:01:02.552090] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:02.392 [2024-11-28 15:01:02.552197] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid587790 ] 00:06:02.392 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.392 [2024-11-28 15:01:02.609645] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:02.650 [2024-11-28 15:01:02.690420] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:02.650 [2024-11-28 15:01:02.690611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:02.650 [2024-11-28 15:01:02.690616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.585 15:01:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:03.585 15:01:03 -- common/autotest_common.sh@862 -- # return 0 00:06:03.585 15:01:03 -- spdkcli/tcp.sh@31 -- # socat_pid=587930 00:06:03.585 15:01:03 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:06:03.585 15:01:03 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:06:03.585 [ 00:06:03.585 "bdev_malloc_delete", 00:06:03.585 "bdev_malloc_create", 00:06:03.585 "bdev_null_resize", 00:06:03.585 "bdev_null_delete", 00:06:03.585 "bdev_null_create", 00:06:03.585 "bdev_nvme_cuse_unregister", 00:06:03.585 "bdev_nvme_cuse_register", 00:06:03.585 "bdev_opal_new_user", 00:06:03.585 "bdev_opal_set_lock_state", 00:06:03.585 "bdev_opal_delete", 00:06:03.585 "bdev_opal_get_info", 00:06:03.585 "bdev_opal_create", 00:06:03.585 "bdev_nvme_opal_revert", 00:06:03.585 "bdev_nvme_opal_init", 00:06:03.585 "bdev_nvme_send_cmd", 00:06:03.585 "bdev_nvme_get_path_iostat", 00:06:03.585 "bdev_nvme_get_mdns_discovery_info", 00:06:03.585 "bdev_nvme_stop_mdns_discovery", 00:06:03.585 "bdev_nvme_start_mdns_discovery", 00:06:03.585 "bdev_nvme_set_multipath_policy", 00:06:03.585 "bdev_nvme_set_preferred_path", 00:06:03.585 "bdev_nvme_get_io_paths", 00:06:03.585 "bdev_nvme_remove_error_injection", 00:06:03.585 "bdev_nvme_add_error_injection", 00:06:03.585 "bdev_nvme_get_discovery_info", 00:06:03.585 "bdev_nvme_stop_discovery", 00:06:03.585 "bdev_nvme_start_discovery", 00:06:03.585 "bdev_nvme_get_controller_health_info", 00:06:03.585 "bdev_nvme_disable_controller", 00:06:03.585 "bdev_nvme_enable_controller", 00:06:03.585 "bdev_nvme_reset_controller", 00:06:03.586 "bdev_nvme_get_transport_statistics", 00:06:03.586 "bdev_nvme_apply_firmware", 00:06:03.586 "bdev_nvme_detach_controller", 00:06:03.586 "bdev_nvme_get_controllers", 00:06:03.586 "bdev_nvme_attach_controller", 00:06:03.586 "bdev_nvme_set_hotplug", 00:06:03.586 "bdev_nvme_set_options", 00:06:03.586 "bdev_passthru_delete", 00:06:03.586 "bdev_passthru_create", 00:06:03.586 "bdev_lvol_grow_lvstore", 00:06:03.586 "bdev_lvol_get_lvols", 00:06:03.586 "bdev_lvol_get_lvstores", 00:06:03.586 "bdev_lvol_delete", 00:06:03.586 "bdev_lvol_set_read_only", 00:06:03.586 "bdev_lvol_resize", 00:06:03.586 "bdev_lvol_decouple_parent", 00:06:03.586 "bdev_lvol_inflate", 00:06:03.586 "bdev_lvol_rename", 00:06:03.586 "bdev_lvol_clone_bdev", 00:06:03.586 "bdev_lvol_clone", 00:06:03.586 "bdev_lvol_snapshot", 00:06:03.586 "bdev_lvol_create", 00:06:03.586 "bdev_lvol_delete_lvstore", 00:06:03.586 "bdev_lvol_rename_lvstore", 00:06:03.586 "bdev_lvol_create_lvstore", 00:06:03.586 "bdev_raid_set_options", 00:06:03.586 "bdev_raid_remove_base_bdev", 00:06:03.586 "bdev_raid_add_base_bdev", 00:06:03.586 "bdev_raid_delete", 00:06:03.586 "bdev_raid_create", 00:06:03.586 "bdev_raid_get_bdevs", 00:06:03.586 "bdev_error_inject_error", 00:06:03.586 "bdev_error_delete", 00:06:03.586 "bdev_error_create", 00:06:03.586 "bdev_split_delete", 00:06:03.586 "bdev_split_create", 00:06:03.586 "bdev_delay_delete", 00:06:03.586 "bdev_delay_create", 00:06:03.586 "bdev_delay_update_latency", 00:06:03.586 "bdev_zone_block_delete", 00:06:03.586 "bdev_zone_block_create", 00:06:03.586 "blobfs_create", 00:06:03.586 "blobfs_detect", 00:06:03.586 "blobfs_set_cache_size", 00:06:03.586 "bdev_aio_delete", 00:06:03.586 "bdev_aio_rescan", 00:06:03.586 "bdev_aio_create", 00:06:03.586 "bdev_ftl_set_property", 00:06:03.586 "bdev_ftl_get_properties", 00:06:03.586 "bdev_ftl_get_stats", 00:06:03.586 "bdev_ftl_unmap", 00:06:03.586 "bdev_ftl_unload", 00:06:03.586 "bdev_ftl_delete", 00:06:03.586 "bdev_ftl_load", 00:06:03.586 "bdev_ftl_create", 00:06:03.586 "bdev_virtio_attach_controller", 00:06:03.586 "bdev_virtio_scsi_get_devices", 00:06:03.586 "bdev_virtio_detach_controller", 00:06:03.586 "bdev_virtio_blk_set_hotplug", 00:06:03.586 "bdev_iscsi_delete", 00:06:03.586 "bdev_iscsi_create", 00:06:03.586 "bdev_iscsi_set_options", 00:06:03.586 "accel_error_inject_error", 00:06:03.586 "ioat_scan_accel_module", 00:06:03.586 "dsa_scan_accel_module", 00:06:03.586 "iaa_scan_accel_module", 00:06:03.586 "vfu_virtio_create_scsi_endpoint", 00:06:03.586 "vfu_virtio_scsi_remove_target", 00:06:03.586 "vfu_virtio_scsi_add_target", 00:06:03.586 "vfu_virtio_create_blk_endpoint", 00:06:03.586 "vfu_virtio_delete_endpoint", 00:06:03.586 "iscsi_set_options", 00:06:03.586 "iscsi_get_auth_groups", 00:06:03.586 "iscsi_auth_group_remove_secret", 00:06:03.586 "iscsi_auth_group_add_secret", 00:06:03.586 "iscsi_delete_auth_group", 00:06:03.586 "iscsi_create_auth_group", 00:06:03.586 "iscsi_set_discovery_auth", 00:06:03.586 "iscsi_get_options", 00:06:03.586 "iscsi_target_node_request_logout", 00:06:03.586 "iscsi_target_node_set_redirect", 00:06:03.586 "iscsi_target_node_set_auth", 00:06:03.586 "iscsi_target_node_add_lun", 00:06:03.586 "iscsi_get_connections", 00:06:03.586 "iscsi_portal_group_set_auth", 00:06:03.586 "iscsi_start_portal_group", 00:06:03.586 "iscsi_delete_portal_group", 00:06:03.586 "iscsi_create_portal_group", 00:06:03.586 "iscsi_get_portal_groups", 00:06:03.586 "iscsi_delete_target_node", 00:06:03.586 "iscsi_target_node_remove_pg_ig_maps", 00:06:03.586 "iscsi_target_node_add_pg_ig_maps", 00:06:03.586 "iscsi_create_target_node", 00:06:03.586 "iscsi_get_target_nodes", 00:06:03.586 "iscsi_delete_initiator_group", 00:06:03.586 "iscsi_initiator_group_remove_initiators", 00:06:03.586 "iscsi_initiator_group_add_initiators", 00:06:03.586 "iscsi_create_initiator_group", 00:06:03.586 "iscsi_get_initiator_groups", 00:06:03.586 "nvmf_set_crdt", 00:06:03.586 "nvmf_set_config", 00:06:03.586 "nvmf_set_max_subsystems", 00:06:03.586 "nvmf_subsystem_get_listeners", 00:06:03.586 "nvmf_subsystem_get_qpairs", 00:06:03.586 "nvmf_subsystem_get_controllers", 00:06:03.586 "nvmf_get_stats", 00:06:03.586 "nvmf_get_transports", 00:06:03.586 "nvmf_create_transport", 00:06:03.586 "nvmf_get_targets", 00:06:03.586 "nvmf_delete_target", 00:06:03.586 "nvmf_create_target", 00:06:03.586 "nvmf_subsystem_allow_any_host", 00:06:03.586 "nvmf_subsystem_remove_host", 00:06:03.586 "nvmf_subsystem_add_host", 00:06:03.586 "nvmf_subsystem_remove_ns", 00:06:03.586 "nvmf_subsystem_add_ns", 00:06:03.586 "nvmf_subsystem_listener_set_ana_state", 00:06:03.586 "nvmf_discovery_get_referrals", 00:06:03.586 "nvmf_discovery_remove_referral", 00:06:03.586 "nvmf_discovery_add_referral", 00:06:03.586 "nvmf_subsystem_remove_listener", 00:06:03.586 "nvmf_subsystem_add_listener", 00:06:03.586 "nvmf_delete_subsystem", 00:06:03.586 "nvmf_create_subsystem", 00:06:03.586 "nvmf_get_subsystems", 00:06:03.586 "env_dpdk_get_mem_stats", 00:06:03.586 "nbd_get_disks", 00:06:03.586 "nbd_stop_disk", 00:06:03.586 "nbd_start_disk", 00:06:03.586 "ublk_recover_disk", 00:06:03.586 "ublk_get_disks", 00:06:03.586 "ublk_stop_disk", 00:06:03.586 "ublk_start_disk", 00:06:03.586 "ublk_destroy_target", 00:06:03.586 "ublk_create_target", 00:06:03.586 "virtio_blk_create_transport", 00:06:03.586 "virtio_blk_get_transports", 00:06:03.586 "vhost_controller_set_coalescing", 00:06:03.586 "vhost_get_controllers", 00:06:03.586 "vhost_delete_controller", 00:06:03.586 "vhost_create_blk_controller", 00:06:03.586 "vhost_scsi_controller_remove_target", 00:06:03.586 "vhost_scsi_controller_add_target", 00:06:03.586 "vhost_start_scsi_controller", 00:06:03.586 "vhost_create_scsi_controller", 00:06:03.586 "thread_set_cpumask", 00:06:03.586 "framework_get_scheduler", 00:06:03.586 "framework_set_scheduler", 00:06:03.586 "framework_get_reactors", 00:06:03.586 "thread_get_io_channels", 00:06:03.586 "thread_get_pollers", 00:06:03.586 "thread_get_stats", 00:06:03.586 "framework_monitor_context_switch", 00:06:03.586 "spdk_kill_instance", 00:06:03.586 "log_enable_timestamps", 00:06:03.586 "log_get_flags", 00:06:03.586 "log_clear_flag", 00:06:03.586 "log_set_flag", 00:06:03.586 "log_get_level", 00:06:03.586 "log_set_level", 00:06:03.586 "log_get_print_level", 00:06:03.586 "log_set_print_level", 00:06:03.586 "framework_enable_cpumask_locks", 00:06:03.586 "framework_disable_cpumask_locks", 00:06:03.586 "framework_wait_init", 00:06:03.586 "framework_start_init", 00:06:03.586 "scsi_get_devices", 00:06:03.586 "bdev_get_histogram", 00:06:03.586 "bdev_enable_histogram", 00:06:03.586 "bdev_set_qos_limit", 00:06:03.586 "bdev_set_qd_sampling_period", 00:06:03.586 "bdev_get_bdevs", 00:06:03.586 "bdev_reset_iostat", 00:06:03.586 "bdev_get_iostat", 00:06:03.586 "bdev_examine", 00:06:03.586 "bdev_wait_for_examine", 00:06:03.586 "bdev_set_options", 00:06:03.586 "notify_get_notifications", 00:06:03.586 "notify_get_types", 00:06:03.586 "accel_get_stats", 00:06:03.586 "accel_set_options", 00:06:03.586 "accel_set_driver", 00:06:03.586 "accel_crypto_key_destroy", 00:06:03.586 "accel_crypto_keys_get", 00:06:03.586 "accel_crypto_key_create", 00:06:03.586 "accel_assign_opc", 00:06:03.586 "accel_get_module_info", 00:06:03.586 "accel_get_opc_assignments", 00:06:03.586 "vmd_rescan", 00:06:03.586 "vmd_remove_device", 00:06:03.586 "vmd_enable", 00:06:03.586 "sock_set_default_impl", 00:06:03.586 "sock_impl_set_options", 00:06:03.586 "sock_impl_get_options", 00:06:03.586 "iobuf_get_stats", 00:06:03.586 "iobuf_set_options", 00:06:03.586 "framework_get_pci_devices", 00:06:03.586 "framework_get_config", 00:06:03.586 "framework_get_subsystems", 00:06:03.586 "vfu_tgt_set_base_path", 00:06:03.586 "trace_get_info", 00:06:03.586 "trace_get_tpoint_group_mask", 00:06:03.586 "trace_disable_tpoint_group", 00:06:03.586 "trace_enable_tpoint_group", 00:06:03.586 "trace_clear_tpoint_mask", 00:06:03.586 "trace_set_tpoint_mask", 00:06:03.586 "spdk_get_version", 00:06:03.586 "rpc_get_methods" 00:06:03.586 ] 00:06:03.586 15:01:03 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:06:03.586 15:01:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:03.586 15:01:03 -- common/autotest_common.sh@10 -- # set +x 00:06:03.586 15:01:03 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:06:03.586 15:01:03 -- spdkcli/tcp.sh@38 -- # killprocess 587790 00:06:03.586 15:01:03 -- common/autotest_common.sh@936 -- # '[' -z 587790 ']' 00:06:03.586 15:01:03 -- common/autotest_common.sh@940 -- # kill -0 587790 00:06:03.586 15:01:03 -- common/autotest_common.sh@941 -- # uname 00:06:03.586 15:01:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:03.586 15:01:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 587790 00:06:03.844 15:01:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:03.844 15:01:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:03.844 15:01:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 587790' 00:06:03.844 killing process with pid 587790 00:06:03.844 15:01:03 -- common/autotest_common.sh@955 -- # kill 587790 00:06:03.844 15:01:03 -- common/autotest_common.sh@960 -- # wait 587790 00:06:04.102 00:06:04.102 real 0m1.842s 00:06:04.102 user 0m3.574s 00:06:04.102 sys 0m0.491s 00:06:04.102 15:01:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.102 15:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:04.102 ************************************ 00:06:04.102 END TEST spdkcli_tcp 00:06:04.102 ************************************ 00:06:04.102 15:01:04 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:04.102 15:01:04 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.102 15:01:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.102 15:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:04.102 ************************************ 00:06:04.102 START TEST dpdk_mem_utility 00:06:04.102 ************************************ 00:06:04.102 15:01:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:06:04.102 * Looking for test storage... 00:06:04.102 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:06:04.102 15:01:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.102 15:01:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.102 15:01:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.360 15:01:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.360 15:01:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.360 15:01:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.360 15:01:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.360 15:01:04 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.360 15:01:04 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.360 15:01:04 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.360 15:01:04 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.360 15:01:04 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.360 15:01:04 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.360 15:01:04 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.360 15:01:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.360 15:01:04 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.360 15:01:04 -- scripts/common.sh@344 -- # : 1 00:06:04.360 15:01:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.360 15:01:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.360 15:01:04 -- scripts/common.sh@364 -- # decimal 1 00:06:04.360 15:01:04 -- scripts/common.sh@352 -- # local d=1 00:06:04.360 15:01:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.360 15:01:04 -- scripts/common.sh@354 -- # echo 1 00:06:04.360 15:01:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.360 15:01:04 -- scripts/common.sh@365 -- # decimal 2 00:06:04.360 15:01:04 -- scripts/common.sh@352 -- # local d=2 00:06:04.360 15:01:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.360 15:01:04 -- scripts/common.sh@354 -- # echo 2 00:06:04.360 15:01:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.360 15:01:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.360 15:01:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.360 15:01:04 -- scripts/common.sh@367 -- # return 0 00:06:04.360 15:01:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.360 15:01:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.360 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.360 --rc genhtml_branch_coverage=1 00:06:04.360 --rc genhtml_function_coverage=1 00:06:04.360 --rc genhtml_legend=1 00:06:04.360 --rc geninfo_all_blocks=1 00:06:04.360 --rc geninfo_unexecuted_blocks=1 00:06:04.360 00:06:04.360 ' 00:06:04.360 15:01:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.360 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.360 --rc genhtml_branch_coverage=1 00:06:04.360 --rc genhtml_function_coverage=1 00:06:04.360 --rc genhtml_legend=1 00:06:04.360 --rc geninfo_all_blocks=1 00:06:04.360 --rc geninfo_unexecuted_blocks=1 00:06:04.360 00:06:04.360 ' 00:06:04.360 15:01:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.360 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.360 --rc genhtml_branch_coverage=1 00:06:04.360 --rc genhtml_function_coverage=1 00:06:04.360 --rc genhtml_legend=1 00:06:04.360 --rc geninfo_all_blocks=1 00:06:04.360 --rc geninfo_unexecuted_blocks=1 00:06:04.360 00:06:04.360 ' 00:06:04.360 15:01:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.360 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.360 --rc genhtml_branch_coverage=1 00:06:04.360 --rc genhtml_function_coverage=1 00:06:04.360 --rc genhtml_legend=1 00:06:04.360 --rc geninfo_all_blocks=1 00:06:04.360 --rc geninfo_unexecuted_blocks=1 00:06:04.360 00:06:04.360 ' 00:06:04.360 15:01:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:04.360 15:01:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=588014 00:06:04.360 15:01:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:06:04.360 15:01:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 588014 00:06:04.360 15:01:04 -- common/autotest_common.sh@829 -- # '[' -z 588014 ']' 00:06:04.360 15:01:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:04.360 15:01:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:04.360 15:01:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:04.360 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:04.360 15:01:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:04.360 15:01:04 -- common/autotest_common.sh@10 -- # set +x 00:06:04.360 [2024-11-28 15:01:04.424343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:04.361 [2024-11-28 15:01:04.424461] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid588014 ] 00:06:04.361 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.361 [2024-11-28 15:01:04.484964] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.361 [2024-11-28 15:01:04.571413] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:04.361 [2024-11-28 15:01:04.571589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:05.295 15:01:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:05.295 15:01:05 -- common/autotest_common.sh@862 -- # return 0 00:06:05.295 15:01:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:06:05.295 15:01:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:06:05.295 15:01:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:05.295 15:01:05 -- common/autotest_common.sh@10 -- # set +x 00:06:05.295 { 00:06:05.295 "filename": "/tmp/spdk_mem_dump.txt" 00:06:05.295 } 00:06:05.295 15:01:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:05.295 15:01:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:06:05.295 DPDK memory size 814.000000 MiB in 1 heap(s) 00:06:05.295 1 heaps totaling size 814.000000 MiB 00:06:05.295 size: 814.000000 MiB heap id: 0 00:06:05.295 end heaps---------- 00:06:05.295 8 mempools totaling size 598.116089 MiB 00:06:05.295 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:06:05.295 size: 158.602051 MiB name: PDU_data_out_Pool 00:06:05.295 size: 84.521057 MiB name: bdev_io_588014 00:06:05.295 size: 51.011292 MiB name: evtpool_588014 00:06:05.295 size: 50.003479 MiB name: msgpool_588014 00:06:05.295 size: 21.763794 MiB name: PDU_Pool 00:06:05.295 size: 19.513306 MiB name: SCSI_TASK_Pool 00:06:05.295 size: 0.026123 MiB name: Session_Pool 00:06:05.295 end mempools------- 00:06:05.295 6 memzones totaling size 4.142822 MiB 00:06:05.295 size: 1.000366 MiB name: RG_ring_0_588014 00:06:05.295 size: 1.000366 MiB name: RG_ring_1_588014 00:06:05.295 size: 1.000366 MiB name: RG_ring_4_588014 00:06:05.295 size: 1.000366 MiB name: RG_ring_5_588014 00:06:05.295 size: 0.125366 MiB name: RG_ring_2_588014 00:06:05.295 size: 0.015991 MiB name: RG_ring_3_588014 00:06:05.295 end memzones------- 00:06:05.295 15:01:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:06:05.295 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:06:05.295 list of free elements. size: 12.519348 MiB 00:06:05.295 element at address: 0x200000400000 with size: 1.999512 MiB 00:06:05.295 element at address: 0x200018e00000 with size: 0.999878 MiB 00:06:05.295 element at address: 0x200019000000 with size: 0.999878 MiB 00:06:05.295 element at address: 0x200003e00000 with size: 0.996277 MiB 00:06:05.295 element at address: 0x200031c00000 with size: 0.994446 MiB 00:06:05.295 element at address: 0x200013800000 with size: 0.978699 MiB 00:06:05.295 element at address: 0x200007000000 with size: 0.959839 MiB 00:06:05.295 element at address: 0x200019200000 with size: 0.936584 MiB 00:06:05.295 element at address: 0x200000200000 with size: 0.841614 MiB 00:06:05.295 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:06:05.295 element at address: 0x20000b200000 with size: 0.490723 MiB 00:06:05.295 element at address: 0x200000800000 with size: 0.487793 MiB 00:06:05.295 element at address: 0x200019400000 with size: 0.485657 MiB 00:06:05.295 element at address: 0x200027e00000 with size: 0.410034 MiB 00:06:05.295 element at address: 0x200003a00000 with size: 0.355530 MiB 00:06:05.295 list of standard malloc elements. size: 199.218079 MiB 00:06:05.295 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:06:05.295 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:06:05.295 element at address: 0x200018efff80 with size: 1.000122 MiB 00:06:05.295 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:06:05.295 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:06:05.295 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:06:05.295 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:06:05.295 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:06:05.295 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:06:05.295 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:06:05.295 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:06:05.295 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003adb300 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003adb500 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003affa80 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003affb40 with size: 0.000183 MiB 00:06:05.295 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:06:05.295 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:06:05.295 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:06:05.296 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:06:05.296 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:06:05.296 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:06:05.296 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:06:05.296 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:06:05.296 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:06:05.296 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:06:05.296 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:06:05.296 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:06:05.296 element at address: 0x200027e69040 with size: 0.000183 MiB 00:06:05.296 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:06:05.296 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:06:05.296 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:06:05.296 list of memzone associated elements. size: 602.262573 MiB 00:06:05.296 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:06:05.296 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:06:05.296 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:06:05.296 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:06:05.296 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:06:05.296 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_588014_0 00:06:05.296 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:06:05.296 associated memzone info: size: 48.002930 MiB name: MP_evtpool_588014_0 00:06:05.296 element at address: 0x200003fff380 with size: 48.003052 MiB 00:06:05.296 associated memzone info: size: 48.002930 MiB name: MP_msgpool_588014_0 00:06:05.296 element at address: 0x2000195be940 with size: 20.255554 MiB 00:06:05.296 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:06:05.296 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:06:05.296 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:06:05.296 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:06:05.296 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_588014 00:06:05.296 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:06:05.296 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_588014 00:06:05.296 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:06:05.296 associated memzone info: size: 1.007996 MiB name: MP_evtpool_588014 00:06:05.296 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:06:05.296 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:06:05.296 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:06:05.296 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:06:05.296 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:06:05.296 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:06:05.296 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:06:05.296 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:06:05.296 element at address: 0x200003eff180 with size: 1.000488 MiB 00:06:05.296 associated memzone info: size: 1.000366 MiB name: RG_ring_0_588014 00:06:05.296 element at address: 0x200003affc00 with size: 1.000488 MiB 00:06:05.296 associated memzone info: size: 1.000366 MiB name: RG_ring_1_588014 00:06:05.296 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:06:05.296 associated memzone info: size: 1.000366 MiB name: RG_ring_4_588014 00:06:05.296 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:06:05.296 associated memzone info: size: 1.000366 MiB name: RG_ring_5_588014 00:06:05.296 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:06:05.296 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_588014 00:06:05.296 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:06:05.296 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:06:05.296 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:06:05.296 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:06:05.296 element at address: 0x20001947c540 with size: 0.250488 MiB 00:06:05.296 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:06:05.296 element at address: 0x200003adf880 with size: 0.125488 MiB 00:06:05.296 associated memzone info: size: 0.125366 MiB name: RG_ring_2_588014 00:06:05.296 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:06:05.296 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:06:05.296 element at address: 0x200027e69100 with size: 0.023743 MiB 00:06:05.296 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:06:05.296 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:06:05.296 associated memzone info: size: 0.015991 MiB name: RG_ring_3_588014 00:06:05.296 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:06:05.296 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:06:05.296 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:06:05.296 associated memzone info: size: 0.000183 MiB name: MP_msgpool_588014 00:06:05.296 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:06:05.296 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_588014 00:06:05.296 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:06:05.296 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:06:05.296 15:01:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:06:05.296 15:01:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 588014 00:06:05.296 15:01:05 -- common/autotest_common.sh@936 -- # '[' -z 588014 ']' 00:06:05.296 15:01:05 -- common/autotest_common.sh@940 -- # kill -0 588014 00:06:05.296 15:01:05 -- common/autotest_common.sh@941 -- # uname 00:06:05.296 15:01:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:05.296 15:01:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 588014 00:06:05.554 15:01:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:05.554 15:01:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:05.554 15:01:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 588014' 00:06:05.554 killing process with pid 588014 00:06:05.554 15:01:05 -- common/autotest_common.sh@955 -- # kill 588014 00:06:05.554 15:01:05 -- common/autotest_common.sh@960 -- # wait 588014 00:06:05.813 00:06:05.813 real 0m1.665s 00:06:05.813 user 0m1.867s 00:06:05.813 sys 0m0.435s 00:06:05.813 15:01:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.813 15:01:05 -- common/autotest_common.sh@10 -- # set +x 00:06:05.813 ************************************ 00:06:05.813 END TEST dpdk_mem_utility 00:06:05.813 ************************************ 00:06:05.813 15:01:05 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:05.813 15:01:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:05.813 15:01:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.813 15:01:05 -- common/autotest_common.sh@10 -- # set +x 00:06:05.813 ************************************ 00:06:05.813 START TEST event 00:06:05.813 ************************************ 00:06:05.813 15:01:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:06:05.813 * Looking for test storage... 00:06:05.813 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:05.813 15:01:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:05.813 15:01:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:05.813 15:01:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:06.072 15:01:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:06.072 15:01:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:06.072 15:01:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:06.072 15:01:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:06.072 15:01:06 -- scripts/common.sh@335 -- # IFS=.-: 00:06:06.072 15:01:06 -- scripts/common.sh@335 -- # read -ra ver1 00:06:06.072 15:01:06 -- scripts/common.sh@336 -- # IFS=.-: 00:06:06.072 15:01:06 -- scripts/common.sh@336 -- # read -ra ver2 00:06:06.072 15:01:06 -- scripts/common.sh@337 -- # local 'op=<' 00:06:06.072 15:01:06 -- scripts/common.sh@339 -- # ver1_l=2 00:06:06.072 15:01:06 -- scripts/common.sh@340 -- # ver2_l=1 00:06:06.072 15:01:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:06.072 15:01:06 -- scripts/common.sh@343 -- # case "$op" in 00:06:06.072 15:01:06 -- scripts/common.sh@344 -- # : 1 00:06:06.072 15:01:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:06.072 15:01:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:06.072 15:01:06 -- scripts/common.sh@364 -- # decimal 1 00:06:06.072 15:01:06 -- scripts/common.sh@352 -- # local d=1 00:06:06.072 15:01:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:06.072 15:01:06 -- scripts/common.sh@354 -- # echo 1 00:06:06.072 15:01:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:06.072 15:01:06 -- scripts/common.sh@365 -- # decimal 2 00:06:06.072 15:01:06 -- scripts/common.sh@352 -- # local d=2 00:06:06.072 15:01:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:06.072 15:01:06 -- scripts/common.sh@354 -- # echo 2 00:06:06.072 15:01:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:06.072 15:01:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:06.072 15:01:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:06.072 15:01:06 -- scripts/common.sh@367 -- # return 0 00:06:06.072 15:01:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:06.072 15:01:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:06.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.072 --rc genhtml_branch_coverage=1 00:06:06.072 --rc genhtml_function_coverage=1 00:06:06.072 --rc genhtml_legend=1 00:06:06.072 --rc geninfo_all_blocks=1 00:06:06.072 --rc geninfo_unexecuted_blocks=1 00:06:06.072 00:06:06.072 ' 00:06:06.072 15:01:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:06.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.072 --rc genhtml_branch_coverage=1 00:06:06.072 --rc genhtml_function_coverage=1 00:06:06.072 --rc genhtml_legend=1 00:06:06.072 --rc geninfo_all_blocks=1 00:06:06.072 --rc geninfo_unexecuted_blocks=1 00:06:06.072 00:06:06.072 ' 00:06:06.072 15:01:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:06.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.072 --rc genhtml_branch_coverage=1 00:06:06.072 --rc genhtml_function_coverage=1 00:06:06.072 --rc genhtml_legend=1 00:06:06.072 --rc geninfo_all_blocks=1 00:06:06.072 --rc geninfo_unexecuted_blocks=1 00:06:06.072 00:06:06.072 ' 00:06:06.072 15:01:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:06.072 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:06.072 --rc genhtml_branch_coverage=1 00:06:06.072 --rc genhtml_function_coverage=1 00:06:06.072 --rc genhtml_legend=1 00:06:06.072 --rc geninfo_all_blocks=1 00:06:06.072 --rc geninfo_unexecuted_blocks=1 00:06:06.072 00:06:06.072 ' 00:06:06.072 15:01:06 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:06:06.072 15:01:06 -- bdev/nbd_common.sh@6 -- # set -e 00:06:06.072 15:01:06 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:06.072 15:01:06 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:06.072 15:01:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.072 15:01:06 -- common/autotest_common.sh@10 -- # set +x 00:06:06.072 ************************************ 00:06:06.072 START TEST event_perf 00:06:06.072 ************************************ 00:06:06.072 15:01:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:06:06.072 Running I/O for 1 seconds...[2024-11-28 15:01:06.093276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:06.072 [2024-11-28 15:01:06.093346] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid588341 ] 00:06:06.072 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.072 [2024-11-28 15:01:06.149163] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:06.072 [2024-11-28 15:01:06.230265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:06.072 [2024-11-28 15:01:06.230323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:06.072 [2024-11-28 15:01:06.230387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:06.072 [2024-11-28 15:01:06.230390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.447 Running I/O for 1 seconds... 00:06:07.447 lcore 0: 233953 00:06:07.447 lcore 1: 233950 00:06:07.447 lcore 2: 233950 00:06:07.447 lcore 3: 233952 00:06:07.447 done. 00:06:07.447 00:06:07.447 real 0m1.228s 00:06:07.447 user 0m4.146s 00:06:07.447 sys 0m0.077s 00:06:07.447 15:01:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.447 15:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:07.447 ************************************ 00:06:07.447 END TEST event_perf 00:06:07.447 ************************************ 00:06:07.447 15:01:07 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:07.447 15:01:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:07.447 15:01:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.447 15:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:07.447 ************************************ 00:06:07.447 START TEST event_reactor 00:06:07.447 ************************************ 00:06:07.447 15:01:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:07.447 [2024-11-28 15:01:07.346069] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:07.447 [2024-11-28 15:01:07.346181] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid588500 ] 00:06:07.447 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.447 [2024-11-28 15:01:07.401752] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.447 [2024-11-28 15:01:07.482705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:08.382 test_start 00:06:08.382 oneshot 00:06:08.382 tick 100 00:06:08.382 tick 100 00:06:08.382 tick 250 00:06:08.382 tick 100 00:06:08.382 tick 100 00:06:08.382 tick 100 00:06:08.382 tick 250 00:06:08.382 tick 500 00:06:08.382 tick 100 00:06:08.382 tick 100 00:06:08.382 tick 250 00:06:08.382 tick 100 00:06:08.382 tick 100 00:06:08.382 test_end 00:06:08.382 00:06:08.382 real 0m1.225s 00:06:08.382 user 0m1.146s 00:06:08.382 sys 0m0.073s 00:06:08.382 15:01:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.382 15:01:08 -- common/autotest_common.sh@10 -- # set +x 00:06:08.382 ************************************ 00:06:08.382 END TEST event_reactor 00:06:08.382 ************************************ 00:06:08.382 15:01:08 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:08.382 15:01:08 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:08.382 15:01:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.382 15:01:08 -- common/autotest_common.sh@10 -- # set +x 00:06:08.382 ************************************ 00:06:08.382 START TEST event_reactor_perf 00:06:08.382 ************************************ 00:06:08.382 15:01:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:08.382 [2024-11-28 15:01:08.598501] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:08.382 [2024-11-28 15:01:08.598582] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid588654 ] 00:06:08.640 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.640 [2024-11-28 15:01:08.655302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.640 [2024-11-28 15:01:08.736796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.014 test_start 00:06:10.014 test_end 00:06:10.014 Performance: 444839 events per second 00:06:10.014 00:06:10.014 real 0m1.226s 00:06:10.014 user 0m1.139s 00:06:10.014 sys 0m0.082s 00:06:10.014 15:01:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.014 15:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:10.014 ************************************ 00:06:10.014 END TEST event_reactor_perf 00:06:10.014 ************************************ 00:06:10.014 15:01:09 -- event/event.sh@49 -- # uname -s 00:06:10.014 15:01:09 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:10.014 15:01:09 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:10.014 15:01:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:10.014 15:01:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.014 15:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:10.014 ************************************ 00:06:10.014 START TEST event_scheduler 00:06:10.014 ************************************ 00:06:10.014 15:01:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:10.014 * Looking for test storage... 00:06:10.014 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:10.014 15:01:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:10.014 15:01:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:10.014 15:01:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:10.014 15:01:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:10.014 15:01:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:10.014 15:01:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:10.014 15:01:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:10.014 15:01:09 -- scripts/common.sh@335 -- # IFS=.-: 00:06:10.015 15:01:09 -- scripts/common.sh@335 -- # read -ra ver1 00:06:10.015 15:01:09 -- scripts/common.sh@336 -- # IFS=.-: 00:06:10.015 15:01:09 -- scripts/common.sh@336 -- # read -ra ver2 00:06:10.015 15:01:09 -- scripts/common.sh@337 -- # local 'op=<' 00:06:10.015 15:01:09 -- scripts/common.sh@339 -- # ver1_l=2 00:06:10.015 15:01:09 -- scripts/common.sh@340 -- # ver2_l=1 00:06:10.015 15:01:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:10.015 15:01:09 -- scripts/common.sh@343 -- # case "$op" in 00:06:10.015 15:01:09 -- scripts/common.sh@344 -- # : 1 00:06:10.015 15:01:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:10.015 15:01:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:10.015 15:01:09 -- scripts/common.sh@364 -- # decimal 1 00:06:10.015 15:01:09 -- scripts/common.sh@352 -- # local d=1 00:06:10.015 15:01:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:10.015 15:01:09 -- scripts/common.sh@354 -- # echo 1 00:06:10.015 15:01:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:10.015 15:01:09 -- scripts/common.sh@365 -- # decimal 2 00:06:10.015 15:01:09 -- scripts/common.sh@352 -- # local d=2 00:06:10.015 15:01:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:10.015 15:01:09 -- scripts/common.sh@354 -- # echo 2 00:06:10.015 15:01:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:10.015 15:01:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:10.015 15:01:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:10.015 15:01:09 -- scripts/common.sh@367 -- # return 0 00:06:10.015 15:01:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:10.015 15:01:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:10.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.015 --rc genhtml_branch_coverage=1 00:06:10.015 --rc genhtml_function_coverage=1 00:06:10.015 --rc genhtml_legend=1 00:06:10.015 --rc geninfo_all_blocks=1 00:06:10.015 --rc geninfo_unexecuted_blocks=1 00:06:10.015 00:06:10.015 ' 00:06:10.015 15:01:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:10.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.015 --rc genhtml_branch_coverage=1 00:06:10.015 --rc genhtml_function_coverage=1 00:06:10.015 --rc genhtml_legend=1 00:06:10.015 --rc geninfo_all_blocks=1 00:06:10.015 --rc geninfo_unexecuted_blocks=1 00:06:10.015 00:06:10.015 ' 00:06:10.015 15:01:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:10.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.015 --rc genhtml_branch_coverage=1 00:06:10.015 --rc genhtml_function_coverage=1 00:06:10.015 --rc genhtml_legend=1 00:06:10.015 --rc geninfo_all_blocks=1 00:06:10.015 --rc geninfo_unexecuted_blocks=1 00:06:10.015 00:06:10.015 ' 00:06:10.015 15:01:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:10.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:10.015 --rc genhtml_branch_coverage=1 00:06:10.015 --rc genhtml_function_coverage=1 00:06:10.015 --rc genhtml_legend=1 00:06:10.015 --rc geninfo_all_blocks=1 00:06:10.015 --rc geninfo_unexecuted_blocks=1 00:06:10.015 00:06:10.015 ' 00:06:10.015 15:01:09 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:10.015 15:01:09 -- scheduler/scheduler.sh@35 -- # scheduler_pid=588854 00:06:10.015 15:01:09 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:10.015 15:01:09 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:10.015 15:01:09 -- scheduler/scheduler.sh@37 -- # waitforlisten 588854 00:06:10.015 15:01:09 -- common/autotest_common.sh@829 -- # '[' -z 588854 ']' 00:06:10.015 15:01:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:10.015 15:01:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:10.015 15:01:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:10.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:10.015 15:01:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:10.015 15:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:10.015 [2024-11-28 15:01:10.015848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:10.015 [2024-11-28 15:01:10.015929] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid588854 ] 00:06:10.015 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.015 [2024-11-28 15:01:10.076022] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:10.015 [2024-11-28 15:01:10.172203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.015 [2024-11-28 15:01:10.172239] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:10.015 [2024-11-28 15:01:10.172262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:10.015 [2024-11-28 15:01:10.172265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:10.273 15:01:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:10.273 15:01:10 -- common/autotest_common.sh@862 -- # return 0 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 POWER: Env isn't set yet! 00:06:10.273 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:10.273 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:10.273 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:10.273 POWER: Cannot get available frequencies of lcore 0 00:06:10.273 POWER: Attempting to initialise PSTAT power management... 00:06:10.273 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:10.273 POWER: Initialized successfully for lcore 0 power management 00:06:10.273 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:10.273 POWER: Initialized successfully for lcore 1 power management 00:06:10.273 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:10.273 POWER: Initialized successfully for lcore 2 power management 00:06:10.273 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:10.273 POWER: Initialized successfully for lcore 3 power management 00:06:10.273 [2024-11-28 15:01:10.295314] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:10.273 [2024-11-28 15:01:10.295333] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:10.273 [2024-11-28 15:01:10.295343] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 [2024-11-28 15:01:10.398685] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:10.273 15:01:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:10.273 15:01:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 ************************************ 00:06:10.273 START TEST scheduler_create_thread 00:06:10.273 ************************************ 00:06:10.273 15:01:10 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 2 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 3 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 4 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 5 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 6 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 7 00:06:10.273 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.273 15:01:10 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:10.273 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.273 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.273 8 00:06:10.274 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.274 15:01:10 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:10.274 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.274 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.274 9 00:06:10.274 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.274 15:01:10 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:10.274 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.274 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.274 10 00:06:10.274 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.274 15:01:10 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:10.274 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.274 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.531 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.531 15:01:10 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:10.531 15:01:10 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:10.531 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.531 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:10.788 15:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:10.788 15:01:10 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:10.788 15:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:10.788 15:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:12.689 15:01:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:12.689 15:01:12 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:12.689 15:01:12 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:12.689 15:01:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:12.689 15:01:12 -- common/autotest_common.sh@10 -- # set +x 00:06:13.620 15:01:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:13.620 00:06:13.620 real 0m3.101s 00:06:13.620 user 0m0.011s 00:06:13.620 sys 0m0.005s 00:06:13.620 15:01:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.620 15:01:13 -- common/autotest_common.sh@10 -- # set +x 00:06:13.620 ************************************ 00:06:13.620 END TEST scheduler_create_thread 00:06:13.620 ************************************ 00:06:13.620 15:01:13 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:13.620 15:01:13 -- scheduler/scheduler.sh@46 -- # killprocess 588854 00:06:13.620 15:01:13 -- common/autotest_common.sh@936 -- # '[' -z 588854 ']' 00:06:13.620 15:01:13 -- common/autotest_common.sh@940 -- # kill -0 588854 00:06:13.620 15:01:13 -- common/autotest_common.sh@941 -- # uname 00:06:13.620 15:01:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:13.620 15:01:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 588854 00:06:13.620 15:01:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:13.620 15:01:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:13.620 15:01:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 588854' 00:06:13.620 killing process with pid 588854 00:06:13.620 15:01:13 -- common/autotest_common.sh@955 -- # kill 588854 00:06:13.620 15:01:13 -- common/autotest_common.sh@960 -- # wait 588854 00:06:13.878 [2024-11-28 15:01:13.886712] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:13.878 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:13.878 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:13.878 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:13.878 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:13.878 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:13.878 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:13.878 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:13.878 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:14.139 00:06:14.139 real 0m4.300s 00:06:14.139 user 0m7.047s 00:06:14.139 sys 0m0.351s 00:06:14.139 15:01:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.139 15:01:14 -- common/autotest_common.sh@10 -- # set +x 00:06:14.139 ************************************ 00:06:14.139 END TEST event_scheduler 00:06:14.139 ************************************ 00:06:14.139 15:01:14 -- event/event.sh@51 -- # modprobe -n nbd 00:06:14.139 15:01:14 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:14.139 15:01:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:14.139 15:01:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.139 15:01:14 -- common/autotest_common.sh@10 -- # set +x 00:06:14.139 ************************************ 00:06:14.139 START TEST app_repeat 00:06:14.139 ************************************ 00:06:14.139 15:01:14 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:14.139 15:01:14 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.139 15:01:14 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.139 15:01:14 -- event/event.sh@13 -- # local nbd_list 00:06:14.139 15:01:14 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.139 15:01:14 -- event/event.sh@14 -- # local bdev_list 00:06:14.139 15:01:14 -- event/event.sh@15 -- # local repeat_times=4 00:06:14.139 15:01:14 -- event/event.sh@17 -- # modprobe nbd 00:06:14.139 15:01:14 -- event/event.sh@19 -- # repeat_pid=589440 00:06:14.139 15:01:14 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:14.139 15:01:14 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:14.139 15:01:14 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 589440' 00:06:14.139 Process app_repeat pid: 589440 00:06:14.139 15:01:14 -- event/event.sh@23 -- # for i in {0..2} 00:06:14.139 15:01:14 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:14.139 spdk_app_start Round 0 00:06:14.139 15:01:14 -- event/event.sh@25 -- # waitforlisten 589440 /var/tmp/spdk-nbd.sock 00:06:14.139 15:01:14 -- common/autotest_common.sh@829 -- # '[' -z 589440 ']' 00:06:14.139 15:01:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:14.139 15:01:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:14.139 15:01:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:14.139 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:14.139 15:01:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:14.139 15:01:14 -- common/autotest_common.sh@10 -- # set +x 00:06:14.139 [2024-11-28 15:01:14.198032] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:14.139 [2024-11-28 15:01:14.198121] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid589440 ] 00:06:14.139 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.139 [2024-11-28 15:01:14.261641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:14.139 [2024-11-28 15:01:14.361124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:14.139 [2024-11-28 15:01:14.361129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.440 15:01:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.440 15:01:14 -- common/autotest_common.sh@862 -- # return 0 00:06:14.440 15:01:14 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.744 Malloc0 00:06:14.744 15:01:14 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:15.055 Malloc1 00:06:15.055 15:01:15 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@12 -- # local i 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:15.055 15:01:15 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:15.312 /dev/nbd0 00:06:15.312 15:01:15 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:15.312 15:01:15 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:15.312 15:01:15 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:15.312 15:01:15 -- common/autotest_common.sh@867 -- # local i 00:06:15.312 15:01:15 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:15.312 15:01:15 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:15.312 15:01:15 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:15.312 15:01:15 -- common/autotest_common.sh@871 -- # break 00:06:15.312 15:01:15 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:15.312 15:01:15 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:15.312 15:01:15 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:15.312 1+0 records in 00:06:15.312 1+0 records out 00:06:15.312 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00022456 s, 18.2 MB/s 00:06:15.312 15:01:15 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.312 15:01:15 -- common/autotest_common.sh@884 -- # size=4096 00:06:15.312 15:01:15 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.312 15:01:15 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:15.312 15:01:15 -- common/autotest_common.sh@887 -- # return 0 00:06:15.312 15:01:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:15.312 15:01:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:15.312 15:01:15 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:15.569 /dev/nbd1 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:15.569 15:01:15 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:15.569 15:01:15 -- common/autotest_common.sh@867 -- # local i 00:06:15.569 15:01:15 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:15.569 15:01:15 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:15.569 15:01:15 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:15.569 15:01:15 -- common/autotest_common.sh@871 -- # break 00:06:15.569 15:01:15 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:15.569 15:01:15 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:15.569 15:01:15 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:15.569 1+0 records in 00:06:15.569 1+0 records out 00:06:15.569 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000220766 s, 18.6 MB/s 00:06:15.569 15:01:15 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.569 15:01:15 -- common/autotest_common.sh@884 -- # size=4096 00:06:15.569 15:01:15 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:15.569 15:01:15 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:15.569 15:01:15 -- common/autotest_common.sh@887 -- # return 0 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.569 15:01:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:15.827 { 00:06:15.827 "nbd_device": "/dev/nbd0", 00:06:15.827 "bdev_name": "Malloc0" 00:06:15.827 }, 00:06:15.827 { 00:06:15.827 "nbd_device": "/dev/nbd1", 00:06:15.827 "bdev_name": "Malloc1" 00:06:15.827 } 00:06:15.827 ]' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:15.827 { 00:06:15.827 "nbd_device": "/dev/nbd0", 00:06:15.827 "bdev_name": "Malloc0" 00:06:15.827 }, 00:06:15.827 { 00:06:15.827 "nbd_device": "/dev/nbd1", 00:06:15.827 "bdev_name": "Malloc1" 00:06:15.827 } 00:06:15.827 ]' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:15.827 /dev/nbd1' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:15.827 /dev/nbd1' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@65 -- # count=2 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@95 -- # count=2 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:15.827 256+0 records in 00:06:15.827 256+0 records out 00:06:15.827 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00391654 s, 268 MB/s 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:15.827 256+0 records in 00:06:15.827 256+0 records out 00:06:15.827 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202227 s, 51.9 MB/s 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:15.827 256+0 records in 00:06:15.827 256+0 records out 00:06:15.827 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238317 s, 44.0 MB/s 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.827 15:01:15 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:15.828 15:01:15 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.828 15:01:15 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.828 15:01:15 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:15.828 15:01:15 -- bdev/nbd_common.sh@51 -- # local i 00:06:15.828 15:01:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.828 15:01:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@41 -- # break 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@45 -- # return 0 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:16.085 15:01:16 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@41 -- # break 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@45 -- # return 0 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:16.344 15:01:16 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@65 -- # true 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@65 -- # count=0 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@104 -- # count=0 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:16.602 15:01:16 -- bdev/nbd_common.sh@109 -- # return 0 00:06:16.602 15:01:16 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:17.168 15:01:17 -- event/event.sh@35 -- # sleep 3 00:06:17.168 [2024-11-28 15:01:17.336676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:17.426 [2024-11-28 15:01:17.425128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:17.426 [2024-11-28 15:01:17.425133] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.426 [2024-11-28 15:01:17.486764] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:17.426 [2024-11-28 15:01:17.486838] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:19.948 15:01:20 -- event/event.sh@23 -- # for i in {0..2} 00:06:19.948 15:01:20 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:19.948 spdk_app_start Round 1 00:06:19.948 15:01:20 -- event/event.sh@25 -- # waitforlisten 589440 /var/tmp/spdk-nbd.sock 00:06:19.948 15:01:20 -- common/autotest_common.sh@829 -- # '[' -z 589440 ']' 00:06:19.948 15:01:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:19.948 15:01:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.948 15:01:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:19.948 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:19.948 15:01:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.948 15:01:20 -- common/autotest_common.sh@10 -- # set +x 00:06:20.204 15:01:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.204 15:01:20 -- common/autotest_common.sh@862 -- # return 0 00:06:20.204 15:01:20 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.461 Malloc0 00:06:20.461 15:01:20 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.719 Malloc1 00:06:20.719 15:01:20 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.719 15:01:20 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.977 /dev/nbd0 00:06:20.977 15:01:21 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.977 15:01:21 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.977 15:01:21 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:20.977 15:01:21 -- common/autotest_common.sh@867 -- # local i 00:06:20.977 15:01:21 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.977 15:01:21 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.977 15:01:21 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:20.977 15:01:21 -- common/autotest_common.sh@871 -- # break 00:06:20.977 15:01:21 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.977 15:01:21 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.977 15:01:21 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.977 1+0 records in 00:06:20.977 1+0 records out 00:06:20.977 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000220256 s, 18.6 MB/s 00:06:20.977 15:01:21 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.977 15:01:21 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.977 15:01:21 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.977 15:01:21 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.977 15:01:21 -- common/autotest_common.sh@887 -- # return 0 00:06:20.977 15:01:21 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.977 15:01:21 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.977 15:01:21 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:21.543 /dev/nbd1 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:21.543 15:01:21 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:21.543 15:01:21 -- common/autotest_common.sh@867 -- # local i 00:06:21.543 15:01:21 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:21.543 15:01:21 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:21.543 15:01:21 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:21.543 15:01:21 -- common/autotest_common.sh@871 -- # break 00:06:21.543 15:01:21 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:21.543 15:01:21 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:21.543 15:01:21 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:21.543 1+0 records in 00:06:21.543 1+0 records out 00:06:21.543 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000230829 s, 17.7 MB/s 00:06:21.543 15:01:21 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:21.543 15:01:21 -- common/autotest_common.sh@884 -- # size=4096 00:06:21.543 15:01:21 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:21.543 15:01:21 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:21.543 15:01:21 -- common/autotest_common.sh@887 -- # return 0 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:21.543 { 00:06:21.543 "nbd_device": "/dev/nbd0", 00:06:21.543 "bdev_name": "Malloc0" 00:06:21.543 }, 00:06:21.543 { 00:06:21.543 "nbd_device": "/dev/nbd1", 00:06:21.543 "bdev_name": "Malloc1" 00:06:21.543 } 00:06:21.543 ]' 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:21.543 { 00:06:21.543 "nbd_device": "/dev/nbd0", 00:06:21.543 "bdev_name": "Malloc0" 00:06:21.543 }, 00:06:21.543 { 00:06:21.543 "nbd_device": "/dev/nbd1", 00:06:21.543 "bdev_name": "Malloc1" 00:06:21.543 } 00:06:21.543 ]' 00:06:21.543 15:01:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:21.801 /dev/nbd1' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:21.801 /dev/nbd1' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@65 -- # count=2 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@95 -- # count=2 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:21.801 256+0 records in 00:06:21.801 256+0 records out 00:06:21.801 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00491926 s, 213 MB/s 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:21.801 256+0 records in 00:06:21.801 256+0 records out 00:06:21.801 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022428 s, 46.8 MB/s 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:21.801 256+0 records in 00:06:21.801 256+0 records out 00:06:21.801 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210173 s, 49.9 MB/s 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@51 -- # local i 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.801 15:01:21 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:22.059 15:01:22 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@41 -- # break 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@45 -- # return 0 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:22.060 15:01:22 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@41 -- # break 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@45 -- # return 0 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:22.318 15:01:22 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@65 -- # true 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@65 -- # count=0 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@104 -- # count=0 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:22.576 15:01:22 -- bdev/nbd_common.sh@109 -- # return 0 00:06:22.576 15:01:22 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.833 15:01:22 -- event/event.sh@35 -- # sleep 3 00:06:23.092 [2024-11-28 15:01:23.209142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:23.092 [2024-11-28 15:01:23.296645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.092 [2024-11-28 15:01:23.296649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.351 [2024-11-28 15:01:23.358584] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:23.351 [2024-11-28 15:01:23.358659] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.875 15:01:25 -- event/event.sh@23 -- # for i in {0..2} 00:06:25.875 15:01:25 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:25.875 spdk_app_start Round 2 00:06:25.875 15:01:25 -- event/event.sh@25 -- # waitforlisten 589440 /var/tmp/spdk-nbd.sock 00:06:25.875 15:01:25 -- common/autotest_common.sh@829 -- # '[' -z 589440 ']' 00:06:25.875 15:01:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.875 15:01:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.875 15:01:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.875 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.875 15:01:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.875 15:01:25 -- common/autotest_common.sh@10 -- # set +x 00:06:26.133 15:01:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:26.133 15:01:26 -- common/autotest_common.sh@862 -- # return 0 00:06:26.133 15:01:26 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.391 Malloc0 00:06:26.391 15:01:26 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:26.651 Malloc1 00:06:26.651 15:01:26 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@12 -- # local i 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.651 15:01:26 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:26.909 /dev/nbd0 00:06:26.909 15:01:27 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:26.909 15:01:27 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:26.909 15:01:27 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:26.909 15:01:27 -- common/autotest_common.sh@867 -- # local i 00:06:26.909 15:01:27 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:26.909 15:01:27 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:26.909 15:01:27 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:26.909 15:01:27 -- common/autotest_common.sh@871 -- # break 00:06:26.909 15:01:27 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:26.909 15:01:27 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:26.909 15:01:27 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:26.909 1+0 records in 00:06:26.909 1+0 records out 00:06:26.909 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000153314 s, 26.7 MB/s 00:06:26.909 15:01:27 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.909 15:01:27 -- common/autotest_common.sh@884 -- # size=4096 00:06:26.909 15:01:27 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:26.909 15:01:27 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:26.909 15:01:27 -- common/autotest_common.sh@887 -- # return 0 00:06:26.909 15:01:27 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:26.909 15:01:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:26.909 15:01:27 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:27.169 /dev/nbd1 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:27.169 15:01:27 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:27.169 15:01:27 -- common/autotest_common.sh@867 -- # local i 00:06:27.169 15:01:27 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:27.169 15:01:27 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:27.169 15:01:27 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:27.169 15:01:27 -- common/autotest_common.sh@871 -- # break 00:06:27.169 15:01:27 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:27.169 15:01:27 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:27.169 15:01:27 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:27.169 1+0 records in 00:06:27.169 1+0 records out 00:06:27.169 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00022464 s, 18.2 MB/s 00:06:27.169 15:01:27 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.169 15:01:27 -- common/autotest_common.sh@884 -- # size=4096 00:06:27.169 15:01:27 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:27.169 15:01:27 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:27.169 15:01:27 -- common/autotest_common.sh@887 -- # return 0 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.169 15:01:27 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:27.427 { 00:06:27.427 "nbd_device": "/dev/nbd0", 00:06:27.427 "bdev_name": "Malloc0" 00:06:27.427 }, 00:06:27.427 { 00:06:27.427 "nbd_device": "/dev/nbd1", 00:06:27.427 "bdev_name": "Malloc1" 00:06:27.427 } 00:06:27.427 ]' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:27.427 { 00:06:27.427 "nbd_device": "/dev/nbd0", 00:06:27.427 "bdev_name": "Malloc0" 00:06:27.427 }, 00:06:27.427 { 00:06:27.427 "nbd_device": "/dev/nbd1", 00:06:27.427 "bdev_name": "Malloc1" 00:06:27.427 } 00:06:27.427 ]' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:27.427 /dev/nbd1' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:27.427 /dev/nbd1' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@65 -- # count=2 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@95 -- # count=2 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:27.427 256+0 records in 00:06:27.427 256+0 records out 00:06:27.427 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00385661 s, 272 MB/s 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:27.427 256+0 records in 00:06:27.427 256+0 records out 00:06:27.427 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190617 s, 55.0 MB/s 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:27.427 15:01:27 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:27.684 256+0 records in 00:06:27.684 256+0 records out 00:06:27.684 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233042 s, 45.0 MB/s 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@51 -- # local i 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.684 15:01:27 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@41 -- # break 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@45 -- # return 0 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:27.942 15:01:27 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@41 -- # break 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@45 -- # return 0 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:28.199 15:01:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@65 -- # true 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@65 -- # count=0 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@104 -- # count=0 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:28.456 15:01:28 -- bdev/nbd_common.sh@109 -- # return 0 00:06:28.456 15:01:28 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:28.714 15:01:28 -- event/event.sh@35 -- # sleep 3 00:06:28.972 [2024-11-28 15:01:29.064281] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:28.972 [2024-11-28 15:01:29.152223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.972 [2024-11-28 15:01:29.152228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.230 [2024-11-28 15:01:29.211070] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:29.230 [2024-11-28 15:01:29.211162] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:31.756 15:01:31 -- event/event.sh@38 -- # waitforlisten 589440 /var/tmp/spdk-nbd.sock 00:06:31.756 15:01:31 -- common/autotest_common.sh@829 -- # '[' -z 589440 ']' 00:06:31.756 15:01:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:31.756 15:01:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:31.756 15:01:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:31.756 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:31.756 15:01:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:31.756 15:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:32.014 15:01:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:32.014 15:01:32 -- common/autotest_common.sh@862 -- # return 0 00:06:32.014 15:01:32 -- event/event.sh@39 -- # killprocess 589440 00:06:32.014 15:01:32 -- common/autotest_common.sh@936 -- # '[' -z 589440 ']' 00:06:32.014 15:01:32 -- common/autotest_common.sh@940 -- # kill -0 589440 00:06:32.014 15:01:32 -- common/autotest_common.sh@941 -- # uname 00:06:32.014 15:01:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.014 15:01:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 589440 00:06:32.014 15:01:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.014 15:01:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.014 15:01:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 589440' 00:06:32.014 killing process with pid 589440 00:06:32.014 15:01:32 -- common/autotest_common.sh@955 -- # kill 589440 00:06:32.014 15:01:32 -- common/autotest_common.sh@960 -- # wait 589440 00:06:32.274 spdk_app_start is called in Round 0. 00:06:32.274 Shutdown signal received, stop current app iteration 00:06:32.274 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:32.274 spdk_app_start is called in Round 1. 00:06:32.274 Shutdown signal received, stop current app iteration 00:06:32.274 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:32.274 spdk_app_start is called in Round 2. 00:06:32.274 Shutdown signal received, stop current app iteration 00:06:32.274 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 reinitialization... 00:06:32.274 spdk_app_start is called in Round 3. 00:06:32.274 Shutdown signal received, stop current app iteration 00:06:32.274 15:01:32 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:32.274 15:01:32 -- event/event.sh@42 -- # return 0 00:06:32.274 00:06:32.274 real 0m18.161s 00:06:32.274 user 0m39.797s 00:06:32.274 sys 0m3.155s 00:06:32.274 15:01:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.274 15:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:32.274 ************************************ 00:06:32.274 END TEST app_repeat 00:06:32.274 ************************************ 00:06:32.274 15:01:32 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:32.274 15:01:32 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:32.274 15:01:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.274 15:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:32.274 ************************************ 00:06:32.274 START TEST cpu_locks 00:06:32.274 ************************************ 00:06:32.274 15:01:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:32.274 * Looking for test storage... 00:06:32.274 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:32.274 15:01:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:32.274 15:01:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:32.274 15:01:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:32.274 15:01:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:32.274 15:01:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:32.274 15:01:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:32.274 15:01:32 -- scripts/common.sh@335 -- # IFS=.-: 00:06:32.274 15:01:32 -- scripts/common.sh@335 -- # read -ra ver1 00:06:32.274 15:01:32 -- scripts/common.sh@336 -- # IFS=.-: 00:06:32.274 15:01:32 -- scripts/common.sh@336 -- # read -ra ver2 00:06:32.274 15:01:32 -- scripts/common.sh@337 -- # local 'op=<' 00:06:32.274 15:01:32 -- scripts/common.sh@339 -- # ver1_l=2 00:06:32.274 15:01:32 -- scripts/common.sh@340 -- # ver2_l=1 00:06:32.274 15:01:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:32.274 15:01:32 -- scripts/common.sh@343 -- # case "$op" in 00:06:32.274 15:01:32 -- scripts/common.sh@344 -- # : 1 00:06:32.274 15:01:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:32.274 15:01:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:32.274 15:01:32 -- scripts/common.sh@364 -- # decimal 1 00:06:32.274 15:01:32 -- scripts/common.sh@352 -- # local d=1 00:06:32.274 15:01:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:32.274 15:01:32 -- scripts/common.sh@354 -- # echo 1 00:06:32.274 15:01:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:32.274 15:01:32 -- scripts/common.sh@365 -- # decimal 2 00:06:32.274 15:01:32 -- scripts/common.sh@352 -- # local d=2 00:06:32.274 15:01:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:32.274 15:01:32 -- scripts/common.sh@354 -- # echo 2 00:06:32.274 15:01:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:32.274 15:01:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:32.274 15:01:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:32.274 15:01:32 -- scripts/common.sh@367 -- # return 0 00:06:32.274 15:01:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:32.274 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.274 --rc genhtml_branch_coverage=1 00:06:32.274 --rc genhtml_function_coverage=1 00:06:32.274 --rc genhtml_legend=1 00:06:32.274 --rc geninfo_all_blocks=1 00:06:32.274 --rc geninfo_unexecuted_blocks=1 00:06:32.274 00:06:32.274 ' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:32.274 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.274 --rc genhtml_branch_coverage=1 00:06:32.274 --rc genhtml_function_coverage=1 00:06:32.274 --rc genhtml_legend=1 00:06:32.274 --rc geninfo_all_blocks=1 00:06:32.274 --rc geninfo_unexecuted_blocks=1 00:06:32.274 00:06:32.274 ' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:32.274 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.274 --rc genhtml_branch_coverage=1 00:06:32.274 --rc genhtml_function_coverage=1 00:06:32.274 --rc genhtml_legend=1 00:06:32.274 --rc geninfo_all_blocks=1 00:06:32.274 --rc geninfo_unexecuted_blocks=1 00:06:32.274 00:06:32.274 ' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:32.274 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:32.274 --rc genhtml_branch_coverage=1 00:06:32.274 --rc genhtml_function_coverage=1 00:06:32.274 --rc genhtml_legend=1 00:06:32.274 --rc geninfo_all_blocks=1 00:06:32.274 --rc geninfo_unexecuted_blocks=1 00:06:32.274 00:06:32.274 ' 00:06:32.274 15:01:32 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:32.274 15:01:32 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:32.274 15:01:32 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:32.274 15:01:32 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:32.274 15:01:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:32.274 15:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.274 15:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:32.274 ************************************ 00:06:32.274 START TEST default_locks 00:06:32.274 ************************************ 00:06:32.274 15:01:32 -- common/autotest_common.sh@1114 -- # default_locks 00:06:32.533 15:01:32 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=591867 00:06:32.533 15:01:32 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:32.533 15:01:32 -- event/cpu_locks.sh@47 -- # waitforlisten 591867 00:06:32.533 15:01:32 -- common/autotest_common.sh@829 -- # '[' -z 591867 ']' 00:06:32.533 15:01:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:32.533 15:01:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:32.533 15:01:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:32.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:32.533 15:01:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:32.533 15:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:32.533 [2024-11-28 15:01:32.556744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:32.533 [2024-11-28 15:01:32.556840] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid591867 ] 00:06:32.533 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.533 [2024-11-28 15:01:32.620791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.533 [2024-11-28 15:01:32.719071] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:32.533 [2024-11-28 15:01:32.719243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.466 15:01:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:33.466 15:01:33 -- common/autotest_common.sh@862 -- # return 0 00:06:33.466 15:01:33 -- event/cpu_locks.sh@49 -- # locks_exist 591867 00:06:33.466 15:01:33 -- event/cpu_locks.sh@22 -- # lslocks -p 591867 00:06:33.466 15:01:33 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:33.725 lslocks: write error 00:06:33.725 15:01:33 -- event/cpu_locks.sh@50 -- # killprocess 591867 00:06:33.725 15:01:33 -- common/autotest_common.sh@936 -- # '[' -z 591867 ']' 00:06:33.725 15:01:33 -- common/autotest_common.sh@940 -- # kill -0 591867 00:06:33.725 15:01:33 -- common/autotest_common.sh@941 -- # uname 00:06:33.725 15:01:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:33.725 15:01:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 591867 00:06:33.725 15:01:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:33.725 15:01:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:33.725 15:01:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 591867' 00:06:33.725 killing process with pid 591867 00:06:33.725 15:01:33 -- common/autotest_common.sh@955 -- # kill 591867 00:06:33.725 15:01:33 -- common/autotest_common.sh@960 -- # wait 591867 00:06:34.291 15:01:34 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 591867 00:06:34.291 15:01:34 -- common/autotest_common.sh@650 -- # local es=0 00:06:34.291 15:01:34 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 591867 00:06:34.291 15:01:34 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:34.291 15:01:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.292 15:01:34 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:34.292 15:01:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:34.292 15:01:34 -- common/autotest_common.sh@653 -- # waitforlisten 591867 00:06:34.292 15:01:34 -- common/autotest_common.sh@829 -- # '[' -z 591867 ']' 00:06:34.292 15:01:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.292 15:01:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.292 15:01:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.292 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.292 15:01:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.292 15:01:34 -- common/autotest_common.sh@10 -- # set +x 00:06:34.292 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (591867) - No such process 00:06:34.292 ERROR: process (pid: 591867) is no longer running 00:06:34.292 15:01:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.292 15:01:34 -- common/autotest_common.sh@862 -- # return 1 00:06:34.292 15:01:34 -- common/autotest_common.sh@653 -- # es=1 00:06:34.292 15:01:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:34.292 15:01:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:34.292 15:01:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:34.292 15:01:34 -- event/cpu_locks.sh@54 -- # no_locks 00:06:34.292 15:01:34 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:34.292 15:01:34 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:34.292 15:01:34 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:34.292 00:06:34.292 real 0m1.720s 00:06:34.292 user 0m1.897s 00:06:34.292 sys 0m0.567s 00:06:34.292 15:01:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:34.292 15:01:34 -- common/autotest_common.sh@10 -- # set +x 00:06:34.292 ************************************ 00:06:34.292 END TEST default_locks 00:06:34.292 ************************************ 00:06:34.292 15:01:34 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:34.292 15:01:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:34.292 15:01:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:34.292 15:01:34 -- common/autotest_common.sh@10 -- # set +x 00:06:34.292 ************************************ 00:06:34.292 START TEST default_locks_via_rpc 00:06:34.292 ************************************ 00:06:34.292 15:01:34 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:34.292 15:01:34 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=592169 00:06:34.292 15:01:34 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:34.292 15:01:34 -- event/cpu_locks.sh@63 -- # waitforlisten 592169 00:06:34.292 15:01:34 -- common/autotest_common.sh@829 -- # '[' -z 592169 ']' 00:06:34.292 15:01:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:34.292 15:01:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.292 15:01:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:34.292 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:34.292 15:01:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.292 15:01:34 -- common/autotest_common.sh@10 -- # set +x 00:06:34.292 [2024-11-28 15:01:34.298226] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:34.292 [2024-11-28 15:01:34.298322] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid592169 ] 00:06:34.292 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.292 [2024-11-28 15:01:34.354435] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.292 [2024-11-28 15:01:34.443746] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.292 [2024-11-28 15:01:34.443912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.227 15:01:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.227 15:01:35 -- common/autotest_common.sh@862 -- # return 0 00:06:35.227 15:01:35 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:35.227 15:01:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.227 15:01:35 -- common/autotest_common.sh@10 -- # set +x 00:06:35.227 15:01:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.227 15:01:35 -- event/cpu_locks.sh@67 -- # no_locks 00:06:35.227 15:01:35 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:35.227 15:01:35 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:35.227 15:01:35 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:35.227 15:01:35 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:35.227 15:01:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:35.227 15:01:35 -- common/autotest_common.sh@10 -- # set +x 00:06:35.227 15:01:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:35.227 15:01:35 -- event/cpu_locks.sh@71 -- # locks_exist 592169 00:06:35.227 15:01:35 -- event/cpu_locks.sh@22 -- # lslocks -p 592169 00:06:35.227 15:01:35 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:35.485 15:01:35 -- event/cpu_locks.sh@73 -- # killprocess 592169 00:06:35.485 15:01:35 -- common/autotest_common.sh@936 -- # '[' -z 592169 ']' 00:06:35.485 15:01:35 -- common/autotest_common.sh@940 -- # kill -0 592169 00:06:35.485 15:01:35 -- common/autotest_common.sh@941 -- # uname 00:06:35.485 15:01:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.485 15:01:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 592169 00:06:35.485 15:01:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.485 15:01:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.485 15:01:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 592169' 00:06:35.485 killing process with pid 592169 00:06:35.485 15:01:35 -- common/autotest_common.sh@955 -- # kill 592169 00:06:35.485 15:01:35 -- common/autotest_common.sh@960 -- # wait 592169 00:06:36.051 00:06:36.051 real 0m1.766s 00:06:36.051 user 0m1.944s 00:06:36.051 sys 0m0.543s 00:06:36.051 15:01:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.051 15:01:36 -- common/autotest_common.sh@10 -- # set +x 00:06:36.051 ************************************ 00:06:36.051 END TEST default_locks_via_rpc 00:06:36.051 ************************************ 00:06:36.051 15:01:36 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:36.051 15:01:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.051 15:01:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.051 15:01:36 -- common/autotest_common.sh@10 -- # set +x 00:06:36.051 ************************************ 00:06:36.051 START TEST non_locking_app_on_locked_coremask 00:06:36.051 ************************************ 00:06:36.051 15:01:36 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:36.051 15:01:36 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=592456 00:06:36.051 15:01:36 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:36.051 15:01:36 -- event/cpu_locks.sh@81 -- # waitforlisten 592456 /var/tmp/spdk.sock 00:06:36.051 15:01:36 -- common/autotest_common.sh@829 -- # '[' -z 592456 ']' 00:06:36.051 15:01:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.051 15:01:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.051 15:01:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.051 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.051 15:01:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.051 15:01:36 -- common/autotest_common.sh@10 -- # set +x 00:06:36.051 [2024-11-28 15:01:36.087150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.051 [2024-11-28 15:01:36.087241] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid592456 ] 00:06:36.051 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.051 [2024-11-28 15:01:36.147907] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.051 [2024-11-28 15:01:36.238112] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.051 [2024-11-28 15:01:36.238293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.986 15:01:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.986 15:01:37 -- common/autotest_common.sh@862 -- # return 0 00:06:36.986 15:01:37 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=592480 00:06:36.986 15:01:37 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:36.986 15:01:37 -- event/cpu_locks.sh@85 -- # waitforlisten 592480 /var/tmp/spdk2.sock 00:06:36.986 15:01:37 -- common/autotest_common.sh@829 -- # '[' -z 592480 ']' 00:06:36.986 15:01:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:36.986 15:01:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.986 15:01:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:36.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:36.986 15:01:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.986 15:01:37 -- common/autotest_common.sh@10 -- # set +x 00:06:36.986 [2024-11-28 15:01:37.092627] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:36.986 [2024-11-28 15:01:37.092705] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid592480 ] 00:06:36.986 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.986 [2024-11-28 15:01:37.192344] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:36.986 [2024-11-28 15:01:37.192387] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.245 [2024-11-28 15:01:37.382333] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.245 [2024-11-28 15:01:37.382537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.180 15:01:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.180 15:01:38 -- common/autotest_common.sh@862 -- # return 0 00:06:38.180 15:01:38 -- event/cpu_locks.sh@87 -- # locks_exist 592456 00:06:38.180 15:01:38 -- event/cpu_locks.sh@22 -- # lslocks -p 592456 00:06:38.180 15:01:38 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:38.439 lslocks: write error 00:06:38.439 15:01:38 -- event/cpu_locks.sh@89 -- # killprocess 592456 00:06:38.439 15:01:38 -- common/autotest_common.sh@936 -- # '[' -z 592456 ']' 00:06:38.439 15:01:38 -- common/autotest_common.sh@940 -- # kill -0 592456 00:06:38.439 15:01:38 -- common/autotest_common.sh@941 -- # uname 00:06:38.439 15:01:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:38.439 15:01:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 592456 00:06:38.439 15:01:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:38.439 15:01:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:38.439 15:01:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 592456' 00:06:38.439 killing process with pid 592456 00:06:38.439 15:01:38 -- common/autotest_common.sh@955 -- # kill 592456 00:06:38.439 15:01:38 -- common/autotest_common.sh@960 -- # wait 592456 00:06:39.374 15:01:39 -- event/cpu_locks.sh@90 -- # killprocess 592480 00:06:39.374 15:01:39 -- common/autotest_common.sh@936 -- # '[' -z 592480 ']' 00:06:39.374 15:01:39 -- common/autotest_common.sh@940 -- # kill -0 592480 00:06:39.374 15:01:39 -- common/autotest_common.sh@941 -- # uname 00:06:39.374 15:01:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.374 15:01:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 592480 00:06:39.374 15:01:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.374 15:01:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.374 15:01:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 592480' 00:06:39.374 killing process with pid 592480 00:06:39.374 15:01:39 -- common/autotest_common.sh@955 -- # kill 592480 00:06:39.374 15:01:39 -- common/autotest_common.sh@960 -- # wait 592480 00:06:39.633 00:06:39.633 real 0m3.736s 00:06:39.633 user 0m4.127s 00:06:39.633 sys 0m1.106s 00:06:39.633 15:01:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.633 15:01:39 -- common/autotest_common.sh@10 -- # set +x 00:06:39.633 ************************************ 00:06:39.633 END TEST non_locking_app_on_locked_coremask 00:06:39.633 ************************************ 00:06:39.633 15:01:39 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:39.633 15:01:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.633 15:01:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.633 15:01:39 -- common/autotest_common.sh@10 -- # set +x 00:06:39.633 ************************************ 00:06:39.633 START TEST locking_app_on_unlocked_coremask 00:06:39.633 ************************************ 00:06:39.633 15:01:39 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:39.633 15:01:39 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=592916 00:06:39.633 15:01:39 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:39.633 15:01:39 -- event/cpu_locks.sh@99 -- # waitforlisten 592916 /var/tmp/spdk.sock 00:06:39.633 15:01:39 -- common/autotest_common.sh@829 -- # '[' -z 592916 ']' 00:06:39.633 15:01:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.634 15:01:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.634 15:01:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.634 15:01:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.634 15:01:39 -- common/autotest_common.sh@10 -- # set +x 00:06:39.634 [2024-11-28 15:01:39.854876] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:39.634 [2024-11-28 15:01:39.854978] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid592916 ] 00:06:39.893 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.893 [2024-11-28 15:01:39.916900] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:39.893 [2024-11-28 15:01:39.916945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.893 [2024-11-28 15:01:40.002430] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.893 [2024-11-28 15:01:40.002613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.828 15:01:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.828 15:01:40 -- common/autotest_common.sh@862 -- # return 0 00:06:40.828 15:01:40 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=593056 00:06:40.828 15:01:40 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:40.828 15:01:40 -- event/cpu_locks.sh@103 -- # waitforlisten 593056 /var/tmp/spdk2.sock 00:06:40.828 15:01:40 -- common/autotest_common.sh@829 -- # '[' -z 593056 ']' 00:06:40.828 15:01:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:40.828 15:01:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.828 15:01:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:40.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:40.828 15:01:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.828 15:01:40 -- common/autotest_common.sh@10 -- # set +x 00:06:40.828 [2024-11-28 15:01:40.845130] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:40.828 [2024-11-28 15:01:40.845213] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid593056 ] 00:06:40.828 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.828 [2024-11-28 15:01:40.938491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.087 [2024-11-28 15:01:41.116251] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.087 [2024-11-28 15:01:41.116454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:41.653 15:01:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:41.653 15:01:41 -- common/autotest_common.sh@862 -- # return 0 00:06:41.653 15:01:41 -- event/cpu_locks.sh@105 -- # locks_exist 593056 00:06:41.653 15:01:41 -- event/cpu_locks.sh@22 -- # lslocks -p 593056 00:06:41.653 15:01:41 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:42.215 lslocks: write error 00:06:42.215 15:01:42 -- event/cpu_locks.sh@107 -- # killprocess 592916 00:06:42.215 15:01:42 -- common/autotest_common.sh@936 -- # '[' -z 592916 ']' 00:06:42.215 15:01:42 -- common/autotest_common.sh@940 -- # kill -0 592916 00:06:42.215 15:01:42 -- common/autotest_common.sh@941 -- # uname 00:06:42.215 15:01:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.215 15:01:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 592916 00:06:42.215 15:01:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.215 15:01:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.215 15:01:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 592916' 00:06:42.215 killing process with pid 592916 00:06:42.215 15:01:42 -- common/autotest_common.sh@955 -- # kill 592916 00:06:42.215 15:01:42 -- common/autotest_common.sh@960 -- # wait 592916 00:06:42.778 15:01:42 -- event/cpu_locks.sh@108 -- # killprocess 593056 00:06:42.778 15:01:42 -- common/autotest_common.sh@936 -- # '[' -z 593056 ']' 00:06:42.778 15:01:42 -- common/autotest_common.sh@940 -- # kill -0 593056 00:06:42.778 15:01:42 -- common/autotest_common.sh@941 -- # uname 00:06:42.778 15:01:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:42.778 15:01:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 593056 00:06:42.778 15:01:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:42.778 15:01:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:42.778 15:01:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 593056' 00:06:42.778 killing process with pid 593056 00:06:42.778 15:01:43 -- common/autotest_common.sh@955 -- # kill 593056 00:06:42.778 15:01:43 -- common/autotest_common.sh@960 -- # wait 593056 00:06:43.342 00:06:43.342 real 0m3.602s 00:06:43.342 user 0m3.968s 00:06:43.342 sys 0m1.054s 00:06:43.342 15:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.342 15:01:43 -- common/autotest_common.sh@10 -- # set +x 00:06:43.342 ************************************ 00:06:43.342 END TEST locking_app_on_unlocked_coremask 00:06:43.342 ************************************ 00:06:43.342 15:01:43 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:43.342 15:01:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:43.342 15:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.342 15:01:43 -- common/autotest_common.sh@10 -- # set +x 00:06:43.342 ************************************ 00:06:43.342 START TEST locking_app_on_locked_coremask 00:06:43.342 ************************************ 00:06:43.342 15:01:43 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:43.342 15:01:43 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=593368 00:06:43.342 15:01:43 -- event/cpu_locks.sh@116 -- # waitforlisten 593368 /var/tmp/spdk.sock 00:06:43.342 15:01:43 -- common/autotest_common.sh@829 -- # '[' -z 593368 ']' 00:06:43.342 15:01:43 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:43.342 15:01:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.342 15:01:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.342 15:01:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.342 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.342 15:01:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.342 15:01:43 -- common/autotest_common.sh@10 -- # set +x 00:06:43.342 [2024-11-28 15:01:43.484903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:43.342 [2024-11-28 15:01:43.485007] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid593368 ] 00:06:43.342 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.342 [2024-11-28 15:01:43.546352] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.601 [2024-11-28 15:01:43.631981] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.601 [2024-11-28 15:01:43.632180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:44.535 15:01:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.535 15:01:44 -- common/autotest_common.sh@862 -- # return 0 00:06:44.535 15:01:44 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=593508 00:06:44.535 15:01:44 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 593508 /var/tmp/spdk2.sock 00:06:44.535 15:01:44 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:44.535 15:01:44 -- common/autotest_common.sh@650 -- # local es=0 00:06:44.535 15:01:44 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 593508 /var/tmp/spdk2.sock 00:06:44.535 15:01:44 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:44.535 15:01:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.535 15:01:44 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:44.535 15:01:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:44.535 15:01:44 -- common/autotest_common.sh@653 -- # waitforlisten 593508 /var/tmp/spdk2.sock 00:06:44.535 15:01:44 -- common/autotest_common.sh@829 -- # '[' -z 593508 ']' 00:06:44.535 15:01:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:44.535 15:01:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.535 15:01:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:44.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:44.535 15:01:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.535 15:01:44 -- common/autotest_common.sh@10 -- # set +x 00:06:44.535 [2024-11-28 15:01:44.473431] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:44.535 [2024-11-28 15:01:44.473512] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid593508 ] 00:06:44.535 EAL: No free 2048 kB hugepages reported on node 1 00:06:44.535 [2024-11-28 15:01:44.570280] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 593368 has claimed it. 00:06:44.535 [2024-11-28 15:01:44.570342] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:45.101 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (593508) - No such process 00:06:45.101 ERROR: process (pid: 593508) is no longer running 00:06:45.101 15:01:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:45.101 15:01:45 -- common/autotest_common.sh@862 -- # return 1 00:06:45.101 15:01:45 -- common/autotest_common.sh@653 -- # es=1 00:06:45.101 15:01:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:45.101 15:01:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:45.101 15:01:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:45.101 15:01:45 -- event/cpu_locks.sh@122 -- # locks_exist 593368 00:06:45.101 15:01:45 -- event/cpu_locks.sh@22 -- # lslocks -p 593368 00:06:45.101 15:01:45 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:45.358 lslocks: write error 00:06:45.358 15:01:45 -- event/cpu_locks.sh@124 -- # killprocess 593368 00:06:45.358 15:01:45 -- common/autotest_common.sh@936 -- # '[' -z 593368 ']' 00:06:45.358 15:01:45 -- common/autotest_common.sh@940 -- # kill -0 593368 00:06:45.358 15:01:45 -- common/autotest_common.sh@941 -- # uname 00:06:45.358 15:01:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:45.358 15:01:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 593368 00:06:45.358 15:01:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:45.358 15:01:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:45.358 15:01:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 593368' 00:06:45.358 killing process with pid 593368 00:06:45.358 15:01:45 -- common/autotest_common.sh@955 -- # kill 593368 00:06:45.358 15:01:45 -- common/autotest_common.sh@960 -- # wait 593368 00:06:45.923 00:06:45.923 real 0m2.437s 00:06:45.923 user 0m2.802s 00:06:45.923 sys 0m0.628s 00:06:45.923 15:01:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.923 15:01:45 -- common/autotest_common.sh@10 -- # set +x 00:06:45.923 ************************************ 00:06:45.923 END TEST locking_app_on_locked_coremask 00:06:45.923 ************************************ 00:06:45.923 15:01:45 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:45.923 15:01:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.923 15:01:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.923 15:01:45 -- common/autotest_common.sh@10 -- # set +x 00:06:45.923 ************************************ 00:06:45.923 START TEST locking_overlapped_coremask 00:06:45.923 ************************************ 00:06:45.923 15:01:45 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:45.923 15:01:45 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=593674 00:06:45.923 15:01:45 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:45.923 15:01:45 -- event/cpu_locks.sh@133 -- # waitforlisten 593674 /var/tmp/spdk.sock 00:06:45.923 15:01:45 -- common/autotest_common.sh@829 -- # '[' -z 593674 ']' 00:06:45.923 15:01:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.923 15:01:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.923 15:01:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.923 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.923 15:01:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.923 15:01:45 -- common/autotest_common.sh@10 -- # set +x 00:06:45.923 [2024-11-28 15:01:45.950219] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:45.923 [2024-11-28 15:01:45.950307] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid593674 ] 00:06:45.923 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.923 [2024-11-28 15:01:46.012125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:45.923 [2024-11-28 15:01:46.102967] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:45.923 [2024-11-28 15:01:46.103188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:45.923 [2024-11-28 15:01:46.103215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:45.923 [2024-11-28 15:01:46.103218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:46.857 15:01:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.857 15:01:46 -- common/autotest_common.sh@862 -- # return 0 00:06:46.857 15:01:46 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=593816 00:06:46.857 15:01:46 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:46.857 15:01:46 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 593816 /var/tmp/spdk2.sock 00:06:46.857 15:01:46 -- common/autotest_common.sh@650 -- # local es=0 00:06:46.857 15:01:46 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 593816 /var/tmp/spdk2.sock 00:06:46.857 15:01:46 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:46.857 15:01:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.857 15:01:46 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:46.857 15:01:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:46.857 15:01:46 -- common/autotest_common.sh@653 -- # waitforlisten 593816 /var/tmp/spdk2.sock 00:06:46.857 15:01:46 -- common/autotest_common.sh@829 -- # '[' -z 593816 ']' 00:06:46.857 15:01:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:46.857 15:01:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:46.857 15:01:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:46.857 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:46.857 15:01:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:46.857 15:01:46 -- common/autotest_common.sh@10 -- # set +x 00:06:46.857 [2024-11-28 15:01:46.951587] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:46.857 [2024-11-28 15:01:46.951670] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid593816 ] 00:06:46.857 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.857 [2024-11-28 15:01:47.039270] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 593674 has claimed it. 00:06:46.857 [2024-11-28 15:01:47.039340] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:47.441 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (593816) - No such process 00:06:47.441 ERROR: process (pid: 593816) is no longer running 00:06:47.441 15:01:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:47.441 15:01:47 -- common/autotest_common.sh@862 -- # return 1 00:06:47.441 15:01:47 -- common/autotest_common.sh@653 -- # es=1 00:06:47.441 15:01:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:47.441 15:01:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:47.441 15:01:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:47.441 15:01:47 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:47.441 15:01:47 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:47.441 15:01:47 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:47.441 15:01:47 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:47.441 15:01:47 -- event/cpu_locks.sh@141 -- # killprocess 593674 00:06:47.441 15:01:47 -- common/autotest_common.sh@936 -- # '[' -z 593674 ']' 00:06:47.441 15:01:47 -- common/autotest_common.sh@940 -- # kill -0 593674 00:06:47.441 15:01:47 -- common/autotest_common.sh@941 -- # uname 00:06:47.441 15:01:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:47.441 15:01:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 593674 00:06:47.700 15:01:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:47.700 15:01:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:47.700 15:01:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 593674' 00:06:47.700 killing process with pid 593674 00:06:47.700 15:01:47 -- common/autotest_common.sh@955 -- # kill 593674 00:06:47.700 15:01:47 -- common/autotest_common.sh@960 -- # wait 593674 00:06:47.959 00:06:47.959 real 0m2.199s 00:06:47.959 user 0m6.358s 00:06:47.959 sys 0m0.455s 00:06:47.959 15:01:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.959 15:01:48 -- common/autotest_common.sh@10 -- # set +x 00:06:47.959 ************************************ 00:06:47.959 END TEST locking_overlapped_coremask 00:06:47.959 ************************************ 00:06:47.959 15:01:48 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:47.959 15:01:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:47.959 15:01:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.959 15:01:48 -- common/autotest_common.sh@10 -- # set +x 00:06:47.959 ************************************ 00:06:47.959 START TEST locking_overlapped_coremask_via_rpc 00:06:47.959 ************************************ 00:06:47.959 15:01:48 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:47.959 15:01:48 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=593980 00:06:47.959 15:01:48 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:47.959 15:01:48 -- event/cpu_locks.sh@149 -- # waitforlisten 593980 /var/tmp/spdk.sock 00:06:47.959 15:01:48 -- common/autotest_common.sh@829 -- # '[' -z 593980 ']' 00:06:47.959 15:01:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:47.959 15:01:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:47.959 15:01:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:47.959 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:47.959 15:01:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:47.959 15:01:48 -- common/autotest_common.sh@10 -- # set +x 00:06:47.959 [2024-11-28 15:01:48.178866] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:47.959 [2024-11-28 15:01:48.178968] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid593980 ] 00:06:48.218 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.218 [2024-11-28 15:01:48.240495] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:48.218 [2024-11-28 15:01:48.240542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:48.218 [2024-11-28 15:01:48.333423] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:48.218 [2024-11-28 15:01:48.333630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:48.218 [2024-11-28 15:01:48.333704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:48.218 [2024-11-28 15:01:48.333708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.151 15:01:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.151 15:01:49 -- common/autotest_common.sh@862 -- # return 0 00:06:49.151 15:01:49 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=594124 00:06:49.151 15:01:49 -- event/cpu_locks.sh@153 -- # waitforlisten 594124 /var/tmp/spdk2.sock 00:06:49.151 15:01:49 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:49.151 15:01:49 -- common/autotest_common.sh@829 -- # '[' -z 594124 ']' 00:06:49.151 15:01:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:49.151 15:01:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.151 15:01:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:49.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:49.151 15:01:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.151 15:01:49 -- common/autotest_common.sh@10 -- # set +x 00:06:49.151 [2024-11-28 15:01:49.180581] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:49.151 [2024-11-28 15:01:49.180668] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid594124 ] 00:06:49.151 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.151 [2024-11-28 15:01:49.266644] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:49.151 [2024-11-28 15:01:49.266682] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:49.409 [2024-11-28 15:01:49.441745] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:49.409 [2024-11-28 15:01:49.442043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:49.409 [2024-11-28 15:01:49.445190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:49.409 [2024-11-28 15:01:49.445193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:49.976 15:01:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.976 15:01:50 -- common/autotest_common.sh@862 -- # return 0 00:06:49.976 15:01:50 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:49.976 15:01:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.976 15:01:50 -- common/autotest_common.sh@10 -- # set +x 00:06:49.976 15:01:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.976 15:01:50 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:49.976 15:01:50 -- common/autotest_common.sh@650 -- # local es=0 00:06:49.976 15:01:50 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:49.976 15:01:50 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:49.976 15:01:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.976 15:01:50 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:49.976 15:01:50 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.976 15:01:50 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:49.976 15:01:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.976 15:01:50 -- common/autotest_common.sh@10 -- # set +x 00:06:49.976 [2024-11-28 15:01:50.148192] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 593980 has claimed it. 00:06:49.976 request: 00:06:49.976 { 00:06:49.976 "method": "framework_enable_cpumask_locks", 00:06:49.976 "req_id": 1 00:06:49.976 } 00:06:49.976 Got JSON-RPC error response 00:06:49.976 response: 00:06:49.976 { 00:06:49.976 "code": -32603, 00:06:49.976 "message": "Failed to claim CPU core: 2" 00:06:49.976 } 00:06:49.976 15:01:50 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:49.976 15:01:50 -- common/autotest_common.sh@653 -- # es=1 00:06:49.976 15:01:50 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:49.976 15:01:50 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:49.976 15:01:50 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:49.976 15:01:50 -- event/cpu_locks.sh@158 -- # waitforlisten 593980 /var/tmp/spdk.sock 00:06:49.976 15:01:50 -- common/autotest_common.sh@829 -- # '[' -z 593980 ']' 00:06:49.976 15:01:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:49.976 15:01:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:49.976 15:01:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:49.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:49.976 15:01:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:49.976 15:01:50 -- common/autotest_common.sh@10 -- # set +x 00:06:50.233 15:01:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.233 15:01:50 -- common/autotest_common.sh@862 -- # return 0 00:06:50.233 15:01:50 -- event/cpu_locks.sh@159 -- # waitforlisten 594124 /var/tmp/spdk2.sock 00:06:50.233 15:01:50 -- common/autotest_common.sh@829 -- # '[' -z 594124 ']' 00:06:50.233 15:01:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:50.233 15:01:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:50.233 15:01:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:50.233 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:50.233 15:01:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:50.233 15:01:50 -- common/autotest_common.sh@10 -- # set +x 00:06:50.491 15:01:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:50.491 15:01:50 -- common/autotest_common.sh@862 -- # return 0 00:06:50.491 15:01:50 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:50.491 15:01:50 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:50.491 15:01:50 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:50.491 15:01:50 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:50.491 00:06:50.491 real 0m2.557s 00:06:50.491 user 0m1.300s 00:06:50.491 sys 0m0.192s 00:06:50.491 15:01:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.491 15:01:50 -- common/autotest_common.sh@10 -- # set +x 00:06:50.491 ************************************ 00:06:50.491 END TEST locking_overlapped_coremask_via_rpc 00:06:50.491 ************************************ 00:06:50.491 15:01:50 -- event/cpu_locks.sh@174 -- # cleanup 00:06:50.491 15:01:50 -- event/cpu_locks.sh@15 -- # [[ -z 593980 ]] 00:06:50.491 15:01:50 -- event/cpu_locks.sh@15 -- # killprocess 593980 00:06:50.491 15:01:50 -- common/autotest_common.sh@936 -- # '[' -z 593980 ']' 00:06:50.491 15:01:50 -- common/autotest_common.sh@940 -- # kill -0 593980 00:06:50.491 15:01:50 -- common/autotest_common.sh@941 -- # uname 00:06:50.491 15:01:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:50.491 15:01:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 593980 00:06:50.749 15:01:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:50.749 15:01:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:50.749 15:01:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 593980' 00:06:50.749 killing process with pid 593980 00:06:50.749 15:01:50 -- common/autotest_common.sh@955 -- # kill 593980 00:06:50.749 15:01:50 -- common/autotest_common.sh@960 -- # wait 593980 00:06:51.007 15:01:51 -- event/cpu_locks.sh@16 -- # [[ -z 594124 ]] 00:06:51.007 15:01:51 -- event/cpu_locks.sh@16 -- # killprocess 594124 00:06:51.007 15:01:51 -- common/autotest_common.sh@936 -- # '[' -z 594124 ']' 00:06:51.007 15:01:51 -- common/autotest_common.sh@940 -- # kill -0 594124 00:06:51.007 15:01:51 -- common/autotest_common.sh@941 -- # uname 00:06:51.007 15:01:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:51.007 15:01:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 594124 00:06:51.007 15:01:51 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:51.007 15:01:51 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:51.007 15:01:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 594124' 00:06:51.007 killing process with pid 594124 00:06:51.007 15:01:51 -- common/autotest_common.sh@955 -- # kill 594124 00:06:51.007 15:01:51 -- common/autotest_common.sh@960 -- # wait 594124 00:06:51.574 15:01:51 -- event/cpu_locks.sh@18 -- # rm -f 00:06:51.574 15:01:51 -- event/cpu_locks.sh@1 -- # cleanup 00:06:51.574 15:01:51 -- event/cpu_locks.sh@15 -- # [[ -z 593980 ]] 00:06:51.574 15:01:51 -- event/cpu_locks.sh@15 -- # killprocess 593980 00:06:51.574 15:01:51 -- common/autotest_common.sh@936 -- # '[' -z 593980 ']' 00:06:51.574 15:01:51 -- common/autotest_common.sh@940 -- # kill -0 593980 00:06:51.574 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (593980) - No such process 00:06:51.574 15:01:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 593980 is not found' 00:06:51.574 Process with pid 593980 is not found 00:06:51.574 15:01:51 -- event/cpu_locks.sh@16 -- # [[ -z 594124 ]] 00:06:51.574 15:01:51 -- event/cpu_locks.sh@16 -- # killprocess 594124 00:06:51.574 15:01:51 -- common/autotest_common.sh@936 -- # '[' -z 594124 ']' 00:06:51.574 15:01:51 -- common/autotest_common.sh@940 -- # kill -0 594124 00:06:51.574 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (594124) - No such process 00:06:51.574 15:01:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 594124 is not found' 00:06:51.574 Process with pid 594124 is not found 00:06:51.574 15:01:51 -- event/cpu_locks.sh@18 -- # rm -f 00:06:51.574 00:06:51.574 real 0m19.225s 00:06:51.574 user 0m35.052s 00:06:51.574 sys 0m5.405s 00:06:51.574 15:01:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.574 15:01:51 -- common/autotest_common.sh@10 -- # set +x 00:06:51.574 ************************************ 00:06:51.574 END TEST cpu_locks 00:06:51.574 ************************************ 00:06:51.574 00:06:51.574 real 0m45.685s 00:06:51.574 user 1m28.497s 00:06:51.574 sys 0m9.330s 00:06:51.574 15:01:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:51.574 15:01:51 -- common/autotest_common.sh@10 -- # set +x 00:06:51.574 ************************************ 00:06:51.574 END TEST event 00:06:51.574 ************************************ 00:06:51.574 15:01:51 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:51.574 15:01:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:51.574 15:01:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.574 15:01:51 -- common/autotest_common.sh@10 -- # set +x 00:06:51.574 ************************************ 00:06:51.574 START TEST thread 00:06:51.574 ************************************ 00:06:51.574 15:01:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:51.574 * Looking for test storage... 00:06:51.574 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:51.574 15:01:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:51.574 15:01:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:51.574 15:01:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:51.574 15:01:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:51.574 15:01:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:51.574 15:01:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:51.574 15:01:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:51.574 15:01:51 -- scripts/common.sh@335 -- # IFS=.-: 00:06:51.574 15:01:51 -- scripts/common.sh@335 -- # read -ra ver1 00:06:51.574 15:01:51 -- scripts/common.sh@336 -- # IFS=.-: 00:06:51.574 15:01:51 -- scripts/common.sh@336 -- # read -ra ver2 00:06:51.574 15:01:51 -- scripts/common.sh@337 -- # local 'op=<' 00:06:51.574 15:01:51 -- scripts/common.sh@339 -- # ver1_l=2 00:06:51.575 15:01:51 -- scripts/common.sh@340 -- # ver2_l=1 00:06:51.575 15:01:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:51.575 15:01:51 -- scripts/common.sh@343 -- # case "$op" in 00:06:51.575 15:01:51 -- scripts/common.sh@344 -- # : 1 00:06:51.575 15:01:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:51.575 15:01:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:51.575 15:01:51 -- scripts/common.sh@364 -- # decimal 1 00:06:51.575 15:01:51 -- scripts/common.sh@352 -- # local d=1 00:06:51.575 15:01:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:51.575 15:01:51 -- scripts/common.sh@354 -- # echo 1 00:06:51.575 15:01:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:51.575 15:01:51 -- scripts/common.sh@365 -- # decimal 2 00:06:51.575 15:01:51 -- scripts/common.sh@352 -- # local d=2 00:06:51.575 15:01:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:51.575 15:01:51 -- scripts/common.sh@354 -- # echo 2 00:06:51.575 15:01:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:51.575 15:01:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:51.575 15:01:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:51.575 15:01:51 -- scripts/common.sh@367 -- # return 0 00:06:51.575 15:01:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:51.575 15:01:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:51.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.575 --rc genhtml_branch_coverage=1 00:06:51.575 --rc genhtml_function_coverage=1 00:06:51.575 --rc genhtml_legend=1 00:06:51.575 --rc geninfo_all_blocks=1 00:06:51.575 --rc geninfo_unexecuted_blocks=1 00:06:51.575 00:06:51.575 ' 00:06:51.575 15:01:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:51.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.575 --rc genhtml_branch_coverage=1 00:06:51.575 --rc genhtml_function_coverage=1 00:06:51.575 --rc genhtml_legend=1 00:06:51.575 --rc geninfo_all_blocks=1 00:06:51.575 --rc geninfo_unexecuted_blocks=1 00:06:51.575 00:06:51.575 ' 00:06:51.575 15:01:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:51.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.575 --rc genhtml_branch_coverage=1 00:06:51.575 --rc genhtml_function_coverage=1 00:06:51.575 --rc genhtml_legend=1 00:06:51.575 --rc geninfo_all_blocks=1 00:06:51.575 --rc geninfo_unexecuted_blocks=1 00:06:51.575 00:06:51.575 ' 00:06:51.575 15:01:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:51.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:51.575 --rc genhtml_branch_coverage=1 00:06:51.575 --rc genhtml_function_coverage=1 00:06:51.575 --rc genhtml_legend=1 00:06:51.575 --rc geninfo_all_blocks=1 00:06:51.575 --rc geninfo_unexecuted_blocks=1 00:06:51.575 00:06:51.575 ' 00:06:51.575 15:01:51 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:51.575 15:01:51 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:51.575 15:01:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:51.575 15:01:51 -- common/autotest_common.sh@10 -- # set +x 00:06:51.575 ************************************ 00:06:51.575 START TEST thread_poller_perf 00:06:51.575 ************************************ 00:06:51.575 15:01:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:51.575 [2024-11-28 15:01:51.795113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:51.575 [2024-11-28 15:01:51.795203] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid594624 ] 00:06:51.834 EAL: No free 2048 kB hugepages reported on node 1 00:06:51.834 [2024-11-28 15:01:51.850934] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:51.834 [2024-11-28 15:01:51.934547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:51.834 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:53.208 [2024-11-28T14:01:53.442Z] ====================================== 00:06:53.208 [2024-11-28T14:01:53.442Z] busy:2715502713 (cyc) 00:06:53.208 [2024-11-28T14:01:53.442Z] total_run_count: 280000 00:06:53.208 [2024-11-28T14:01:53.442Z] tsc_hz: 2700000000 (cyc) 00:06:53.208 [2024-11-28T14:01:53.442Z] ====================================== 00:06:53.208 [2024-11-28T14:01:53.442Z] poller_cost: 9698 (cyc), 3591 (nsec) 00:06:53.208 00:06:53.208 real 0m1.236s 00:06:53.208 user 0m1.157s 00:06:53.208 sys 0m0.073s 00:06:53.208 15:01:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.208 15:01:53 -- common/autotest_common.sh@10 -- # set +x 00:06:53.208 ************************************ 00:06:53.208 END TEST thread_poller_perf 00:06:53.208 ************************************ 00:06:53.208 15:01:53 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:53.208 15:01:53 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:53.208 15:01:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.208 15:01:53 -- common/autotest_common.sh@10 -- # set +x 00:06:53.208 ************************************ 00:06:53.208 START TEST thread_poller_perf 00:06:53.208 ************************************ 00:06:53.209 15:01:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:53.209 [2024-11-28 15:01:53.057160] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:53.209 [2024-11-28 15:01:53.057237] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid594782 ] 00:06:53.209 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.209 [2024-11-28 15:01:53.116832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.209 [2024-11-28 15:01:53.207981] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.209 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:54.143 [2024-11-28T14:01:54.377Z] ====================================== 00:06:54.143 [2024-11-28T14:01:54.377Z] busy:2703559190 (cyc) 00:06:54.143 [2024-11-28T14:01:54.377Z] total_run_count: 3915000 00:06:54.143 [2024-11-28T14:01:54.377Z] tsc_hz: 2700000000 (cyc) 00:06:54.143 [2024-11-28T14:01:54.377Z] ====================================== 00:06:54.143 [2024-11-28T14:01:54.377Z] poller_cost: 690 (cyc), 255 (nsec) 00:06:54.143 00:06:54.143 real 0m1.246s 00:06:54.143 user 0m1.159s 00:06:54.143 sys 0m0.080s 00:06:54.143 15:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.143 15:01:54 -- common/autotest_common.sh@10 -- # set +x 00:06:54.143 ************************************ 00:06:54.143 END TEST thread_poller_perf 00:06:54.143 ************************************ 00:06:54.143 15:01:54 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:54.143 00:06:54.143 real 0m2.676s 00:06:54.143 user 0m2.435s 00:06:54.143 sys 0m0.245s 00:06:54.143 15:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.143 15:01:54 -- common/autotest_common.sh@10 -- # set +x 00:06:54.143 ************************************ 00:06:54.143 END TEST thread 00:06:54.143 ************************************ 00:06:54.143 15:01:54 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:54.143 15:01:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:54.143 15:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.143 15:01:54 -- common/autotest_common.sh@10 -- # set +x 00:06:54.143 ************************************ 00:06:54.143 START TEST accel 00:06:54.143 ************************************ 00:06:54.143 15:01:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:54.402 * Looking for test storage... 00:06:54.402 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:54.402 15:01:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:54.402 15:01:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:54.402 15:01:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:54.402 15:01:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:54.402 15:01:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:54.402 15:01:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:54.402 15:01:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:54.402 15:01:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:54.402 15:01:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:54.402 15:01:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:54.402 15:01:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:54.402 15:01:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:54.402 15:01:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:54.402 15:01:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:54.402 15:01:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:54.402 15:01:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:54.402 15:01:54 -- scripts/common.sh@344 -- # : 1 00:06:54.402 15:01:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:54.402 15:01:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:54.402 15:01:54 -- scripts/common.sh@364 -- # decimal 1 00:06:54.402 15:01:54 -- scripts/common.sh@352 -- # local d=1 00:06:54.402 15:01:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:54.402 15:01:54 -- scripts/common.sh@354 -- # echo 1 00:06:54.402 15:01:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:54.402 15:01:54 -- scripts/common.sh@365 -- # decimal 2 00:06:54.403 15:01:54 -- scripts/common.sh@352 -- # local d=2 00:06:54.403 15:01:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:54.403 15:01:54 -- scripts/common.sh@354 -- # echo 2 00:06:54.403 15:01:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:54.403 15:01:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:54.403 15:01:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:54.403 15:01:54 -- scripts/common.sh@367 -- # return 0 00:06:54.403 15:01:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:54.403 15:01:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:54.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.403 --rc genhtml_branch_coverage=1 00:06:54.403 --rc genhtml_function_coverage=1 00:06:54.403 --rc genhtml_legend=1 00:06:54.403 --rc geninfo_all_blocks=1 00:06:54.403 --rc geninfo_unexecuted_blocks=1 00:06:54.403 00:06:54.403 ' 00:06:54.403 15:01:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:54.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.403 --rc genhtml_branch_coverage=1 00:06:54.403 --rc genhtml_function_coverage=1 00:06:54.403 --rc genhtml_legend=1 00:06:54.403 --rc geninfo_all_blocks=1 00:06:54.403 --rc geninfo_unexecuted_blocks=1 00:06:54.403 00:06:54.403 ' 00:06:54.403 15:01:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:54.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.403 --rc genhtml_branch_coverage=1 00:06:54.403 --rc genhtml_function_coverage=1 00:06:54.403 --rc genhtml_legend=1 00:06:54.403 --rc geninfo_all_blocks=1 00:06:54.403 --rc geninfo_unexecuted_blocks=1 00:06:54.403 00:06:54.403 ' 00:06:54.403 15:01:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:54.403 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:54.403 --rc genhtml_branch_coverage=1 00:06:54.403 --rc genhtml_function_coverage=1 00:06:54.403 --rc genhtml_legend=1 00:06:54.403 --rc geninfo_all_blocks=1 00:06:54.403 --rc geninfo_unexecuted_blocks=1 00:06:54.403 00:06:54.403 ' 00:06:54.403 15:01:54 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:54.403 15:01:54 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:54.403 15:01:54 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:54.403 15:01:54 -- accel/accel.sh@59 -- # spdk_tgt_pid=594992 00:06:54.403 15:01:54 -- accel/accel.sh@60 -- # waitforlisten 594992 00:06:54.403 15:01:54 -- common/autotest_common.sh@829 -- # '[' -z 594992 ']' 00:06:54.403 15:01:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:54.403 15:01:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:54.403 15:01:54 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:54.403 15:01:54 -- accel/accel.sh@58 -- # build_accel_config 00:06:54.403 15:01:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:54.403 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:54.403 15:01:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:54.403 15:01:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:54.403 15:01:54 -- common/autotest_common.sh@10 -- # set +x 00:06:54.403 15:01:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:54.403 15:01:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:54.403 15:01:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:54.403 15:01:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:54.403 15:01:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:54.403 15:01:54 -- accel/accel.sh@42 -- # jq -r . 00:06:54.403 [2024-11-28 15:01:54.537853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:54.403 [2024-11-28 15:01:54.537925] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid594992 ] 00:06:54.403 EAL: No free 2048 kB hugepages reported on node 1 00:06:54.403 [2024-11-28 15:01:54.598283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:54.661 [2024-11-28 15:01:54.686450] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:54.661 [2024-11-28 15:01:54.686641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.595 15:01:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:55.595 15:01:55 -- common/autotest_common.sh@862 -- # return 0 00:06:55.595 15:01:55 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:55.595 15:01:55 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:55.595 15:01:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:55.595 15:01:55 -- common/autotest_common.sh@10 -- # set +x 00:06:55.595 15:01:55 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:55.595 15:01:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # IFS== 00:06:55.595 15:01:55 -- accel/accel.sh@64 -- # read -r opc module 00:06:55.595 15:01:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:55.595 15:01:55 -- accel/accel.sh@67 -- # killprocess 594992 00:06:55.595 15:01:55 -- common/autotest_common.sh@936 -- # '[' -z 594992 ']' 00:06:55.595 15:01:55 -- common/autotest_common.sh@940 -- # kill -0 594992 00:06:55.595 15:01:55 -- common/autotest_common.sh@941 -- # uname 00:06:55.595 15:01:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:55.596 15:01:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 594992 00:06:55.596 15:01:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:55.596 15:01:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:55.596 15:01:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 594992' 00:06:55.596 killing process with pid 594992 00:06:55.596 15:01:55 -- common/autotest_common.sh@955 -- # kill 594992 00:06:55.596 15:01:55 -- common/autotest_common.sh@960 -- # wait 594992 00:06:55.854 15:01:56 -- accel/accel.sh@68 -- # trap - ERR 00:06:55.854 15:01:56 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:55.854 15:01:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:55.854 15:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.854 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:55.854 15:01:56 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:55.854 15:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:55.854 15:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.854 15:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.854 15:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.854 15:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.854 15:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.854 15:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.854 15:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.854 15:01:56 -- accel/accel.sh@42 -- # jq -r . 00:06:55.854 15:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:55.854 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:55.854 15:01:56 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:55.854 15:01:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:55.854 15:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:55.854 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:55.854 ************************************ 00:06:55.854 START TEST accel_missing_filename 00:06:55.854 ************************************ 00:06:55.854 15:01:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:55.854 15:01:56 -- common/autotest_common.sh@650 -- # local es=0 00:06:55.854 15:01:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:55.854 15:01:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:55.854 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.854 15:01:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:55.854 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:55.854 15:01:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:55.854 15:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:55.854 15:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.854 15:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.854 15:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.854 15:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.854 15:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.854 15:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.854 15:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.854 15:01:56 -- accel/accel.sh@42 -- # jq -r . 00:06:55.854 [2024-11-28 15:01:56.083323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:55.854 [2024-11-28 15:01:56.083392] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid595165 ] 00:06:56.112 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.112 [2024-11-28 15:01:56.145280] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.112 [2024-11-28 15:01:56.234780] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.112 [2024-11-28 15:01:56.296467] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:56.370 [2024-11-28 15:01:56.377788] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:56.370 A filename is required. 00:06:56.370 15:01:56 -- common/autotest_common.sh@653 -- # es=234 00:06:56.370 15:01:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.370 15:01:56 -- common/autotest_common.sh@662 -- # es=106 00:06:56.370 15:01:56 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:56.370 15:01:56 -- common/autotest_common.sh@670 -- # es=1 00:06:56.370 15:01:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.370 00:06:56.370 real 0m0.387s 00:06:56.370 user 0m0.284s 00:06:56.370 sys 0m0.136s 00:06:56.370 15:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.371 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.371 ************************************ 00:06:56.371 END TEST accel_missing_filename 00:06:56.371 ************************************ 00:06:56.371 15:01:56 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:56.371 15:01:56 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:56.371 15:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.371 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.371 ************************************ 00:06:56.371 START TEST accel_compress_verify 00:06:56.371 ************************************ 00:06:56.371 15:01:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:56.371 15:01:56 -- common/autotest_common.sh@650 -- # local es=0 00:06:56.371 15:01:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:56.371 15:01:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:56.371 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.371 15:01:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:56.371 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.371 15:01:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:56.371 15:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:56.371 15:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.371 15:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.371 15:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.371 15:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.371 15:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.371 15:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.371 15:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.371 15:01:56 -- accel/accel.sh@42 -- # jq -r . 00:06:56.371 [2024-11-28 15:01:56.499634] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.371 [2024-11-28 15:01:56.499710] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid595313 ] 00:06:56.371 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.371 [2024-11-28 15:01:56.561048] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.629 [2024-11-28 15:01:56.653128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.629 [2024-11-28 15:01:56.712309] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:56.629 [2024-11-28 15:01:56.794485] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:56.889 00:06:56.889 Compression does not support the verify option, aborting. 00:06:56.889 15:01:56 -- common/autotest_common.sh@653 -- # es=161 00:06:56.889 15:01:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.889 15:01:56 -- common/autotest_common.sh@662 -- # es=33 00:06:56.889 15:01:56 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:56.889 15:01:56 -- common/autotest_common.sh@670 -- # es=1 00:06:56.889 15:01:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.889 00:06:56.889 real 0m0.396s 00:06:56.889 user 0m0.285s 00:06:56.889 sys 0m0.146s 00:06:56.889 15:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.889 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.889 ************************************ 00:06:56.889 END TEST accel_compress_verify 00:06:56.889 ************************************ 00:06:56.889 15:01:56 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:56.889 15:01:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:56.889 15:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.889 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.889 ************************************ 00:06:56.889 START TEST accel_wrong_workload 00:06:56.889 ************************************ 00:06:56.889 15:01:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:56.889 15:01:56 -- common/autotest_common.sh@650 -- # local es=0 00:06:56.889 15:01:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:56.889 15:01:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:56.889 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.889 15:01:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:56.889 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.889 15:01:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:56.889 15:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:56.889 15:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.889 15:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.889 15:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.889 15:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.889 15:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.889 15:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.889 15:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.889 15:01:56 -- accel/accel.sh@42 -- # jq -r . 00:06:56.889 Unsupported workload type: foobar 00:06:56.889 [2024-11-28 15:01:56.920476] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:56.889 accel_perf options: 00:06:56.889 [-h help message] 00:06:56.889 [-q queue depth per core] 00:06:56.889 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:56.889 [-T number of threads per core 00:06:56.889 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:56.889 [-t time in seconds] 00:06:56.889 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:56.889 [ dif_verify, , dif_generate, dif_generate_copy 00:06:56.889 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:56.889 [-l for compress/decompress workloads, name of uncompressed input file 00:06:56.889 [-S for crc32c workload, use this seed value (default 0) 00:06:56.889 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:56.889 [-f for fill workload, use this BYTE value (default 255) 00:06:56.889 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:56.889 [-y verify result if this switch is on] 00:06:56.889 [-a tasks to allocate per core (default: same value as -q)] 00:06:56.889 Can be used to spread operations across a wider range of memory. 00:06:56.889 15:01:56 -- common/autotest_common.sh@653 -- # es=1 00:06:56.889 15:01:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.889 15:01:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:56.889 15:01:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.889 00:06:56.889 real 0m0.023s 00:06:56.889 user 0m0.015s 00:06:56.889 sys 0m0.007s 00:06:56.889 15:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.889 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.889 ************************************ 00:06:56.889 END TEST accel_wrong_workload 00:06:56.889 ************************************ 00:06:56.889 Error: writing output failed: Broken pipe 00:06:56.889 15:01:56 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:56.889 15:01:56 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:56.889 15:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.889 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.889 ************************************ 00:06:56.889 START TEST accel_negative_buffers 00:06:56.889 ************************************ 00:06:56.889 15:01:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:56.889 15:01:56 -- common/autotest_common.sh@650 -- # local es=0 00:06:56.889 15:01:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:56.889 15:01:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:56.889 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.889 15:01:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:56.889 15:01:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:56.889 15:01:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:56.889 15:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:56.889 15:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.889 15:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.889 15:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.889 15:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.889 15:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.889 15:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.889 15:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.889 15:01:56 -- accel/accel.sh@42 -- # jq -r . 00:06:56.890 -x option must be non-negative. 00:06:56.890 [2024-11-28 15:01:56.971423] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:56.890 accel_perf options: 00:06:56.890 [-h help message] 00:06:56.890 [-q queue depth per core] 00:06:56.890 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:56.890 [-T number of threads per core 00:06:56.890 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:56.890 [-t time in seconds] 00:06:56.890 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:56.890 [ dif_verify, , dif_generate, dif_generate_copy 00:06:56.890 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:56.890 [-l for compress/decompress workloads, name of uncompressed input file 00:06:56.890 [-S for crc32c workload, use this seed value (default 0) 00:06:56.890 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:56.890 [-f for fill workload, use this BYTE value (default 255) 00:06:56.890 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:56.890 [-y verify result if this switch is on] 00:06:56.890 [-a tasks to allocate per core (default: same value as -q)] 00:06:56.890 Can be used to spread operations across a wider range of memory. 00:06:56.890 15:01:56 -- common/autotest_common.sh@653 -- # es=1 00:06:56.890 15:01:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:56.890 15:01:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:56.890 15:01:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:56.890 00:06:56.890 real 0m0.025s 00:06:56.890 user 0m0.014s 00:06:56.890 sys 0m0.010s 00:06:56.890 15:01:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.890 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.890 ************************************ 00:06:56.890 END TEST accel_negative_buffers 00:06:56.890 ************************************ 00:06:56.890 Error: writing output failed: Broken pipe 00:06:56.890 15:01:56 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:56.890 15:01:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:56.890 15:01:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.890 15:01:56 -- common/autotest_common.sh@10 -- # set +x 00:06:56.890 ************************************ 00:06:56.890 START TEST accel_crc32c 00:06:56.890 ************************************ 00:06:56.890 15:01:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:56.890 15:01:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.890 15:01:57 -- accel/accel.sh@17 -- # local accel_module 00:06:56.890 15:01:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:56.890 15:01:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:56.890 15:01:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.890 15:01:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.890 15:01:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.890 15:01:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.890 15:01:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.890 15:01:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.890 15:01:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.890 15:01:57 -- accel/accel.sh@42 -- # jq -r . 00:06:56.890 [2024-11-28 15:01:57.017810] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:56.890 [2024-11-28 15:01:57.017873] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid595372 ] 00:06:56.890 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.890 [2024-11-28 15:01:57.078904] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.148 [2024-11-28 15:01:57.170881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.521 15:01:58 -- accel/accel.sh@18 -- # out=' 00:06:58.521 SPDK Configuration: 00:06:58.521 Core mask: 0x1 00:06:58.521 00:06:58.521 Accel Perf Configuration: 00:06:58.521 Workload Type: crc32c 00:06:58.521 CRC-32C seed: 32 00:06:58.521 Transfer size: 4096 bytes 00:06:58.521 Vector count 1 00:06:58.521 Module: software 00:06:58.521 Queue depth: 32 00:06:58.521 Allocate depth: 32 00:06:58.521 # threads/core: 1 00:06:58.521 Run time: 1 seconds 00:06:58.521 Verify: Yes 00:06:58.521 00:06:58.521 Running for 1 seconds... 00:06:58.521 00:06:58.521 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:58.521 ------------------------------------------------------------------------------------ 00:06:58.521 0,0 407008/s 1589 MiB/s 0 0 00:06:58.521 ==================================================================================== 00:06:58.521 Total 407008/s 1589 MiB/s 0 0' 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:58.521 15:01:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:58.521 15:01:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:58.521 15:01:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:58.521 15:01:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:58.521 15:01:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:58.521 15:01:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:58.521 15:01:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:58.521 15:01:58 -- accel/accel.sh@42 -- # jq -r . 00:06:58.521 [2024-11-28 15:01:58.422645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:58.521 [2024-11-28 15:01:58.422723] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid595527 ] 00:06:58.521 EAL: No free 2048 kB hugepages reported on node 1 00:06:58.521 [2024-11-28 15:01:58.482685] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:58.521 [2024-11-28 15:01:58.572901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val=0x1 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val=crc32c 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.521 15:01:58 -- accel/accel.sh@21 -- # val=32 00:06:58.521 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.521 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val=software 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@23 -- # accel_module=software 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val=32 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val=32 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val=1 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val=Yes 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:58.522 15:01:58 -- accel/accel.sh@21 -- # val= 00:06:58.522 15:01:58 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:58.522 15:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@21 -- # val= 00:06:59.895 15:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@21 -- # val= 00:06:59.895 15:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@21 -- # val= 00:06:59.895 15:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@21 -- # val= 00:06:59.895 15:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@21 -- # val= 00:06:59.895 15:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@21 -- # val= 00:06:59.895 15:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:59.895 15:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:59.895 15:01:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:59.895 15:01:59 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:59.895 15:01:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.895 00:06:59.895 real 0m2.805s 00:06:59.895 user 0m2.512s 00:06:59.895 sys 0m0.287s 00:06:59.895 15:01:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.895 15:01:59 -- common/autotest_common.sh@10 -- # set +x 00:06:59.895 ************************************ 00:06:59.895 END TEST accel_crc32c 00:06:59.895 ************************************ 00:06:59.895 15:01:59 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:59.895 15:01:59 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:59.895 15:01:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.895 15:01:59 -- common/autotest_common.sh@10 -- # set +x 00:06:59.895 ************************************ 00:06:59.895 START TEST accel_crc32c_C2 00:06:59.895 ************************************ 00:06:59.895 15:01:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:59.895 15:01:59 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.895 15:01:59 -- accel/accel.sh@17 -- # local accel_module 00:06:59.895 15:01:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:59.895 15:01:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:59.895 15:01:59 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.895 15:01:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.895 15:01:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.895 15:01:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.895 15:01:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.895 15:01:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.895 15:01:59 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.895 15:01:59 -- accel/accel.sh@42 -- # jq -r . 00:06:59.895 [2024-11-28 15:01:59.846824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:06:59.895 [2024-11-28 15:01:59.846901] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid595794 ] 00:06:59.895 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.895 [2024-11-28 15:01:59.909620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.895 [2024-11-28 15:02:00.000955] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.268 15:02:01 -- accel/accel.sh@18 -- # out=' 00:07:01.268 SPDK Configuration: 00:07:01.268 Core mask: 0x1 00:07:01.268 00:07:01.268 Accel Perf Configuration: 00:07:01.268 Workload Type: crc32c 00:07:01.268 CRC-32C seed: 0 00:07:01.268 Transfer size: 4096 bytes 00:07:01.268 Vector count 2 00:07:01.268 Module: software 00:07:01.268 Queue depth: 32 00:07:01.268 Allocate depth: 32 00:07:01.268 # threads/core: 1 00:07:01.268 Run time: 1 seconds 00:07:01.268 Verify: Yes 00:07:01.268 00:07:01.268 Running for 1 seconds... 00:07:01.268 00:07:01.268 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:01.268 ------------------------------------------------------------------------------------ 00:07:01.268 0,0 314848/s 2459 MiB/s 0 0 00:07:01.268 ==================================================================================== 00:07:01.268 Total 314848/s 1229 MiB/s 0 0' 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:07:01.268 15:02:01 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.268 15:02:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.268 15:02:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.268 15:02:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.268 15:02:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.268 15:02:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.268 15:02:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.268 15:02:01 -- accel/accel.sh@42 -- # jq -r . 00:07:01.268 [2024-11-28 15:02:01.257459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:01.268 [2024-11-28 15:02:01.257537] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid595937 ] 00:07:01.268 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.268 [2024-11-28 15:02:01.318640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.268 [2024-11-28 15:02:01.408370] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val=0x1 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val=crc32c 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val=0 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.268 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.268 15:02:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:01.268 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val=software 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@23 -- # accel_module=software 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val=32 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val=32 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val=1 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val=Yes 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:01.269 15:02:01 -- accel/accel.sh@21 -- # val= 00:07:01.269 15:02:01 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # IFS=: 00:07:01.269 15:02:01 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@21 -- # val= 00:07:02.703 15:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@21 -- # val= 00:07:02.703 15:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@21 -- # val= 00:07:02.703 15:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@21 -- # val= 00:07:02.703 15:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@21 -- # val= 00:07:02.703 15:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@21 -- # val= 00:07:02.703 15:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # IFS=: 00:07:02.703 15:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:02.703 15:02:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:02.703 15:02:02 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:07:02.703 15:02:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:02.703 00:07:02.703 real 0m2.811s 00:07:02.703 user 0m2.508s 00:07:02.703 sys 0m0.295s 00:07:02.703 15:02:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.703 15:02:02 -- common/autotest_common.sh@10 -- # set +x 00:07:02.703 ************************************ 00:07:02.703 END TEST accel_crc32c_C2 00:07:02.703 ************************************ 00:07:02.703 15:02:02 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:07:02.703 15:02:02 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:02.703 15:02:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.703 15:02:02 -- common/autotest_common.sh@10 -- # set +x 00:07:02.703 ************************************ 00:07:02.703 START TEST accel_copy 00:07:02.703 ************************************ 00:07:02.703 15:02:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:07:02.703 15:02:02 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.703 15:02:02 -- accel/accel.sh@17 -- # local accel_module 00:07:02.703 15:02:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:07:02.703 15:02:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:02.703 15:02:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.703 15:02:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.703 15:02:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.703 15:02:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.703 15:02:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.703 15:02:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.703 15:02:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.703 15:02:02 -- accel/accel.sh@42 -- # jq -r . 00:07:02.703 [2024-11-28 15:02:02.683848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:02.703 [2024-11-28 15:02:02.683925] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid596099 ] 00:07:02.703 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.703 [2024-11-28 15:02:02.745046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.703 [2024-11-28 15:02:02.835826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.072 15:02:04 -- accel/accel.sh@18 -- # out=' 00:07:04.072 SPDK Configuration: 00:07:04.072 Core mask: 0x1 00:07:04.072 00:07:04.072 Accel Perf Configuration: 00:07:04.072 Workload Type: copy 00:07:04.072 Transfer size: 4096 bytes 00:07:04.072 Vector count 1 00:07:04.072 Module: software 00:07:04.072 Queue depth: 32 00:07:04.072 Allocate depth: 32 00:07:04.072 # threads/core: 1 00:07:04.072 Run time: 1 seconds 00:07:04.072 Verify: Yes 00:07:04.072 00:07:04.072 Running for 1 seconds... 00:07:04.072 00:07:04.072 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:04.072 ------------------------------------------------------------------------------------ 00:07:04.072 0,0 281472/s 1099 MiB/s 0 0 00:07:04.072 ==================================================================================== 00:07:04.072 Total 281472/s 1099 MiB/s 0 0' 00:07:04.072 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.072 15:02:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:07:04.072 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.072 15:02:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:07:04.072 15:02:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:04.072 15:02:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:04.072 15:02:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:04.072 15:02:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:04.072 15:02:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:04.072 15:02:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:04.072 15:02:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:04.072 15:02:04 -- accel/accel.sh@42 -- # jq -r . 00:07:04.072 [2024-11-28 15:02:04.089784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:04.073 [2024-11-28 15:02:04.089870] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid596269 ] 00:07:04.073 EAL: No free 2048 kB hugepages reported on node 1 00:07:04.073 [2024-11-28 15:02:04.154856] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:04.073 [2024-11-28 15:02:04.246424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val=0x1 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val=copy 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@24 -- # accel_opc=copy 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val=software 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@23 -- # accel_module=software 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val=32 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val=32 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val=1 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.330 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.330 15:02:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:04.330 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.331 15:02:04 -- accel/accel.sh@21 -- # val=Yes 00:07:04.331 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.331 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.331 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:04.331 15:02:04 -- accel/accel.sh@21 -- # val= 00:07:04.331 15:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:04.331 15:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@21 -- # val= 00:07:05.261 15:02:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # IFS=: 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@21 -- # val= 00:07:05.261 15:02:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # IFS=: 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@21 -- # val= 00:07:05.261 15:02:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # IFS=: 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@21 -- # val= 00:07:05.261 15:02:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # IFS=: 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@21 -- # val= 00:07:05.261 15:02:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # IFS=: 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@21 -- # val= 00:07:05.261 15:02:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # IFS=: 00:07:05.261 15:02:05 -- accel/accel.sh@20 -- # read -r var val 00:07:05.261 15:02:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.261 15:02:05 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:07:05.261 15:02:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.261 00:07:05.261 real 0m2.808s 00:07:05.261 user 0m2.512s 00:07:05.261 sys 0m0.287s 00:07:05.261 15:02:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.261 15:02:05 -- common/autotest_common.sh@10 -- # set +x 00:07:05.261 ************************************ 00:07:05.261 END TEST accel_copy 00:07:05.261 ************************************ 00:07:05.518 15:02:05 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:05.518 15:02:05 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:05.518 15:02:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.518 15:02:05 -- common/autotest_common.sh@10 -- # set +x 00:07:05.518 ************************************ 00:07:05.518 START TEST accel_fill 00:07:05.518 ************************************ 00:07:05.518 15:02:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:05.518 15:02:05 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.518 15:02:05 -- accel/accel.sh@17 -- # local accel_module 00:07:05.518 15:02:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:05.518 15:02:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:05.518 15:02:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.518 15:02:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.518 15:02:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.518 15:02:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.518 15:02:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.518 15:02:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.518 15:02:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.518 15:02:05 -- accel/accel.sh@42 -- # jq -r . 00:07:05.518 [2024-11-28 15:02:05.514204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:05.518 [2024-11-28 15:02:05.514285] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid596515 ] 00:07:05.518 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.518 [2024-11-28 15:02:05.577192] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.518 [2024-11-28 15:02:05.666769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.890 15:02:06 -- accel/accel.sh@18 -- # out=' 00:07:06.890 SPDK Configuration: 00:07:06.890 Core mask: 0x1 00:07:06.890 00:07:06.890 Accel Perf Configuration: 00:07:06.890 Workload Type: fill 00:07:06.890 Fill pattern: 0x80 00:07:06.890 Transfer size: 4096 bytes 00:07:06.890 Vector count 1 00:07:06.890 Module: software 00:07:06.890 Queue depth: 64 00:07:06.890 Allocate depth: 64 00:07:06.890 # threads/core: 1 00:07:06.890 Run time: 1 seconds 00:07:06.890 Verify: Yes 00:07:06.890 00:07:06.890 Running for 1 seconds... 00:07:06.890 00:07:06.890 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.890 ------------------------------------------------------------------------------------ 00:07:06.890 0,0 407808/s 1593 MiB/s 0 0 00:07:06.890 ==================================================================================== 00:07:06.890 Total 407808/s 1593 MiB/s 0 0' 00:07:06.890 15:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:06.890 15:02:06 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:06.890 15:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:06.890 15:02:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:06.890 15:02:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.890 15:02:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.890 15:02:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.890 15:02:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.890 15:02:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.890 15:02:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.890 15:02:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.890 15:02:06 -- accel/accel.sh@42 -- # jq -r . 00:07:06.890 [2024-11-28 15:02:06.917174] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:06.890 [2024-11-28 15:02:06.917249] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid596662 ] 00:07:06.890 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.890 [2024-11-28 15:02:06.977734] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.890 [2024-11-28 15:02:07.066751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=0x1 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=fill 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=0x80 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=software 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@23 -- # accel_module=software 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=64 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=64 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=1 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val=Yes 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.148 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.148 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.148 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.149 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.149 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:07.149 15:02:07 -- accel/accel.sh@21 -- # val= 00:07:07.149 15:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.149 15:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:07.149 15:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@21 -- # val= 00:07:08.148 15:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@21 -- # val= 00:07:08.148 15:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@21 -- # val= 00:07:08.148 15:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@21 -- # val= 00:07:08.148 15:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@21 -- # val= 00:07:08.148 15:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@21 -- # val= 00:07:08.148 15:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:08.148 15:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:08.148 15:02:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:08.148 15:02:08 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:08.148 15:02:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:08.148 00:07:08.148 real 0m2.800s 00:07:08.148 user 0m2.507s 00:07:08.148 sys 0m0.286s 00:07:08.148 15:02:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:08.148 15:02:08 -- common/autotest_common.sh@10 -- # set +x 00:07:08.148 ************************************ 00:07:08.148 END TEST accel_fill 00:07:08.148 ************************************ 00:07:08.148 15:02:08 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:08.148 15:02:08 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:08.148 15:02:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:08.148 15:02:08 -- common/autotest_common.sh@10 -- # set +x 00:07:08.148 ************************************ 00:07:08.148 START TEST accel_copy_crc32c 00:07:08.148 ************************************ 00:07:08.148 15:02:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:08.148 15:02:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:08.148 15:02:08 -- accel/accel.sh@17 -- # local accel_module 00:07:08.148 15:02:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:08.148 15:02:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:08.148 15:02:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:08.148 15:02:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:08.148 15:02:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:08.148 15:02:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:08.148 15:02:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:08.148 15:02:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:08.148 15:02:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:08.148 15:02:08 -- accel/accel.sh@42 -- # jq -r . 00:07:08.148 [2024-11-28 15:02:08.343126] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:08.148 [2024-11-28 15:02:08.343214] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid596822 ] 00:07:08.436 EAL: No free 2048 kB hugepages reported on node 1 00:07:08.436 [2024-11-28 15:02:08.406672] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:08.436 [2024-11-28 15:02:08.497941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.851 15:02:09 -- accel/accel.sh@18 -- # out=' 00:07:09.851 SPDK Configuration: 00:07:09.851 Core mask: 0x1 00:07:09.851 00:07:09.851 Accel Perf Configuration: 00:07:09.851 Workload Type: copy_crc32c 00:07:09.851 CRC-32C seed: 0 00:07:09.851 Vector size: 4096 bytes 00:07:09.852 Transfer size: 4096 bytes 00:07:09.852 Vector count 1 00:07:09.852 Module: software 00:07:09.852 Queue depth: 32 00:07:09.852 Allocate depth: 32 00:07:09.852 # threads/core: 1 00:07:09.852 Run time: 1 seconds 00:07:09.852 Verify: Yes 00:07:09.852 00:07:09.852 Running for 1 seconds... 00:07:09.852 00:07:09.852 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.852 ------------------------------------------------------------------------------------ 00:07:09.852 0,0 218592/s 853 MiB/s 0 0 00:07:09.852 ==================================================================================== 00:07:09.852 Total 218592/s 853 MiB/s 0 0' 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:09.852 15:02:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.852 15:02:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.852 15:02:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.852 15:02:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.852 15:02:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.852 15:02:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.852 15:02:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.852 15:02:09 -- accel/accel.sh@42 -- # jq -r . 00:07:09.852 [2024-11-28 15:02:09.751892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:09.852 [2024-11-28 15:02:09.751970] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid596976 ] 00:07:09.852 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.852 [2024-11-28 15:02:09.813314] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.852 [2024-11-28 15:02:09.907105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=0x1 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=0 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=software 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=32 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=32 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=1 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val=Yes 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:09.852 15:02:09 -- accel/accel.sh@21 -- # val= 00:07:09.852 15:02:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # IFS=: 00:07:09.852 15:02:09 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@21 -- # val= 00:07:11.226 15:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@21 -- # val= 00:07:11.226 15:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@21 -- # val= 00:07:11.226 15:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@21 -- # val= 00:07:11.226 15:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@21 -- # val= 00:07:11.226 15:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@21 -- # val= 00:07:11.226 15:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:11.226 15:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:11.226 15:02:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:11.226 15:02:11 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:11.226 15:02:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:11.226 00:07:11.226 real 0m2.814s 00:07:11.226 user 0m2.516s 00:07:11.226 sys 0m0.291s 00:07:11.226 15:02:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.226 15:02:11 -- common/autotest_common.sh@10 -- # set +x 00:07:11.226 ************************************ 00:07:11.227 END TEST accel_copy_crc32c 00:07:11.227 ************************************ 00:07:11.227 15:02:11 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:11.227 15:02:11 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:11.227 15:02:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.227 15:02:11 -- common/autotest_common.sh@10 -- # set +x 00:07:11.227 ************************************ 00:07:11.227 START TEST accel_copy_crc32c_C2 00:07:11.227 ************************************ 00:07:11.227 15:02:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:11.227 15:02:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.227 15:02:11 -- accel/accel.sh@17 -- # local accel_module 00:07:11.227 15:02:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:11.227 15:02:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:11.227 15:02:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.227 15:02:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.227 15:02:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.227 15:02:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.227 15:02:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.227 15:02:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.227 15:02:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.227 15:02:11 -- accel/accel.sh@42 -- # jq -r . 00:07:11.227 [2024-11-28 15:02:11.181691] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:11.227 [2024-11-28 15:02:11.181765] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid597249 ] 00:07:11.227 EAL: No free 2048 kB hugepages reported on node 1 00:07:11.227 [2024-11-28 15:02:11.242666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:11.227 [2024-11-28 15:02:11.333215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.601 15:02:12 -- accel/accel.sh@18 -- # out=' 00:07:12.601 SPDK Configuration: 00:07:12.601 Core mask: 0x1 00:07:12.601 00:07:12.601 Accel Perf Configuration: 00:07:12.601 Workload Type: copy_crc32c 00:07:12.601 CRC-32C seed: 0 00:07:12.601 Vector size: 4096 bytes 00:07:12.601 Transfer size: 8192 bytes 00:07:12.601 Vector count 2 00:07:12.601 Module: software 00:07:12.601 Queue depth: 32 00:07:12.601 Allocate depth: 32 00:07:12.601 # threads/core: 1 00:07:12.601 Run time: 1 seconds 00:07:12.601 Verify: Yes 00:07:12.601 00:07:12.601 Running for 1 seconds... 00:07:12.601 00:07:12.601 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.601 ------------------------------------------------------------------------------------ 00:07:12.601 0,0 155616/s 1215 MiB/s 0 0 00:07:12.601 ==================================================================================== 00:07:12.601 Total 155616/s 607 MiB/s 0 0' 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.601 15:02:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:12.601 15:02:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.601 15:02:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.601 15:02:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.601 15:02:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.601 15:02:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.601 15:02:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.601 15:02:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.601 15:02:12 -- accel/accel.sh@42 -- # jq -r . 00:07:12.601 [2024-11-28 15:02:12.589687] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:12.601 [2024-11-28 15:02:12.589783] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid597390 ] 00:07:12.601 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.601 [2024-11-28 15:02:12.654601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.601 [2024-11-28 15:02:12.742425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.601 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.601 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.601 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.601 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.601 15:02:12 -- accel/accel.sh@21 -- # val=0x1 00:07:12.601 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.601 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.601 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.601 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.601 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.601 15:02:12 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:12.601 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.601 15:02:12 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.601 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val=0 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val=software 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val=32 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val=32 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val=1 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val=Yes 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:12.602 15:02:12 -- accel/accel.sh@21 -- # val= 00:07:12.602 15:02:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # IFS=: 00:07:12.602 15:02:12 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@21 -- # val= 00:07:13.976 15:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@21 -- # val= 00:07:13.976 15:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@21 -- # val= 00:07:13.976 15:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@21 -- # val= 00:07:13.976 15:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@21 -- # val= 00:07:13.976 15:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@21 -- # val= 00:07:13.976 15:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:13.976 15:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:13.976 15:02:13 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.976 15:02:13 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:13.976 15:02:13 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.976 00:07:13.976 real 0m2.808s 00:07:13.976 user 0m2.510s 00:07:13.976 sys 0m0.290s 00:07:13.976 15:02:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.976 15:02:13 -- common/autotest_common.sh@10 -- # set +x 00:07:13.976 ************************************ 00:07:13.976 END TEST accel_copy_crc32c_C2 00:07:13.976 ************************************ 00:07:13.976 15:02:13 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:13.976 15:02:13 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.976 15:02:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.976 15:02:13 -- common/autotest_common.sh@10 -- # set +x 00:07:13.976 ************************************ 00:07:13.976 START TEST accel_dualcast 00:07:13.976 ************************************ 00:07:13.976 15:02:13 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:13.976 15:02:13 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.977 15:02:13 -- accel/accel.sh@17 -- # local accel_module 00:07:13.977 15:02:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:13.977 15:02:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:13.977 15:02:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.977 15:02:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.977 15:02:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.977 15:02:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.977 15:02:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.977 15:02:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.977 15:02:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.977 15:02:14 -- accel/accel.sh@42 -- # jq -r . 00:07:13.977 [2024-11-28 15:02:14.016954] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:13.977 [2024-11-28 15:02:14.017030] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid597556 ] 00:07:13.977 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.977 [2024-11-28 15:02:14.077494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.977 [2024-11-28 15:02:14.168123] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.351 15:02:15 -- accel/accel.sh@18 -- # out=' 00:07:15.351 SPDK Configuration: 00:07:15.351 Core mask: 0x1 00:07:15.351 00:07:15.351 Accel Perf Configuration: 00:07:15.351 Workload Type: dualcast 00:07:15.351 Transfer size: 4096 bytes 00:07:15.351 Vector count 1 00:07:15.351 Module: software 00:07:15.351 Queue depth: 32 00:07:15.351 Allocate depth: 32 00:07:15.351 # threads/core: 1 00:07:15.351 Run time: 1 seconds 00:07:15.351 Verify: Yes 00:07:15.351 00:07:15.351 Running for 1 seconds... 00:07:15.351 00:07:15.351 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:15.351 ------------------------------------------------------------------------------------ 00:07:15.351 0,0 299424/s 1169 MiB/s 0 0 00:07:15.351 ==================================================================================== 00:07:15.351 Total 299424/s 1169 MiB/s 0 0' 00:07:15.351 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.351 15:02:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:15.351 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.351 15:02:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:15.351 15:02:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:15.351 15:02:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:15.351 15:02:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:15.351 15:02:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:15.351 15:02:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:15.351 15:02:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:15.351 15:02:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:15.351 15:02:15 -- accel/accel.sh@42 -- # jq -r . 00:07:15.351 [2024-11-28 15:02:15.421960] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:15.351 [2024-11-28 15:02:15.422049] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid597694 ] 00:07:15.351 EAL: No free 2048 kB hugepages reported on node 1 00:07:15.351 [2024-11-28 15:02:15.483704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:15.351 [2024-11-28 15:02:15.578163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val=0x1 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val=dualcast 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.609 15:02:15 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:15.609 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.609 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val=software 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@23 -- # accel_module=software 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val=32 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val=32 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val=1 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val=Yes 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:15.610 15:02:15 -- accel/accel.sh@21 -- # val= 00:07:15.610 15:02:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:15.610 15:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@21 -- # val= 00:07:16.984 15:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@21 -- # val= 00:07:16.984 15:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@21 -- # val= 00:07:16.984 15:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@21 -- # val= 00:07:16.984 15:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@21 -- # val= 00:07:16.984 15:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@21 -- # val= 00:07:16.984 15:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:16.984 15:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:16.984 15:02:16 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.984 15:02:16 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:16.984 15:02:16 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.984 00:07:16.984 real 0m2.805s 00:07:16.984 user 0m2.507s 00:07:16.984 sys 0m0.290s 00:07:16.984 15:02:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.984 15:02:16 -- common/autotest_common.sh@10 -- # set +x 00:07:16.984 ************************************ 00:07:16.984 END TEST accel_dualcast 00:07:16.984 ************************************ 00:07:16.984 15:02:16 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:16.984 15:02:16 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:16.984 15:02:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.984 15:02:16 -- common/autotest_common.sh@10 -- # set +x 00:07:16.984 ************************************ 00:07:16.984 START TEST accel_compare 00:07:16.984 ************************************ 00:07:16.984 15:02:16 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:16.984 15:02:16 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.984 15:02:16 -- accel/accel.sh@17 -- # local accel_module 00:07:16.984 15:02:16 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:16.984 15:02:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:16.984 15:02:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.984 15:02:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.984 15:02:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.984 15:02:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.984 15:02:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.984 15:02:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.984 15:02:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.984 15:02:16 -- accel/accel.sh@42 -- # jq -r . 00:07:16.984 [2024-11-28 15:02:16.850455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:16.984 [2024-11-28 15:02:16.850527] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid597978 ] 00:07:16.984 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.984 [2024-11-28 15:02:16.910231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.984 [2024-11-28 15:02:17.000971] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.357 15:02:18 -- accel/accel.sh@18 -- # out=' 00:07:18.357 SPDK Configuration: 00:07:18.357 Core mask: 0x1 00:07:18.357 00:07:18.357 Accel Perf Configuration: 00:07:18.357 Workload Type: compare 00:07:18.357 Transfer size: 4096 bytes 00:07:18.357 Vector count 1 00:07:18.357 Module: software 00:07:18.357 Queue depth: 32 00:07:18.357 Allocate depth: 32 00:07:18.357 # threads/core: 1 00:07:18.357 Run time: 1 seconds 00:07:18.357 Verify: Yes 00:07:18.357 00:07:18.357 Running for 1 seconds... 00:07:18.357 00:07:18.357 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:18.357 ------------------------------------------------------------------------------------ 00:07:18.357 0,0 396000/s 1546 MiB/s 0 0 00:07:18.357 ==================================================================================== 00:07:18.357 Total 396000/s 1546 MiB/s 0 0' 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.357 15:02:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.357 15:02:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:18.357 15:02:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:18.357 15:02:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:18.357 15:02:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:18.357 15:02:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:18.357 15:02:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:18.357 15:02:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:18.357 15:02:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:18.357 15:02:18 -- accel/accel.sh@42 -- # jq -r . 00:07:18.357 [2024-11-28 15:02:18.255781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:18.357 [2024-11-28 15:02:18.255862] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid598117 ] 00:07:18.357 EAL: No free 2048 kB hugepages reported on node 1 00:07:18.357 [2024-11-28 15:02:18.316855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:18.357 [2024-11-28 15:02:18.407251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.357 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.357 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.357 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.357 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.357 15:02:18 -- accel/accel.sh@21 -- # val=0x1 00:07:18.357 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.357 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val=compare 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val=software 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@23 -- # accel_module=software 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val=32 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val=32 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val=1 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val=Yes 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:18.358 15:02:18 -- accel/accel.sh@21 -- # val= 00:07:18.358 15:02:18 -- accel/accel.sh@22 -- # case "$var" in 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:18.358 15:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@21 -- # val= 00:07:19.732 15:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@21 -- # val= 00:07:19.732 15:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@21 -- # val= 00:07:19.732 15:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@21 -- # val= 00:07:19.732 15:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@21 -- # val= 00:07:19.732 15:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@21 -- # val= 00:07:19.732 15:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:19.732 15:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:19.732 15:02:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:19.732 15:02:19 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:19.732 15:02:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.732 00:07:19.732 real 0m2.805s 00:07:19.732 user 0m2.516s 00:07:19.732 sys 0m0.280s 00:07:19.732 15:02:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.732 15:02:19 -- common/autotest_common.sh@10 -- # set +x 00:07:19.732 ************************************ 00:07:19.732 END TEST accel_compare 00:07:19.732 ************************************ 00:07:19.732 15:02:19 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:19.732 15:02:19 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:19.732 15:02:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.732 15:02:19 -- common/autotest_common.sh@10 -- # set +x 00:07:19.732 ************************************ 00:07:19.732 START TEST accel_xor 00:07:19.732 ************************************ 00:07:19.732 15:02:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:19.732 15:02:19 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.732 15:02:19 -- accel/accel.sh@17 -- # local accel_module 00:07:19.733 15:02:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:19.733 15:02:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:19.733 15:02:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.733 15:02:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.733 15:02:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.733 15:02:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.733 15:02:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.733 15:02:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.733 15:02:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.733 15:02:19 -- accel/accel.sh@42 -- # jq -r . 00:07:19.733 [2024-11-28 15:02:19.679943] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:19.733 [2024-11-28 15:02:19.680017] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid598276 ] 00:07:19.733 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.733 [2024-11-28 15:02:19.740563] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.733 [2024-11-28 15:02:19.831985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.106 15:02:21 -- accel/accel.sh@18 -- # out=' 00:07:21.106 SPDK Configuration: 00:07:21.106 Core mask: 0x1 00:07:21.106 00:07:21.106 Accel Perf Configuration: 00:07:21.106 Workload Type: xor 00:07:21.106 Source buffers: 2 00:07:21.106 Transfer size: 4096 bytes 00:07:21.106 Vector count 1 00:07:21.107 Module: software 00:07:21.107 Queue depth: 32 00:07:21.107 Allocate depth: 32 00:07:21.107 # threads/core: 1 00:07:21.107 Run time: 1 seconds 00:07:21.107 Verify: Yes 00:07:21.107 00:07:21.107 Running for 1 seconds... 00:07:21.107 00:07:21.107 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:21.107 ------------------------------------------------------------------------------------ 00:07:21.107 0,0 192416/s 751 MiB/s 0 0 00:07:21.107 ==================================================================================== 00:07:21.107 Total 192416/s 751 MiB/s 0 0' 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:21.107 15:02:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:21.107 15:02:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:21.107 15:02:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:21.107 15:02:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:21.107 15:02:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:21.107 15:02:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:21.107 15:02:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:21.107 15:02:21 -- accel/accel.sh@42 -- # jq -r . 00:07:21.107 [2024-11-28 15:02:21.083817] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:21.107 [2024-11-28 15:02:21.083893] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid598421 ] 00:07:21.107 EAL: No free 2048 kB hugepages reported on node 1 00:07:21.107 [2024-11-28 15:02:21.144674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:21.107 [2024-11-28 15:02:21.240931] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=0x1 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=xor 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=2 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=software 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@23 -- # accel_module=software 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=32 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=32 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=1 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val=Yes 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:21.107 15:02:21 -- accel/accel.sh@21 -- # val= 00:07:21.107 15:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:21.107 15:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@21 -- # val= 00:07:22.483 15:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # IFS=: 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@21 -- # val= 00:07:22.483 15:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # IFS=: 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@21 -- # val= 00:07:22.483 15:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # IFS=: 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@21 -- # val= 00:07:22.483 15:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # IFS=: 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@21 -- # val= 00:07:22.483 15:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # IFS=: 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@21 -- # val= 00:07:22.483 15:02:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # IFS=: 00:07:22.483 15:02:22 -- accel/accel.sh@20 -- # read -r var val 00:07:22.483 15:02:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.483 15:02:22 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:22.483 15:02:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.483 00:07:22.483 real 0m2.807s 00:07:22.483 user 0m2.506s 00:07:22.483 sys 0m0.293s 00:07:22.484 15:02:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.484 15:02:22 -- common/autotest_common.sh@10 -- # set +x 00:07:22.484 ************************************ 00:07:22.484 END TEST accel_xor 00:07:22.484 ************************************ 00:07:22.484 15:02:22 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:22.484 15:02:22 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:22.484 15:02:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.484 15:02:22 -- common/autotest_common.sh@10 -- # set +x 00:07:22.484 ************************************ 00:07:22.484 START TEST accel_xor 00:07:22.484 ************************************ 00:07:22.484 15:02:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:22.484 15:02:22 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.484 15:02:22 -- accel/accel.sh@17 -- # local accel_module 00:07:22.484 15:02:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:22.484 15:02:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:22.484 15:02:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.484 15:02:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.484 15:02:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.484 15:02:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.484 15:02:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.484 15:02:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.484 15:02:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.484 15:02:22 -- accel/accel.sh@42 -- # jq -r . 00:07:22.484 [2024-11-28 15:02:22.514537] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:22.484 [2024-11-28 15:02:22.514609] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid598699 ] 00:07:22.484 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.484 [2024-11-28 15:02:22.574704] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.484 [2024-11-28 15:02:22.664077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.858 15:02:23 -- accel/accel.sh@18 -- # out=' 00:07:23.858 SPDK Configuration: 00:07:23.858 Core mask: 0x1 00:07:23.858 00:07:23.858 Accel Perf Configuration: 00:07:23.858 Workload Type: xor 00:07:23.858 Source buffers: 3 00:07:23.858 Transfer size: 4096 bytes 00:07:23.858 Vector count 1 00:07:23.858 Module: software 00:07:23.858 Queue depth: 32 00:07:23.858 Allocate depth: 32 00:07:23.858 # threads/core: 1 00:07:23.858 Run time: 1 seconds 00:07:23.858 Verify: Yes 00:07:23.858 00:07:23.858 Running for 1 seconds... 00:07:23.858 00:07:23.858 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.858 ------------------------------------------------------------------------------------ 00:07:23.858 0,0 183712/s 717 MiB/s 0 0 00:07:23.858 ==================================================================================== 00:07:23.858 Total 183712/s 717 MiB/s 0 0' 00:07:23.858 15:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:23.858 15:02:23 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:23.858 15:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:23.858 15:02:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:23.858 15:02:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.858 15:02:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.858 15:02:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.858 15:02:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.858 15:02:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.858 15:02:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.858 15:02:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.858 15:02:23 -- accel/accel.sh@42 -- # jq -r . 00:07:23.858 [2024-11-28 15:02:23.918425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:23.858 [2024-11-28 15:02:23.918502] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid598844 ] 00:07:23.858 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.858 [2024-11-28 15:02:23.978723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.858 [2024-11-28 15:02:24.069116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:24.116 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.116 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.116 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.116 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=0x1 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=xor 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=3 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=software 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=32 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=32 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=1 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val=Yes 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:24.117 15:02:24 -- accel/accel.sh@21 -- # val= 00:07:24.117 15:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:24.117 15:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@21 -- # val= 00:07:25.494 15:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@21 -- # val= 00:07:25.494 15:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@21 -- # val= 00:07:25.494 15:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@21 -- # val= 00:07:25.494 15:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@21 -- # val= 00:07:25.494 15:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@21 -- # val= 00:07:25.494 15:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:25.494 15:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:25.494 15:02:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:25.494 15:02:25 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:25.494 15:02:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:25.494 00:07:25.494 real 0m2.812s 00:07:25.494 user 0m2.497s 00:07:25.494 sys 0m0.307s 00:07:25.494 15:02:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:25.494 15:02:25 -- common/autotest_common.sh@10 -- # set +x 00:07:25.494 ************************************ 00:07:25.494 END TEST accel_xor 00:07:25.494 ************************************ 00:07:25.494 15:02:25 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:25.494 15:02:25 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:25.494 15:02:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:25.494 15:02:25 -- common/autotest_common.sh@10 -- # set +x 00:07:25.494 ************************************ 00:07:25.494 START TEST accel_dif_verify 00:07:25.494 ************************************ 00:07:25.494 15:02:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:25.494 15:02:25 -- accel/accel.sh@16 -- # local accel_opc 00:07:25.494 15:02:25 -- accel/accel.sh@17 -- # local accel_module 00:07:25.494 15:02:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:25.494 15:02:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:25.494 15:02:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.494 15:02:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.494 15:02:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.494 15:02:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.494 15:02:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.494 15:02:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.494 15:02:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.494 15:02:25 -- accel/accel.sh@42 -- # jq -r . 00:07:25.494 [2024-11-28 15:02:25.351150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:25.494 [2024-11-28 15:02:25.351220] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid599001 ] 00:07:25.494 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.494 [2024-11-28 15:02:25.413460] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.494 [2024-11-28 15:02:25.503530] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.868 15:02:26 -- accel/accel.sh@18 -- # out=' 00:07:26.868 SPDK Configuration: 00:07:26.868 Core mask: 0x1 00:07:26.868 00:07:26.868 Accel Perf Configuration: 00:07:26.868 Workload Type: dif_verify 00:07:26.868 Vector size: 4096 bytes 00:07:26.868 Transfer size: 4096 bytes 00:07:26.868 Block size: 512 bytes 00:07:26.868 Metadata size: 8 bytes 00:07:26.868 Vector count 1 00:07:26.868 Module: software 00:07:26.868 Queue depth: 32 00:07:26.868 Allocate depth: 32 00:07:26.868 # threads/core: 1 00:07:26.868 Run time: 1 seconds 00:07:26.868 Verify: No 00:07:26.868 00:07:26.868 Running for 1 seconds... 00:07:26.868 00:07:26.868 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.869 ------------------------------------------------------------------------------------ 00:07:26.869 0,0 81120/s 321 MiB/s 0 0 00:07:26.869 ==================================================================================== 00:07:26.869 Total 81120/s 316 MiB/s 0 0' 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:26.869 15:02:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.869 15:02:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.869 15:02:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.869 15:02:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.869 15:02:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.869 15:02:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.869 15:02:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.869 15:02:26 -- accel/accel.sh@42 -- # jq -r . 00:07:26.869 [2024-11-28 15:02:26.756446] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:26.869 [2024-11-28 15:02:26.756519] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid599142 ] 00:07:26.869 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.869 [2024-11-28 15:02:26.817109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.869 [2024-11-28 15:02:26.911612] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=0x1 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=dif_verify 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=software 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=32 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=32 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=1 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val=No 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:26.869 15:02:26 -- accel/accel.sh@21 -- # val= 00:07:26.869 15:02:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # IFS=: 00:07:26.869 15:02:26 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@21 -- # val= 00:07:28.244 15:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@21 -- # val= 00:07:28.244 15:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@21 -- # val= 00:07:28.244 15:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@21 -- # val= 00:07:28.244 15:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@21 -- # val= 00:07:28.244 15:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@21 -- # val= 00:07:28.244 15:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:28.244 15:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:28.244 15:02:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:28.244 15:02:28 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:28.244 15:02:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:28.244 00:07:28.244 real 0m2.808s 00:07:28.244 user 0m2.508s 00:07:28.244 sys 0m0.294s 00:07:28.244 15:02:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.244 15:02:28 -- common/autotest_common.sh@10 -- # set +x 00:07:28.244 ************************************ 00:07:28.244 END TEST accel_dif_verify 00:07:28.244 ************************************ 00:07:28.244 15:02:28 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:28.244 15:02:28 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:28.244 15:02:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.244 15:02:28 -- common/autotest_common.sh@10 -- # set +x 00:07:28.244 ************************************ 00:07:28.244 START TEST accel_dif_generate 00:07:28.244 ************************************ 00:07:28.244 15:02:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:28.244 15:02:28 -- accel/accel.sh@16 -- # local accel_opc 00:07:28.244 15:02:28 -- accel/accel.sh@17 -- # local accel_module 00:07:28.244 15:02:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:28.244 15:02:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:28.244 15:02:28 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.244 15:02:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.244 15:02:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.244 15:02:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.244 15:02:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.244 15:02:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.244 15:02:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.244 15:02:28 -- accel/accel.sh@42 -- # jq -r . 00:07:28.244 [2024-11-28 15:02:28.185084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:28.244 [2024-11-28 15:02:28.185229] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid599426 ] 00:07:28.244 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.244 [2024-11-28 15:02:28.244684] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.244 [2024-11-28 15:02:28.333720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.626 15:02:29 -- accel/accel.sh@18 -- # out=' 00:07:29.626 SPDK Configuration: 00:07:29.626 Core mask: 0x1 00:07:29.626 00:07:29.626 Accel Perf Configuration: 00:07:29.626 Workload Type: dif_generate 00:07:29.626 Vector size: 4096 bytes 00:07:29.626 Transfer size: 4096 bytes 00:07:29.626 Block size: 512 bytes 00:07:29.626 Metadata size: 8 bytes 00:07:29.626 Vector count 1 00:07:29.626 Module: software 00:07:29.626 Queue depth: 32 00:07:29.626 Allocate depth: 32 00:07:29.626 # threads/core: 1 00:07:29.626 Run time: 1 seconds 00:07:29.626 Verify: No 00:07:29.626 00:07:29.626 Running for 1 seconds... 00:07:29.626 00:07:29.626 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:29.626 ------------------------------------------------------------------------------------ 00:07:29.627 0,0 95392/s 378 MiB/s 0 0 00:07:29.627 ==================================================================================== 00:07:29.627 Total 95392/s 372 MiB/s 0 0' 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:29.627 15:02:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:29.627 15:02:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:29.627 15:02:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:29.627 15:02:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:29.627 15:02:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:29.627 15:02:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:29.627 15:02:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:29.627 15:02:29 -- accel/accel.sh@42 -- # jq -r . 00:07:29.627 [2024-11-28 15:02:29.576844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:29.627 [2024-11-28 15:02:29.576920] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid599565 ] 00:07:29.627 EAL: No free 2048 kB hugepages reported on node 1 00:07:29.627 [2024-11-28 15:02:29.636924] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:29.627 [2024-11-28 15:02:29.727214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=0x1 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=dif_generate 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=software 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=32 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=32 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=1 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val=No 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:29.627 15:02:29 -- accel/accel.sh@21 -- # val= 00:07:29.627 15:02:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # IFS=: 00:07:29.627 15:02:29 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@21 -- # val= 00:07:31.002 15:02:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # IFS=: 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@21 -- # val= 00:07:31.002 15:02:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # IFS=: 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@21 -- # val= 00:07:31.002 15:02:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # IFS=: 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@21 -- # val= 00:07:31.002 15:02:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # IFS=: 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@21 -- # val= 00:07:31.002 15:02:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # IFS=: 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@21 -- # val= 00:07:31.002 15:02:30 -- accel/accel.sh@22 -- # case "$var" in 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # IFS=: 00:07:31.002 15:02:30 -- accel/accel.sh@20 -- # read -r var val 00:07:31.002 15:02:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:31.002 15:02:30 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:31.002 15:02:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:31.002 00:07:31.002 real 0m2.794s 00:07:31.002 user 0m2.501s 00:07:31.002 sys 0m0.288s 00:07:31.002 15:02:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:31.002 15:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:31.002 ************************************ 00:07:31.002 END TEST accel_dif_generate 00:07:31.002 ************************************ 00:07:31.002 15:02:30 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:31.002 15:02:30 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:31.002 15:02:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:31.002 15:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:31.002 ************************************ 00:07:31.002 START TEST accel_dif_generate_copy 00:07:31.002 ************************************ 00:07:31.003 15:02:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:31.003 15:02:30 -- accel/accel.sh@16 -- # local accel_opc 00:07:31.003 15:02:30 -- accel/accel.sh@17 -- # local accel_module 00:07:31.003 15:02:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:31.003 15:02:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:31.003 15:02:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.003 15:02:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.003 15:02:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.003 15:02:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.003 15:02:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.003 15:02:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.003 15:02:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.003 15:02:30 -- accel/accel.sh@42 -- # jq -r . 00:07:31.003 [2024-11-28 15:02:31.003686] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:31.003 [2024-11-28 15:02:31.003762] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid599726 ] 00:07:31.003 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.003 [2024-11-28 15:02:31.064677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.003 [2024-11-28 15:02:31.154527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.378 15:02:32 -- accel/accel.sh@18 -- # out=' 00:07:32.378 SPDK Configuration: 00:07:32.378 Core mask: 0x1 00:07:32.378 00:07:32.378 Accel Perf Configuration: 00:07:32.378 Workload Type: dif_generate_copy 00:07:32.378 Vector size: 4096 bytes 00:07:32.378 Transfer size: 4096 bytes 00:07:32.378 Vector count 1 00:07:32.378 Module: software 00:07:32.378 Queue depth: 32 00:07:32.378 Allocate depth: 32 00:07:32.378 # threads/core: 1 00:07:32.378 Run time: 1 seconds 00:07:32.378 Verify: No 00:07:32.378 00:07:32.378 Running for 1 seconds... 00:07:32.378 00:07:32.378 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:32.378 ------------------------------------------------------------------------------------ 00:07:32.378 0,0 73600/s 291 MiB/s 0 0 00:07:32.378 ==================================================================================== 00:07:32.378 Total 73600/s 287 MiB/s 0 0' 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.378 15:02:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.378 15:02:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:32.378 15:02:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:32.378 15:02:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:32.378 15:02:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:32.378 15:02:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:32.378 15:02:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:32.378 15:02:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:32.378 15:02:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:32.378 15:02:32 -- accel/accel.sh@42 -- # jq -r . 00:07:32.378 [2024-11-28 15:02:32.396044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:32.378 [2024-11-28 15:02:32.396151] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid599868 ] 00:07:32.378 EAL: No free 2048 kB hugepages reported on node 1 00:07:32.378 [2024-11-28 15:02:32.457821] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:32.378 [2024-11-28 15:02:32.549311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.378 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.378 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.378 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.378 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.378 15:02:32 -- accel/accel.sh@21 -- # val=0x1 00:07:32.378 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.378 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.378 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.378 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.378 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.378 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val=software 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@23 -- # accel_module=software 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val=32 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val=32 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val=1 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val=No 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:32.636 15:02:32 -- accel/accel.sh@21 -- # val= 00:07:32.636 15:02:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # IFS=: 00:07:32.636 15:02:32 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@21 -- # val= 00:07:33.571 15:02:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # IFS=: 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@21 -- # val= 00:07:33.571 15:02:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # IFS=: 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@21 -- # val= 00:07:33.571 15:02:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # IFS=: 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@21 -- # val= 00:07:33.571 15:02:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # IFS=: 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@21 -- # val= 00:07:33.571 15:02:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # IFS=: 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@21 -- # val= 00:07:33.571 15:02:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # IFS=: 00:07:33.571 15:02:33 -- accel/accel.sh@20 -- # read -r var val 00:07:33.571 15:02:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:33.571 15:02:33 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:33.571 15:02:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:33.571 00:07:33.571 real 0m2.787s 00:07:33.571 user 0m2.465s 00:07:33.571 sys 0m0.291s 00:07:33.571 15:02:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:33.571 15:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:33.571 ************************************ 00:07:33.571 END TEST accel_dif_generate_copy 00:07:33.571 ************************************ 00:07:33.571 15:02:33 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:33.571 15:02:33 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.572 15:02:33 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:33.572 15:02:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.572 15:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:33.572 ************************************ 00:07:33.572 START TEST accel_comp 00:07:33.572 ************************************ 00:07:33.572 15:02:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.572 15:02:33 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.572 15:02:33 -- accel/accel.sh@17 -- # local accel_module 00:07:33.572 15:02:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.572 15:02:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:33.572 15:02:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.572 15:02:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.572 15:02:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.572 15:02:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.572 15:02:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.572 15:02:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.572 15:02:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.572 15:02:33 -- accel/accel.sh@42 -- # jq -r . 00:07:33.830 [2024-11-28 15:02:33.816484] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:33.830 [2024-11-28 15:02:33.816557] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid600141 ] 00:07:33.830 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.830 [2024-11-28 15:02:33.879582] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.830 [2024-11-28 15:02:33.969027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.204 15:02:35 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:35.204 00:07:35.204 SPDK Configuration: 00:07:35.204 Core mask: 0x1 00:07:35.204 00:07:35.204 Accel Perf Configuration: 00:07:35.204 Workload Type: compress 00:07:35.204 Transfer size: 4096 bytes 00:07:35.204 Vector count 1 00:07:35.204 Module: software 00:07:35.204 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:35.204 Queue depth: 32 00:07:35.204 Allocate depth: 32 00:07:35.204 # threads/core: 1 00:07:35.204 Run time: 1 seconds 00:07:35.204 Verify: No 00:07:35.204 00:07:35.204 Running for 1 seconds... 00:07:35.204 00:07:35.204 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:35.204 ------------------------------------------------------------------------------------ 00:07:35.204 0,0 31456/s 131 MiB/s 0 0 00:07:35.204 ==================================================================================== 00:07:35.204 Total 31456/s 122 MiB/s 0 0' 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:35.204 15:02:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:35.204 15:02:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:35.204 15:02:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:35.204 15:02:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:35.204 15:02:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:35.204 15:02:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:35.204 15:02:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:35.204 15:02:35 -- accel/accel.sh@42 -- # jq -r . 00:07:35.204 [2024-11-28 15:02:35.202712] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:35.204 [2024-11-28 15:02:35.202790] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid600292 ] 00:07:35.204 EAL: No free 2048 kB hugepages reported on node 1 00:07:35.204 [2024-11-28 15:02:35.262982] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:35.204 [2024-11-28 15:02:35.353211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=0x1 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=compress 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=software 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@23 -- # accel_module=software 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=32 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=32 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val=1 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.204 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.204 15:02:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:35.204 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.205 15:02:35 -- accel/accel.sh@21 -- # val=No 00:07:35.205 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.205 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.205 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:35.205 15:02:35 -- accel/accel.sh@21 -- # val= 00:07:35.205 15:02:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # IFS=: 00:07:35.205 15:02:35 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@21 -- # val= 00:07:36.578 15:02:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # IFS=: 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@21 -- # val= 00:07:36.578 15:02:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # IFS=: 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@21 -- # val= 00:07:36.578 15:02:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # IFS=: 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@21 -- # val= 00:07:36.578 15:02:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # IFS=: 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@21 -- # val= 00:07:36.578 15:02:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # IFS=: 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@21 -- # val= 00:07:36.578 15:02:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # IFS=: 00:07:36.578 15:02:36 -- accel/accel.sh@20 -- # read -r var val 00:07:36.578 15:02:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.578 15:02:36 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:36.578 15:02:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.578 00:07:36.578 real 0m2.795s 00:07:36.578 user 0m2.496s 00:07:36.578 sys 0m0.292s 00:07:36.578 15:02:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.578 15:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:36.578 ************************************ 00:07:36.578 END TEST accel_comp 00:07:36.578 ************************************ 00:07:36.578 15:02:36 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.578 15:02:36 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:36.578 15:02:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.578 15:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:36.578 ************************************ 00:07:36.578 START TEST accel_decomp 00:07:36.578 ************************************ 00:07:36.578 15:02:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.578 15:02:36 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.578 15:02:36 -- accel/accel.sh@17 -- # local accel_module 00:07:36.578 15:02:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.578 15:02:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:36.578 15:02:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.578 15:02:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.578 15:02:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.578 15:02:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.578 15:02:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.578 15:02:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.578 15:02:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.578 15:02:36 -- accel/accel.sh@42 -- # jq -r . 00:07:36.578 [2024-11-28 15:02:36.642398] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:36.578 [2024-11-28 15:02:36.642501] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid600445 ] 00:07:36.578 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.578 [2024-11-28 15:02:36.705657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:36.578 [2024-11-28 15:02:36.794020] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.954 15:02:38 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.954 00:07:37.954 SPDK Configuration: 00:07:37.954 Core mask: 0x1 00:07:37.954 00:07:37.954 Accel Perf Configuration: 00:07:37.954 Workload Type: decompress 00:07:37.954 Transfer size: 4096 bytes 00:07:37.954 Vector count 1 00:07:37.954 Module: software 00:07:37.954 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.954 Queue depth: 32 00:07:37.954 Allocate depth: 32 00:07:37.954 # threads/core: 1 00:07:37.954 Run time: 1 seconds 00:07:37.954 Verify: Yes 00:07:37.954 00:07:37.954 Running for 1 seconds... 00:07:37.954 00:07:37.954 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.954 ------------------------------------------------------------------------------------ 00:07:37.954 0,0 55392/s 102 MiB/s 0 0 00:07:37.954 ==================================================================================== 00:07:37.954 Total 55392/s 216 MiB/s 0 0' 00:07:37.954 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:37.954 15:02:38 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:37.954 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:37.954 15:02:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:37.954 15:02:38 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.954 15:02:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.954 15:02:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.954 15:02:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.954 15:02:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.954 15:02:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.954 15:02:38 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.954 15:02:38 -- accel/accel.sh@42 -- # jq -r . 00:07:37.954 [2024-11-28 15:02:38.049266] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:37.954 [2024-11-28 15:02:38.049343] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid600593 ] 00:07:37.954 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.954 [2024-11-28 15:02:38.110621] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:38.213 [2024-11-28 15:02:38.201697] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=0x1 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=decompress 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=software 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@23 -- # accel_module=software 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=32 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=32 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=1 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.213 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.213 15:02:38 -- accel/accel.sh@21 -- # val=Yes 00:07:38.213 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.214 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.214 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.214 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.214 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.214 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.214 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:38.214 15:02:38 -- accel/accel.sh@21 -- # val= 00:07:38.214 15:02:38 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.214 15:02:38 -- accel/accel.sh@20 -- # IFS=: 00:07:38.214 15:02:38 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@21 -- # val= 00:07:39.624 15:02:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # IFS=: 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@21 -- # val= 00:07:39.624 15:02:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # IFS=: 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@21 -- # val= 00:07:39.624 15:02:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # IFS=: 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@21 -- # val= 00:07:39.624 15:02:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # IFS=: 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@21 -- # val= 00:07:39.624 15:02:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # IFS=: 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@21 -- # val= 00:07:39.624 15:02:39 -- accel/accel.sh@22 -- # case "$var" in 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # IFS=: 00:07:39.624 15:02:39 -- accel/accel.sh@20 -- # read -r var val 00:07:39.624 15:02:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:39.624 15:02:39 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:39.624 15:02:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:39.624 00:07:39.624 real 0m2.807s 00:07:39.624 user 0m2.509s 00:07:39.624 sys 0m0.290s 00:07:39.624 15:02:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:39.624 15:02:39 -- common/autotest_common.sh@10 -- # set +x 00:07:39.624 ************************************ 00:07:39.624 END TEST accel_decomp 00:07:39.624 ************************************ 00:07:39.624 15:02:39 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.624 15:02:39 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:39.624 15:02:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.624 15:02:39 -- common/autotest_common.sh@10 -- # set +x 00:07:39.624 ************************************ 00:07:39.624 START TEST accel_decmop_full 00:07:39.624 ************************************ 00:07:39.624 15:02:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.624 15:02:39 -- accel/accel.sh@16 -- # local accel_opc 00:07:39.624 15:02:39 -- accel/accel.sh@17 -- # local accel_module 00:07:39.624 15:02:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.624 15:02:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:39.624 15:02:39 -- accel/accel.sh@12 -- # build_accel_config 00:07:39.624 15:02:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:39.624 15:02:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:39.624 15:02:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:39.624 15:02:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:39.624 15:02:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:39.624 15:02:39 -- accel/accel.sh@41 -- # local IFS=, 00:07:39.624 15:02:39 -- accel/accel.sh@42 -- # jq -r . 00:07:39.624 [2024-11-28 15:02:39.473308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:39.624 [2024-11-28 15:02:39.473384] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid600868 ] 00:07:39.624 EAL: No free 2048 kB hugepages reported on node 1 00:07:39.624 [2024-11-28 15:02:39.534150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:39.624 [2024-11-28 15:02:39.626841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.048 15:02:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:41.048 00:07:41.048 SPDK Configuration: 00:07:41.048 Core mask: 0x1 00:07:41.048 00:07:41.048 Accel Perf Configuration: 00:07:41.048 Workload Type: decompress 00:07:41.048 Transfer size: 111250 bytes 00:07:41.048 Vector count 1 00:07:41.048 Module: software 00:07:41.048 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:41.048 Queue depth: 32 00:07:41.048 Allocate depth: 32 00:07:41.048 # threads/core: 1 00:07:41.048 Run time: 1 seconds 00:07:41.048 Verify: Yes 00:07:41.048 00:07:41.048 Running for 1 seconds... 00:07:41.048 00:07:41.048 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:41.048 ------------------------------------------------------------------------------------ 00:07:41.048 0,0 3840/s 158 MiB/s 0 0 00:07:41.048 ==================================================================================== 00:07:41.048 Total 3840/s 407 MiB/s 0 0' 00:07:41.048 15:02:40 -- accel/accel.sh@20 -- # IFS=: 00:07:41.048 15:02:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:41.048 15:02:40 -- accel/accel.sh@20 -- # read -r var val 00:07:41.048 15:02:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:41.048 15:02:40 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.049 15:02:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.049 15:02:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.049 15:02:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.049 15:02:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.049 15:02:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.049 15:02:40 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.049 15:02:40 -- accel/accel.sh@42 -- # jq -r . 00:07:41.049 [2024-11-28 15:02:40.879506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:41.049 [2024-11-28 15:02:40.879583] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601016 ] 00:07:41.049 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.049 [2024-11-28 15:02:40.939118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.049 [2024-11-28 15:02:41.030049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=0x1 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=decompress 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=software 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@23 -- # accel_module=software 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=32 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=32 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=1 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val=Yes 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:41.049 15:02:41 -- accel/accel.sh@21 -- # val= 00:07:41.049 15:02:41 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # IFS=: 00:07:41.049 15:02:41 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@21 -- # val= 00:07:42.421 15:02:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # IFS=: 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@21 -- # val= 00:07:42.421 15:02:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # IFS=: 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@21 -- # val= 00:07:42.421 15:02:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # IFS=: 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@21 -- # val= 00:07:42.421 15:02:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # IFS=: 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@21 -- # val= 00:07:42.421 15:02:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # IFS=: 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@21 -- # val= 00:07:42.421 15:02:42 -- accel/accel.sh@22 -- # case "$var" in 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # IFS=: 00:07:42.421 15:02:42 -- accel/accel.sh@20 -- # read -r var val 00:07:42.421 15:02:42 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:42.421 15:02:42 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:42.421 15:02:42 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:42.421 00:07:42.421 real 0m2.831s 00:07:42.421 user 0m2.533s 00:07:42.421 sys 0m0.291s 00:07:42.421 15:02:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:42.421 15:02:42 -- common/autotest_common.sh@10 -- # set +x 00:07:42.421 ************************************ 00:07:42.421 END TEST accel_decmop_full 00:07:42.421 ************************************ 00:07:42.421 15:02:42 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:42.421 15:02:42 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:42.421 15:02:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:42.421 15:02:42 -- common/autotest_common.sh@10 -- # set +x 00:07:42.421 ************************************ 00:07:42.421 START TEST accel_decomp_mcore 00:07:42.421 ************************************ 00:07:42.421 15:02:42 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:42.421 15:02:42 -- accel/accel.sh@16 -- # local accel_opc 00:07:42.421 15:02:42 -- accel/accel.sh@17 -- # local accel_module 00:07:42.421 15:02:42 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:42.421 15:02:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:42.421 15:02:42 -- accel/accel.sh@12 -- # build_accel_config 00:07:42.421 15:02:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:42.421 15:02:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:42.421 15:02:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:42.421 15:02:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:42.421 15:02:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:42.421 15:02:42 -- accel/accel.sh@41 -- # local IFS=, 00:07:42.422 15:02:42 -- accel/accel.sh@42 -- # jq -r . 00:07:42.422 [2024-11-28 15:02:42.333291] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:42.422 [2024-11-28 15:02:42.333375] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601176 ] 00:07:42.422 EAL: No free 2048 kB hugepages reported on node 1 00:07:42.422 [2024-11-28 15:02:42.396081] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:42.422 [2024-11-28 15:02:42.488816] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:42.422 [2024-11-28 15:02:42.488867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:42.422 [2024-11-28 15:02:42.488983] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:42.422 [2024-11-28 15:02:42.488986] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.793 15:02:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.793 00:07:43.793 SPDK Configuration: 00:07:43.793 Core mask: 0xf 00:07:43.793 00:07:43.793 Accel Perf Configuration: 00:07:43.793 Workload Type: decompress 00:07:43.793 Transfer size: 4096 bytes 00:07:43.793 Vector count 1 00:07:43.793 Module: software 00:07:43.793 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.793 Queue depth: 32 00:07:43.793 Allocate depth: 32 00:07:43.793 # threads/core: 1 00:07:43.793 Run time: 1 seconds 00:07:43.793 Verify: Yes 00:07:43.793 00:07:43.793 Running for 1 seconds... 00:07:43.793 00:07:43.793 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.794 ------------------------------------------------------------------------------------ 00:07:43.794 0,0 56512/s 104 MiB/s 0 0 00:07:43.794 3,0 57056/s 105 MiB/s 0 0 00:07:43.794 2,0 57056/s 105 MiB/s 0 0 00:07:43.794 1,0 56864/s 104 MiB/s 0 0 00:07:43.794 ==================================================================================== 00:07:43.794 Total 227488/s 888 MiB/s 0 0' 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:43.794 15:02:43 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.794 15:02:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.794 15:02:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.794 15:02:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.794 15:02:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.794 15:02:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.794 15:02:43 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.794 15:02:43 -- accel/accel.sh@42 -- # jq -r . 00:07:43.794 [2024-11-28 15:02:43.747800] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:43.794 [2024-11-28 15:02:43.747880] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601319 ] 00:07:43.794 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.794 [2024-11-28 15:02:43.811278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:43.794 [2024-11-28 15:02:43.906314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:43.794 [2024-11-28 15:02:43.906375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:43.794 [2024-11-28 15:02:43.906378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.794 [2024-11-28 15:02:43.906348] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=0xf 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=decompress 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=software 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=32 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=32 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=1 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val=Yes 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:43.794 15:02:43 -- accel/accel.sh@21 -- # val= 00:07:43.794 15:02:43 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # IFS=: 00:07:43.794 15:02:43 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.163 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.163 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.163 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.164 15:02:45 -- accel/accel.sh@21 -- # val= 00:07:45.164 15:02:45 -- accel/accel.sh@22 -- # case "$var" in 00:07:45.164 15:02:45 -- accel/accel.sh@20 -- # IFS=: 00:07:45.164 15:02:45 -- accel/accel.sh@20 -- # read -r var val 00:07:45.164 15:02:45 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:45.164 15:02:45 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:45.164 15:02:45 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:45.164 00:07:45.164 real 0m2.823s 00:07:45.164 user 0m9.378s 00:07:45.164 sys 0m0.313s 00:07:45.164 15:02:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:45.164 15:02:45 -- common/autotest_common.sh@10 -- # set +x 00:07:45.164 ************************************ 00:07:45.164 END TEST accel_decomp_mcore 00:07:45.164 ************************************ 00:07:45.164 15:02:45 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:45.164 15:02:45 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:45.164 15:02:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:45.164 15:02:45 -- common/autotest_common.sh@10 -- # set +x 00:07:45.164 ************************************ 00:07:45.164 START TEST accel_decomp_full_mcore 00:07:45.164 ************************************ 00:07:45.164 15:02:45 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:45.164 15:02:45 -- accel/accel.sh@16 -- # local accel_opc 00:07:45.164 15:02:45 -- accel/accel.sh@17 -- # local accel_module 00:07:45.164 15:02:45 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:45.164 15:02:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:45.164 15:02:45 -- accel/accel.sh@12 -- # build_accel_config 00:07:45.164 15:02:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:45.164 15:02:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:45.164 15:02:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:45.164 15:02:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:45.164 15:02:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:45.164 15:02:45 -- accel/accel.sh@41 -- # local IFS=, 00:07:45.164 15:02:45 -- accel/accel.sh@42 -- # jq -r . 00:07:45.164 [2024-11-28 15:02:45.181006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:45.164 [2024-11-28 15:02:45.181080] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601605 ] 00:07:45.164 EAL: No free 2048 kB hugepages reported on node 1 00:07:45.164 [2024-11-28 15:02:45.242017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:45.164 [2024-11-28 15:02:45.336235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:45.164 [2024-11-28 15:02:45.336295] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:45.164 [2024-11-28 15:02:45.336415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:45.164 [2024-11-28 15:02:45.336418] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.537 15:02:46 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:46.537 00:07:46.537 SPDK Configuration: 00:07:46.537 Core mask: 0xf 00:07:46.537 00:07:46.537 Accel Perf Configuration: 00:07:46.537 Workload Type: decompress 00:07:46.537 Transfer size: 111250 bytes 00:07:46.537 Vector count 1 00:07:46.537 Module: software 00:07:46.537 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.537 Queue depth: 32 00:07:46.537 Allocate depth: 32 00:07:46.537 # threads/core: 1 00:07:46.537 Run time: 1 seconds 00:07:46.537 Verify: Yes 00:07:46.537 00:07:46.537 Running for 1 seconds... 00:07:46.537 00:07:46.537 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.537 ------------------------------------------------------------------------------------ 00:07:46.537 0,0 4256/s 175 MiB/s 0 0 00:07:46.537 3,0 4256/s 175 MiB/s 0 0 00:07:46.537 2,0 4256/s 175 MiB/s 0 0 00:07:46.537 1,0 4256/s 175 MiB/s 0 0 00:07:46.537 ==================================================================================== 00:07:46.537 Total 17024/s 1806 MiB/s 0 0' 00:07:46.537 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.537 15:02:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:46.537 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.537 15:02:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:46.538 15:02:46 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.538 15:02:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.538 15:02:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.538 15:02:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.538 15:02:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.538 15:02:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.538 15:02:46 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.538 15:02:46 -- accel/accel.sh@42 -- # jq -r . 00:07:46.538 [2024-11-28 15:02:46.595997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:46.538 [2024-11-28 15:02:46.596069] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601752 ] 00:07:46.538 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.538 [2024-11-28 15:02:46.656055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:46.538 [2024-11-28 15:02:46.749738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:46.538 [2024-11-28 15:02:46.749815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:46.538 [2024-11-28 15:02:46.749911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:46.538 [2024-11-28 15:02:46.749914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=0xf 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=decompress 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=software 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=32 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=32 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=1 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.796 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.796 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.796 15:02:46 -- accel/accel.sh@21 -- # val=Yes 00:07:46.797 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.797 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.797 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.797 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.797 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.797 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.797 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:46.797 15:02:46 -- accel/accel.sh@21 -- # val= 00:07:46.797 15:02:46 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.797 15:02:46 -- accel/accel.sh@20 -- # IFS=: 00:07:46.797 15:02:46 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:47 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # IFS=: 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:47 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # IFS=: 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:47 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # IFS=: 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:47 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # IFS=: 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:47 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # IFS=: 00:07:48.171 15:02:47 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:47 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:47 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.171 15:02:48 -- accel/accel.sh@20 -- # IFS=: 00:07:48.171 15:02:48 -- accel/accel.sh@20 -- # read -r var val 00:07:48.171 15:02:48 -- accel/accel.sh@21 -- # val= 00:07:48.171 15:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.172 15:02:48 -- accel/accel.sh@20 -- # IFS=: 00:07:48.172 15:02:48 -- accel/accel.sh@20 -- # read -r var val 00:07:48.172 15:02:48 -- accel/accel.sh@21 -- # val= 00:07:48.172 15:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.172 15:02:48 -- accel/accel.sh@20 -- # IFS=: 00:07:48.172 15:02:48 -- accel/accel.sh@20 -- # read -r var val 00:07:48.172 15:02:48 -- accel/accel.sh@21 -- # val= 00:07:48.172 15:02:48 -- accel/accel.sh@22 -- # case "$var" in 00:07:48.172 15:02:48 -- accel/accel.sh@20 -- # IFS=: 00:07:48.172 15:02:48 -- accel/accel.sh@20 -- # read -r var val 00:07:48.172 15:02:48 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:48.172 15:02:48 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:48.172 15:02:48 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:48.172 00:07:48.172 real 0m2.839s 00:07:48.172 user 0m9.488s 00:07:48.172 sys 0m0.299s 00:07:48.172 15:02:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.172 15:02:48 -- common/autotest_common.sh@10 -- # set +x 00:07:48.172 ************************************ 00:07:48.172 END TEST accel_decomp_full_mcore 00:07:48.172 ************************************ 00:07:48.172 15:02:48 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:48.172 15:02:48 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:48.172 15:02:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.172 15:02:48 -- common/autotest_common.sh@10 -- # set +x 00:07:48.172 ************************************ 00:07:48.172 START TEST accel_decomp_mthread 00:07:48.172 ************************************ 00:07:48.172 15:02:48 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:48.172 15:02:48 -- accel/accel.sh@16 -- # local accel_opc 00:07:48.172 15:02:48 -- accel/accel.sh@17 -- # local accel_module 00:07:48.172 15:02:48 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:48.172 15:02:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:48.172 15:02:48 -- accel/accel.sh@12 -- # build_accel_config 00:07:48.172 15:02:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:48.172 15:02:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:48.172 15:02:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:48.172 15:02:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:48.172 15:02:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:48.172 15:02:48 -- accel/accel.sh@41 -- # local IFS=, 00:07:48.172 15:02:48 -- accel/accel.sh@42 -- # jq -r . 00:07:48.172 [2024-11-28 15:02:48.045113] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:48.172 [2024-11-28 15:02:48.045204] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid601909 ] 00:07:48.172 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.172 [2024-11-28 15:02:48.100315] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.172 [2024-11-28 15:02:48.186690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.546 15:02:49 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:49.547 00:07:49.547 SPDK Configuration: 00:07:49.547 Core mask: 0x1 00:07:49.547 00:07:49.547 Accel Perf Configuration: 00:07:49.547 Workload Type: decompress 00:07:49.547 Transfer size: 4096 bytes 00:07:49.547 Vector count 1 00:07:49.547 Module: software 00:07:49.547 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:49.547 Queue depth: 32 00:07:49.547 Allocate depth: 32 00:07:49.547 # threads/core: 2 00:07:49.547 Run time: 1 seconds 00:07:49.547 Verify: Yes 00:07:49.547 00:07:49.547 Running for 1 seconds... 00:07:49.547 00:07:49.547 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:49.547 ------------------------------------------------------------------------------------ 00:07:49.547 0,1 30112/s 55 MiB/s 0 0 00:07:49.547 0,0 30016/s 55 MiB/s 0 0 00:07:49.547 ==================================================================================== 00:07:49.547 Total 60128/s 234 MiB/s 0 0' 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:49.547 15:02:49 -- accel/accel.sh@12 -- # build_accel_config 00:07:49.547 15:02:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:49.547 15:02:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:49.547 15:02:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:49.547 15:02:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:49.547 15:02:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:49.547 15:02:49 -- accel/accel.sh@41 -- # local IFS=, 00:07:49.547 15:02:49 -- accel/accel.sh@42 -- # jq -r . 00:07:49.547 [2024-11-28 15:02:49.443986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:49.547 [2024-11-28 15:02:49.444062] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid602055 ] 00:07:49.547 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.547 [2024-11-28 15:02:49.504145] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:49.547 [2024-11-28 15:02:49.594038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=0x1 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=decompress 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=software 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@23 -- # accel_module=software 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=32 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=32 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=2 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val=Yes 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:49.547 15:02:49 -- accel/accel.sh@21 -- # val= 00:07:49.547 15:02:49 -- accel/accel.sh@22 -- # case "$var" in 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # IFS=: 00:07:49.547 15:02:49 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@21 -- # val= 00:07:50.921 15:02:50 -- accel/accel.sh@22 -- # case "$var" in 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # IFS=: 00:07:50.921 15:02:50 -- accel/accel.sh@20 -- # read -r var val 00:07:50.921 15:02:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:50.921 15:02:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:50.922 15:02:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:50.922 00:07:50.922 real 0m2.795s 00:07:50.922 user 0m2.503s 00:07:50.922 sys 0m0.285s 00:07:50.922 15:02:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:50.922 15:02:50 -- common/autotest_common.sh@10 -- # set +x 00:07:50.922 ************************************ 00:07:50.922 END TEST accel_decomp_mthread 00:07:50.922 ************************************ 00:07:50.922 15:02:50 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.922 15:02:50 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:50.922 15:02:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:50.922 15:02:50 -- common/autotest_common.sh@10 -- # set +x 00:07:50.922 ************************************ 00:07:50.922 START TEST accel_deomp_full_mthread 00:07:50.922 ************************************ 00:07:50.922 15:02:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.922 15:02:50 -- accel/accel.sh@16 -- # local accel_opc 00:07:50.922 15:02:50 -- accel/accel.sh@17 -- # local accel_module 00:07:50.922 15:02:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.922 15:02:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:50.922 15:02:50 -- accel/accel.sh@12 -- # build_accel_config 00:07:50.922 15:02:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:50.922 15:02:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:50.922 15:02:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:50.922 15:02:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:50.922 15:02:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:50.922 15:02:50 -- accel/accel.sh@41 -- # local IFS=, 00:07:50.922 15:02:50 -- accel/accel.sh@42 -- # jq -r . 00:07:50.922 [2024-11-28 15:02:50.866186] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:50.922 [2024-11-28 15:02:50.866256] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid602332 ] 00:07:50.922 EAL: No free 2048 kB hugepages reported on node 1 00:07:50.922 [2024-11-28 15:02:50.927521] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:50.922 [2024-11-28 15:02:51.018328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.295 15:02:52 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:52.295 00:07:52.295 SPDK Configuration: 00:07:52.295 Core mask: 0x1 00:07:52.295 00:07:52.295 Accel Perf Configuration: 00:07:52.295 Workload Type: decompress 00:07:52.295 Transfer size: 111250 bytes 00:07:52.295 Vector count 1 00:07:52.295 Module: software 00:07:52.295 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:52.295 Queue depth: 32 00:07:52.295 Allocate depth: 32 00:07:52.295 # threads/core: 2 00:07:52.295 Run time: 1 seconds 00:07:52.295 Verify: Yes 00:07:52.295 00:07:52.295 Running for 1 seconds... 00:07:52.295 00:07:52.295 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:52.295 ------------------------------------------------------------------------------------ 00:07:52.295 0,1 1984/s 81 MiB/s 0 0 00:07:52.295 0,0 1984/s 81 MiB/s 0 0 00:07:52.295 ==================================================================================== 00:07:52.295 Total 3968/s 420 MiB/s 0 0' 00:07:52.295 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.295 15:02:52 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:52.295 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:52.296 15:02:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:52.296 15:02:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:52.296 15:02:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:52.296 15:02:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:52.296 15:02:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:52.296 15:02:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:52.296 15:02:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:52.296 15:02:52 -- accel/accel.sh@42 -- # jq -r . 00:07:52.296 [2024-11-28 15:02:52.306972] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:52.296 [2024-11-28 15:02:52.307046] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid602483 ] 00:07:52.296 EAL: No free 2048 kB hugepages reported on node 1 00:07:52.296 [2024-11-28 15:02:52.368852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:52.296 [2024-11-28 15:02:52.456508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=0x1 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=decompress 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=software 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@23 -- # accel_module=software 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=32 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=32 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=2 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val=Yes 00:07:52.296 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.296 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.296 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.554 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.554 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.554 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:52.554 15:02:52 -- accel/accel.sh@21 -- # val= 00:07:52.554 15:02:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:52.554 15:02:52 -- accel/accel.sh@20 -- # IFS=: 00:07:52.554 15:02:52 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@21 -- # val= 00:07:53.487 15:02:53 -- accel/accel.sh@22 -- # case "$var" in 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # IFS=: 00:07:53.487 15:02:53 -- accel/accel.sh@20 -- # read -r var val 00:07:53.487 15:02:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:53.487 15:02:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:53.487 15:02:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:53.487 00:07:53.487 real 0m2.866s 00:07:53.487 user 0m2.577s 00:07:53.487 sys 0m0.283s 00:07:53.487 15:02:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.487 15:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:53.487 ************************************ 00:07:53.487 END TEST accel_deomp_full_mthread 00:07:53.487 ************************************ 00:07:53.746 15:02:53 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:53.746 15:02:53 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:53.746 15:02:53 -- accel/accel.sh@129 -- # build_accel_config 00:07:53.746 15:02:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:53.746 15:02:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:53.746 15:02:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.746 15:02:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:53.746 15:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:53.746 15:02:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:53.746 15:02:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:53.746 15:02:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:53.746 15:02:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:53.746 15:02:53 -- accel/accel.sh@42 -- # jq -r . 00:07:53.746 ************************************ 00:07:53.746 START TEST accel_dif_functional_tests 00:07:53.746 ************************************ 00:07:53.746 15:02:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:53.746 [2024-11-28 15:02:53.779951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:53.746 [2024-11-28 15:02:53.780019] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid602638 ] 00:07:53.746 EAL: No free 2048 kB hugepages reported on node 1 00:07:53.746 [2024-11-28 15:02:53.840345] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:53.746 [2024-11-28 15:02:53.933022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:53.746 [2024-11-28 15:02:53.933075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:53.746 [2024-11-28 15:02:53.933098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.004 00:07:54.004 00:07:54.004 CUnit - A unit testing framework for C - Version 2.1-3 00:07:54.004 http://cunit.sourceforge.net/ 00:07:54.004 00:07:54.004 00:07:54.004 Suite: accel_dif 00:07:54.004 Test: verify: DIF generated, GUARD check ...passed 00:07:54.004 Test: verify: DIF generated, APPTAG check ...passed 00:07:54.004 Test: verify: DIF generated, REFTAG check ...passed 00:07:54.004 Test: verify: DIF not generated, GUARD check ...[2024-11-28 15:02:54.025681] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:54.004 [2024-11-28 15:02:54.025752] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:54.004 passed 00:07:54.004 Test: verify: DIF not generated, APPTAG check ...[2024-11-28 15:02:54.025788] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:54.004 [2024-11-28 15:02:54.025815] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:54.004 passed 00:07:54.004 Test: verify: DIF not generated, REFTAG check ...[2024-11-28 15:02:54.025844] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:54.004 [2024-11-28 15:02:54.025867] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:54.004 passed 00:07:54.004 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:54.004 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-28 15:02:54.025925] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:54.004 passed 00:07:54.004 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:54.004 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:54.004 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:54.004 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-28 15:02:54.026057] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:54.004 passed 00:07:54.004 Test: generate copy: DIF generated, GUARD check ...passed 00:07:54.004 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:54.004 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:54.004 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:54.004 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:54.004 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:54.004 Test: generate copy: iovecs-len validate ...[2024-11-28 15:02:54.026304] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:54.004 passed 00:07:54.004 Test: generate copy: buffer alignment validate ...passed 00:07:54.004 00:07:54.004 Run Summary: Type Total Ran Passed Failed Inactive 00:07:54.004 suites 1 1 n/a 0 0 00:07:54.004 tests 20 20 20 0 0 00:07:54.004 asserts 204 204 204 0 n/a 00:07:54.004 00:07:54.004 Elapsed time = 0.002 seconds 00:07:54.004 00:07:54.004 real 0m0.481s 00:07:54.004 user 0m0.725s 00:07:54.004 sys 0m0.188s 00:07:54.004 15:02:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.004 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.004 ************************************ 00:07:54.004 END TEST accel_dif_functional_tests 00:07:54.004 ************************************ 00:07:54.262 00:07:54.262 real 0m59.908s 00:07:54.262 user 1m7.585s 00:07:54.262 sys 0m7.296s 00:07:54.262 15:02:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.262 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.262 ************************************ 00:07:54.262 END TEST accel 00:07:54.262 ************************************ 00:07:54.262 15:02:54 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:54.262 15:02:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:54.262 15:02:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.262 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.262 ************************************ 00:07:54.262 START TEST accel_rpc 00:07:54.262 ************************************ 00:07:54.262 15:02:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:54.262 * Looking for test storage... 00:07:54.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:54.262 15:02:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:54.262 15:02:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:54.262 15:02:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:54.262 15:02:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:54.262 15:02:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:54.262 15:02:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:54.262 15:02:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:54.262 15:02:54 -- scripts/common.sh@335 -- # IFS=.-: 00:07:54.262 15:02:54 -- scripts/common.sh@335 -- # read -ra ver1 00:07:54.262 15:02:54 -- scripts/common.sh@336 -- # IFS=.-: 00:07:54.262 15:02:54 -- scripts/common.sh@336 -- # read -ra ver2 00:07:54.262 15:02:54 -- scripts/common.sh@337 -- # local 'op=<' 00:07:54.262 15:02:54 -- scripts/common.sh@339 -- # ver1_l=2 00:07:54.262 15:02:54 -- scripts/common.sh@340 -- # ver2_l=1 00:07:54.262 15:02:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:54.262 15:02:54 -- scripts/common.sh@343 -- # case "$op" in 00:07:54.262 15:02:54 -- scripts/common.sh@344 -- # : 1 00:07:54.262 15:02:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:54.262 15:02:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:54.262 15:02:54 -- scripts/common.sh@364 -- # decimal 1 00:07:54.262 15:02:54 -- scripts/common.sh@352 -- # local d=1 00:07:54.262 15:02:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:54.262 15:02:54 -- scripts/common.sh@354 -- # echo 1 00:07:54.262 15:02:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:54.262 15:02:54 -- scripts/common.sh@365 -- # decimal 2 00:07:54.262 15:02:54 -- scripts/common.sh@352 -- # local d=2 00:07:54.262 15:02:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:54.262 15:02:54 -- scripts/common.sh@354 -- # echo 2 00:07:54.262 15:02:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:54.262 15:02:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:54.262 15:02:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:54.262 15:02:54 -- scripts/common.sh@367 -- # return 0 00:07:54.262 15:02:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:54.262 15:02:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.262 --rc genhtml_branch_coverage=1 00:07:54.262 --rc genhtml_function_coverage=1 00:07:54.262 --rc genhtml_legend=1 00:07:54.262 --rc geninfo_all_blocks=1 00:07:54.262 --rc geninfo_unexecuted_blocks=1 00:07:54.262 00:07:54.262 ' 00:07:54.262 15:02:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.262 --rc genhtml_branch_coverage=1 00:07:54.262 --rc genhtml_function_coverage=1 00:07:54.262 --rc genhtml_legend=1 00:07:54.262 --rc geninfo_all_blocks=1 00:07:54.262 --rc geninfo_unexecuted_blocks=1 00:07:54.262 00:07:54.262 ' 00:07:54.262 15:02:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.262 --rc genhtml_branch_coverage=1 00:07:54.262 --rc genhtml_function_coverage=1 00:07:54.262 --rc genhtml_legend=1 00:07:54.262 --rc geninfo_all_blocks=1 00:07:54.262 --rc geninfo_unexecuted_blocks=1 00:07:54.262 00:07:54.262 ' 00:07:54.262 15:02:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:54.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:54.262 --rc genhtml_branch_coverage=1 00:07:54.262 --rc genhtml_function_coverage=1 00:07:54.262 --rc genhtml_legend=1 00:07:54.262 --rc geninfo_all_blocks=1 00:07:54.262 --rc geninfo_unexecuted_blocks=1 00:07:54.262 00:07:54.262 ' 00:07:54.262 15:02:54 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:54.262 15:02:54 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=602834 00:07:54.262 15:02:54 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:54.262 15:02:54 -- accel/accel_rpc.sh@15 -- # waitforlisten 602834 00:07:54.262 15:02:54 -- common/autotest_common.sh@829 -- # '[' -z 602834 ']' 00:07:54.262 15:02:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.262 15:02:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:54.262 15:02:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.262 15:02:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:54.262 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.262 [2024-11-28 15:02:54.453802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:54.262 [2024-11-28 15:02:54.453891] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid602834 ] 00:07:54.262 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.519 [2024-11-28 15:02:54.511781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:54.519 [2024-11-28 15:02:54.598127] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:54.519 [2024-11-28 15:02:54.598313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:54.519 15:02:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:54.519 15:02:54 -- common/autotest_common.sh@862 -- # return 0 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:54.519 15:02:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:54.519 15:02:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:54.519 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.519 ************************************ 00:07:54.519 START TEST accel_assign_opcode 00:07:54.519 ************************************ 00:07:54.519 15:02:54 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:54.519 15:02:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.519 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.519 [2024-11-28 15:02:54.674909] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:54.519 15:02:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:54.519 15:02:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.519 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.519 [2024-11-28 15:02:54.682927] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:54.519 15:02:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.519 15:02:54 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:54.519 15:02:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.519 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.777 15:02:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.777 15:02:54 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:54.777 15:02:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.777 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.777 15:02:54 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:54.777 15:02:54 -- accel/accel_rpc.sh@42 -- # grep software 00:07:54.777 15:02:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.777 software 00:07:54.777 00:07:54.777 real 0m0.285s 00:07:54.777 user 0m0.041s 00:07:54.777 sys 0m0.006s 00:07:54.777 15:02:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:54.777 15:02:54 -- common/autotest_common.sh@10 -- # set +x 00:07:54.777 ************************************ 00:07:54.777 END TEST accel_assign_opcode 00:07:54.777 ************************************ 00:07:54.777 15:02:54 -- accel/accel_rpc.sh@55 -- # killprocess 602834 00:07:54.777 15:02:54 -- common/autotest_common.sh@936 -- # '[' -z 602834 ']' 00:07:54.777 15:02:54 -- common/autotest_common.sh@940 -- # kill -0 602834 00:07:54.777 15:02:54 -- common/autotest_common.sh@941 -- # uname 00:07:54.777 15:02:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:54.777 15:02:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 602834 00:07:55.040 15:02:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:55.040 15:02:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:55.040 15:02:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 602834' 00:07:55.040 killing process with pid 602834 00:07:55.040 15:02:55 -- common/autotest_common.sh@955 -- # kill 602834 00:07:55.040 15:02:55 -- common/autotest_common.sh@960 -- # wait 602834 00:07:55.302 00:07:55.302 real 0m1.127s 00:07:55.302 user 0m1.056s 00:07:55.302 sys 0m0.430s 00:07:55.302 15:02:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:55.302 15:02:55 -- common/autotest_common.sh@10 -- # set +x 00:07:55.302 ************************************ 00:07:55.302 END TEST accel_rpc 00:07:55.302 ************************************ 00:07:55.302 15:02:55 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:55.302 15:02:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:55.302 15:02:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:55.302 15:02:55 -- common/autotest_common.sh@10 -- # set +x 00:07:55.302 ************************************ 00:07:55.302 START TEST app_cmdline 00:07:55.302 ************************************ 00:07:55.302 15:02:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:55.302 * Looking for test storage... 00:07:55.302 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:55.302 15:02:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:55.302 15:02:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:55.302 15:02:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:55.562 15:02:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:55.562 15:02:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:55.562 15:02:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:55.562 15:02:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:55.562 15:02:55 -- scripts/common.sh@335 -- # IFS=.-: 00:07:55.562 15:02:55 -- scripts/common.sh@335 -- # read -ra ver1 00:07:55.562 15:02:55 -- scripts/common.sh@336 -- # IFS=.-: 00:07:55.562 15:02:55 -- scripts/common.sh@336 -- # read -ra ver2 00:07:55.562 15:02:55 -- scripts/common.sh@337 -- # local 'op=<' 00:07:55.562 15:02:55 -- scripts/common.sh@339 -- # ver1_l=2 00:07:55.562 15:02:55 -- scripts/common.sh@340 -- # ver2_l=1 00:07:55.562 15:02:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:55.562 15:02:55 -- scripts/common.sh@343 -- # case "$op" in 00:07:55.562 15:02:55 -- scripts/common.sh@344 -- # : 1 00:07:55.562 15:02:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:55.562 15:02:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:55.562 15:02:55 -- scripts/common.sh@364 -- # decimal 1 00:07:55.562 15:02:55 -- scripts/common.sh@352 -- # local d=1 00:07:55.562 15:02:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:55.562 15:02:55 -- scripts/common.sh@354 -- # echo 1 00:07:55.562 15:02:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:55.562 15:02:55 -- scripts/common.sh@365 -- # decimal 2 00:07:55.562 15:02:55 -- scripts/common.sh@352 -- # local d=2 00:07:55.562 15:02:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:55.562 15:02:55 -- scripts/common.sh@354 -- # echo 2 00:07:55.562 15:02:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:55.562 15:02:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:55.562 15:02:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:55.562 15:02:55 -- scripts/common.sh@367 -- # return 0 00:07:55.562 15:02:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:55.562 15:02:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:55.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.562 --rc genhtml_branch_coverage=1 00:07:55.562 --rc genhtml_function_coverage=1 00:07:55.562 --rc genhtml_legend=1 00:07:55.562 --rc geninfo_all_blocks=1 00:07:55.562 --rc geninfo_unexecuted_blocks=1 00:07:55.562 00:07:55.562 ' 00:07:55.562 15:02:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:55.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.562 --rc genhtml_branch_coverage=1 00:07:55.562 --rc genhtml_function_coverage=1 00:07:55.562 --rc genhtml_legend=1 00:07:55.562 --rc geninfo_all_blocks=1 00:07:55.562 --rc geninfo_unexecuted_blocks=1 00:07:55.562 00:07:55.562 ' 00:07:55.562 15:02:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:55.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.562 --rc genhtml_branch_coverage=1 00:07:55.562 --rc genhtml_function_coverage=1 00:07:55.562 --rc genhtml_legend=1 00:07:55.562 --rc geninfo_all_blocks=1 00:07:55.562 --rc geninfo_unexecuted_blocks=1 00:07:55.562 00:07:55.562 ' 00:07:55.562 15:02:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:55.562 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:55.562 --rc genhtml_branch_coverage=1 00:07:55.562 --rc genhtml_function_coverage=1 00:07:55.562 --rc genhtml_legend=1 00:07:55.562 --rc geninfo_all_blocks=1 00:07:55.562 --rc geninfo_unexecuted_blocks=1 00:07:55.562 00:07:55.562 ' 00:07:55.562 15:02:55 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:55.562 15:02:55 -- app/cmdline.sh@17 -- # spdk_tgt_pid=603047 00:07:55.562 15:02:55 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:55.562 15:02:55 -- app/cmdline.sh@18 -- # waitforlisten 603047 00:07:55.562 15:02:55 -- common/autotest_common.sh@829 -- # '[' -z 603047 ']' 00:07:55.562 15:02:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:55.562 15:02:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:55.562 15:02:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:55.562 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:55.562 15:02:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:55.562 15:02:55 -- common/autotest_common.sh@10 -- # set +x 00:07:55.562 [2024-11-28 15:02:55.616244] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:07:55.562 [2024-11-28 15:02:55.616331] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid603047 ] 00:07:55.562 EAL: No free 2048 kB hugepages reported on node 1 00:07:55.562 [2024-11-28 15:02:55.672562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:55.562 [2024-11-28 15:02:55.758914] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:55.562 [2024-11-28 15:02:55.759103] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:56.497 15:02:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:56.497 15:02:56 -- common/autotest_common.sh@862 -- # return 0 00:07:56.497 15:02:56 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:56.755 { 00:07:56.755 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:56.755 "fields": { 00:07:56.755 "major": 24, 00:07:56.755 "minor": 1, 00:07:56.755 "patch": 1, 00:07:56.755 "suffix": "-pre", 00:07:56.755 "commit": "c13c99a5e" 00:07:56.755 } 00:07:56.755 } 00:07:56.755 15:02:56 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:56.755 15:02:56 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:56.755 15:02:56 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:56.755 15:02:56 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:56.755 15:02:56 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:56.755 15:02:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:56.755 15:02:56 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:56.755 15:02:56 -- common/autotest_common.sh@10 -- # set +x 00:07:56.755 15:02:56 -- app/cmdline.sh@26 -- # sort 00:07:56.755 15:02:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:56.755 15:02:56 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:56.755 15:02:56 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:56.755 15:02:56 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:56.755 15:02:56 -- common/autotest_common.sh@650 -- # local es=0 00:07:56.755 15:02:56 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:56.755 15:02:56 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.755 15:02:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:56.755 15:02:56 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.755 15:02:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:56.755 15:02:56 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.755 15:02:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:56.755 15:02:56 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:56.755 15:02:56 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:56.755 15:02:56 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:57.013 request: 00:07:57.013 { 00:07:57.013 "method": "env_dpdk_get_mem_stats", 00:07:57.013 "req_id": 1 00:07:57.013 } 00:07:57.013 Got JSON-RPC error response 00:07:57.014 response: 00:07:57.014 { 00:07:57.014 "code": -32601, 00:07:57.014 "message": "Method not found" 00:07:57.014 } 00:07:57.014 15:02:57 -- common/autotest_common.sh@653 -- # es=1 00:07:57.014 15:02:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:57.014 15:02:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:57.014 15:02:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:57.014 15:02:57 -- app/cmdline.sh@1 -- # killprocess 603047 00:07:57.014 15:02:57 -- common/autotest_common.sh@936 -- # '[' -z 603047 ']' 00:07:57.014 15:02:57 -- common/autotest_common.sh@940 -- # kill -0 603047 00:07:57.014 15:02:57 -- common/autotest_common.sh@941 -- # uname 00:07:57.014 15:02:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:57.014 15:02:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 603047 00:07:57.014 15:02:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:57.014 15:02:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:57.014 15:02:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 603047' 00:07:57.014 killing process with pid 603047 00:07:57.014 15:02:57 -- common/autotest_common.sh@955 -- # kill 603047 00:07:57.014 15:02:57 -- common/autotest_common.sh@960 -- # wait 603047 00:07:57.580 00:07:57.580 real 0m2.151s 00:07:57.580 user 0m2.712s 00:07:57.580 sys 0m0.512s 00:07:57.580 15:02:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:57.580 15:02:57 -- common/autotest_common.sh@10 -- # set +x 00:07:57.580 ************************************ 00:07:57.580 END TEST app_cmdline 00:07:57.580 ************************************ 00:07:57.580 15:02:57 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:57.580 15:02:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:57.580 15:02:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.580 15:02:57 -- common/autotest_common.sh@10 -- # set +x 00:07:57.580 ************************************ 00:07:57.580 START TEST version 00:07:57.580 ************************************ 00:07:57.580 15:02:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:57.580 * Looking for test storage... 00:07:57.580 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:57.580 15:02:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:57.580 15:02:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:57.580 15:02:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:57.580 15:02:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:57.580 15:02:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:57.580 15:02:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:57.580 15:02:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:57.580 15:02:57 -- scripts/common.sh@335 -- # IFS=.-: 00:07:57.580 15:02:57 -- scripts/common.sh@335 -- # read -ra ver1 00:07:57.580 15:02:57 -- scripts/common.sh@336 -- # IFS=.-: 00:07:57.580 15:02:57 -- scripts/common.sh@336 -- # read -ra ver2 00:07:57.580 15:02:57 -- scripts/common.sh@337 -- # local 'op=<' 00:07:57.580 15:02:57 -- scripts/common.sh@339 -- # ver1_l=2 00:07:57.580 15:02:57 -- scripts/common.sh@340 -- # ver2_l=1 00:07:57.580 15:02:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:57.580 15:02:57 -- scripts/common.sh@343 -- # case "$op" in 00:07:57.580 15:02:57 -- scripts/common.sh@344 -- # : 1 00:07:57.580 15:02:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:57.580 15:02:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:57.580 15:02:57 -- scripts/common.sh@364 -- # decimal 1 00:07:57.580 15:02:57 -- scripts/common.sh@352 -- # local d=1 00:07:57.580 15:02:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:57.580 15:02:57 -- scripts/common.sh@354 -- # echo 1 00:07:57.580 15:02:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:57.580 15:02:57 -- scripts/common.sh@365 -- # decimal 2 00:07:57.580 15:02:57 -- scripts/common.sh@352 -- # local d=2 00:07:57.580 15:02:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:57.580 15:02:57 -- scripts/common.sh@354 -- # echo 2 00:07:57.580 15:02:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:57.580 15:02:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:57.580 15:02:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:57.580 15:02:57 -- scripts/common.sh@367 -- # return 0 00:07:57.580 15:02:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:57.580 15:02:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.580 --rc genhtml_branch_coverage=1 00:07:57.580 --rc genhtml_function_coverage=1 00:07:57.580 --rc genhtml_legend=1 00:07:57.580 --rc geninfo_all_blocks=1 00:07:57.580 --rc geninfo_unexecuted_blocks=1 00:07:57.580 00:07:57.580 ' 00:07:57.580 15:02:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.580 --rc genhtml_branch_coverage=1 00:07:57.580 --rc genhtml_function_coverage=1 00:07:57.580 --rc genhtml_legend=1 00:07:57.580 --rc geninfo_all_blocks=1 00:07:57.580 --rc geninfo_unexecuted_blocks=1 00:07:57.580 00:07:57.580 ' 00:07:57.580 15:02:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.580 --rc genhtml_branch_coverage=1 00:07:57.580 --rc genhtml_function_coverage=1 00:07:57.580 --rc genhtml_legend=1 00:07:57.580 --rc geninfo_all_blocks=1 00:07:57.580 --rc geninfo_unexecuted_blocks=1 00:07:57.580 00:07:57.580 ' 00:07:57.580 15:02:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:57.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.580 --rc genhtml_branch_coverage=1 00:07:57.580 --rc genhtml_function_coverage=1 00:07:57.580 --rc genhtml_legend=1 00:07:57.580 --rc geninfo_all_blocks=1 00:07:57.580 --rc geninfo_unexecuted_blocks=1 00:07:57.580 00:07:57.580 ' 00:07:57.580 15:02:57 -- app/version.sh@17 -- # get_header_version major 00:07:57.580 15:02:57 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:57.581 15:02:57 -- app/version.sh@14 -- # cut -f2 00:07:57.581 15:02:57 -- app/version.sh@14 -- # tr -d '"' 00:07:57.581 15:02:57 -- app/version.sh@17 -- # major=24 00:07:57.581 15:02:57 -- app/version.sh@18 -- # get_header_version minor 00:07:57.581 15:02:57 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:57.581 15:02:57 -- app/version.sh@14 -- # cut -f2 00:07:57.581 15:02:57 -- app/version.sh@14 -- # tr -d '"' 00:07:57.581 15:02:57 -- app/version.sh@18 -- # minor=1 00:07:57.581 15:02:57 -- app/version.sh@19 -- # get_header_version patch 00:07:57.581 15:02:57 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:57.581 15:02:57 -- app/version.sh@14 -- # cut -f2 00:07:57.581 15:02:57 -- app/version.sh@14 -- # tr -d '"' 00:07:57.581 15:02:57 -- app/version.sh@19 -- # patch=1 00:07:57.581 15:02:57 -- app/version.sh@20 -- # get_header_version suffix 00:07:57.581 15:02:57 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:57.581 15:02:57 -- app/version.sh@14 -- # cut -f2 00:07:57.581 15:02:57 -- app/version.sh@14 -- # tr -d '"' 00:07:57.581 15:02:57 -- app/version.sh@20 -- # suffix=-pre 00:07:57.581 15:02:57 -- app/version.sh@22 -- # version=24.1 00:07:57.581 15:02:57 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:57.581 15:02:57 -- app/version.sh@25 -- # version=24.1.1 00:07:57.581 15:02:57 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:57.581 15:02:57 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:57.581 15:02:57 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:57.581 15:02:57 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:57.581 15:02:57 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:57.581 00:07:57.581 real 0m0.190s 00:07:57.581 user 0m0.123s 00:07:57.581 sys 0m0.092s 00:07:57.581 15:02:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:57.581 15:02:57 -- common/autotest_common.sh@10 -- # set +x 00:07:57.581 ************************************ 00:07:57.581 END TEST version 00:07:57.581 ************************************ 00:07:57.840 15:02:57 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@191 -- # uname -s 00:07:57.840 15:02:57 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:57.840 15:02:57 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:57.840 15:02:57 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:57.840 15:02:57 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:57.840 15:02:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:57.840 15:02:57 -- common/autotest_common.sh@10 -- # set +x 00:07:57.840 15:02:57 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:57.840 15:02:57 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:57.840 15:02:57 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:57.840 15:02:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:57.840 15:02:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.840 15:02:57 -- common/autotest_common.sh@10 -- # set +x 00:07:57.840 ************************************ 00:07:57.840 START TEST nvmf_tcp 00:07:57.840 ************************************ 00:07:57.840 15:02:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:57.840 * Looking for test storage... 00:07:57.840 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:57.840 15:02:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:57.840 15:02:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:57.840 15:02:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:57.840 15:02:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:57.840 15:02:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:57.840 15:02:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:57.840 15:02:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:57.840 15:02:57 -- scripts/common.sh@335 -- # IFS=.-: 00:07:57.840 15:02:57 -- scripts/common.sh@335 -- # read -ra ver1 00:07:57.840 15:02:57 -- scripts/common.sh@336 -- # IFS=.-: 00:07:57.840 15:02:57 -- scripts/common.sh@336 -- # read -ra ver2 00:07:57.840 15:02:57 -- scripts/common.sh@337 -- # local 'op=<' 00:07:57.840 15:02:57 -- scripts/common.sh@339 -- # ver1_l=2 00:07:57.840 15:02:57 -- scripts/common.sh@340 -- # ver2_l=1 00:07:57.840 15:02:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:57.840 15:02:57 -- scripts/common.sh@343 -- # case "$op" in 00:07:57.840 15:02:57 -- scripts/common.sh@344 -- # : 1 00:07:57.840 15:02:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:57.840 15:02:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:57.840 15:02:57 -- scripts/common.sh@364 -- # decimal 1 00:07:57.840 15:02:57 -- scripts/common.sh@352 -- # local d=1 00:07:57.840 15:02:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:57.840 15:02:57 -- scripts/common.sh@354 -- # echo 1 00:07:57.840 15:02:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:57.840 15:02:57 -- scripts/common.sh@365 -- # decimal 2 00:07:57.840 15:02:57 -- scripts/common.sh@352 -- # local d=2 00:07:57.840 15:02:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:57.840 15:02:57 -- scripts/common.sh@354 -- # echo 2 00:07:57.840 15:02:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:57.840 15:02:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:57.840 15:02:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:57.840 15:02:57 -- scripts/common.sh@367 -- # return 0 00:07:57.840 15:02:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:57.840 15:02:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:57.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.840 --rc genhtml_branch_coverage=1 00:07:57.840 --rc genhtml_function_coverage=1 00:07:57.840 --rc genhtml_legend=1 00:07:57.840 --rc geninfo_all_blocks=1 00:07:57.840 --rc geninfo_unexecuted_blocks=1 00:07:57.840 00:07:57.840 ' 00:07:57.840 15:02:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:57.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.840 --rc genhtml_branch_coverage=1 00:07:57.840 --rc genhtml_function_coverage=1 00:07:57.840 --rc genhtml_legend=1 00:07:57.840 --rc geninfo_all_blocks=1 00:07:57.840 --rc geninfo_unexecuted_blocks=1 00:07:57.840 00:07:57.840 ' 00:07:57.840 15:02:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:57.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.840 --rc genhtml_branch_coverage=1 00:07:57.840 --rc genhtml_function_coverage=1 00:07:57.840 --rc genhtml_legend=1 00:07:57.840 --rc geninfo_all_blocks=1 00:07:57.840 --rc geninfo_unexecuted_blocks=1 00:07:57.840 00:07:57.840 ' 00:07:57.840 15:02:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:57.840 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:57.840 --rc genhtml_branch_coverage=1 00:07:57.840 --rc genhtml_function_coverage=1 00:07:57.840 --rc genhtml_legend=1 00:07:57.840 --rc geninfo_all_blocks=1 00:07:57.840 --rc geninfo_unexecuted_blocks=1 00:07:57.840 00:07:57.840 ' 00:07:57.840 15:02:57 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:57.840 15:02:57 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:57.840 15:02:57 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:57.840 15:02:57 -- nvmf/common.sh@7 -- # uname -s 00:07:57.840 15:02:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:57.840 15:02:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:57.840 15:02:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:57.840 15:02:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:57.840 15:02:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:57.840 15:02:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:57.840 15:02:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:57.840 15:02:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:57.840 15:02:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:57.840 15:02:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:57.840 15:02:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:57.840 15:02:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:57.840 15:02:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:57.840 15:02:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:57.840 15:02:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:57.840 15:02:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:57.840 15:02:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:57.840 15:02:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:57.840 15:02:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:57.840 15:02:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.840 15:02:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.840 15:02:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.840 15:02:58 -- paths/export.sh@5 -- # export PATH 00:07:57.840 15:02:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:57.840 15:02:58 -- nvmf/common.sh@46 -- # : 0 00:07:57.840 15:02:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:57.840 15:02:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:57.840 15:02:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:57.840 15:02:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:57.840 15:02:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:57.840 15:02:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:57.840 15:02:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:57.840 15:02:58 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:57.840 15:02:58 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:57.840 15:02:58 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:57.840 15:02:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:57.840 15:02:58 -- common/autotest_common.sh@10 -- # set +x 00:07:57.840 15:02:58 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:57.840 15:02:58 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:57.840 15:02:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:57.840 15:02:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:57.840 15:02:58 -- common/autotest_common.sh@10 -- # set +x 00:07:57.840 ************************************ 00:07:57.840 START TEST nvmf_example 00:07:57.840 ************************************ 00:07:57.840 15:02:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:57.840 * Looking for test storage... 00:07:58.100 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:58.100 15:02:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:58.100 15:02:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:58.100 15:02:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:58.100 15:02:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:58.100 15:02:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:58.100 15:02:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:58.100 15:02:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:58.100 15:02:58 -- scripts/common.sh@335 -- # IFS=.-: 00:07:58.100 15:02:58 -- scripts/common.sh@335 -- # read -ra ver1 00:07:58.100 15:02:58 -- scripts/common.sh@336 -- # IFS=.-: 00:07:58.100 15:02:58 -- scripts/common.sh@336 -- # read -ra ver2 00:07:58.100 15:02:58 -- scripts/common.sh@337 -- # local 'op=<' 00:07:58.100 15:02:58 -- scripts/common.sh@339 -- # ver1_l=2 00:07:58.100 15:02:58 -- scripts/common.sh@340 -- # ver2_l=1 00:07:58.100 15:02:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:58.100 15:02:58 -- scripts/common.sh@343 -- # case "$op" in 00:07:58.100 15:02:58 -- scripts/common.sh@344 -- # : 1 00:07:58.100 15:02:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:58.100 15:02:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:58.100 15:02:58 -- scripts/common.sh@364 -- # decimal 1 00:07:58.100 15:02:58 -- scripts/common.sh@352 -- # local d=1 00:07:58.100 15:02:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:58.100 15:02:58 -- scripts/common.sh@354 -- # echo 1 00:07:58.100 15:02:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:58.100 15:02:58 -- scripts/common.sh@365 -- # decimal 2 00:07:58.100 15:02:58 -- scripts/common.sh@352 -- # local d=2 00:07:58.100 15:02:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:58.100 15:02:58 -- scripts/common.sh@354 -- # echo 2 00:07:58.100 15:02:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:58.100 15:02:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:58.100 15:02:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:58.100 15:02:58 -- scripts/common.sh@367 -- # return 0 00:07:58.100 15:02:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:58.100 15:02:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:58.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:58.100 --rc genhtml_branch_coverage=1 00:07:58.100 --rc genhtml_function_coverage=1 00:07:58.100 --rc genhtml_legend=1 00:07:58.100 --rc geninfo_all_blocks=1 00:07:58.100 --rc geninfo_unexecuted_blocks=1 00:07:58.100 00:07:58.100 ' 00:07:58.100 15:02:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:58.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:58.100 --rc genhtml_branch_coverage=1 00:07:58.100 --rc genhtml_function_coverage=1 00:07:58.100 --rc genhtml_legend=1 00:07:58.100 --rc geninfo_all_blocks=1 00:07:58.100 --rc geninfo_unexecuted_blocks=1 00:07:58.100 00:07:58.100 ' 00:07:58.100 15:02:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:58.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:58.100 --rc genhtml_branch_coverage=1 00:07:58.100 --rc genhtml_function_coverage=1 00:07:58.100 --rc genhtml_legend=1 00:07:58.100 --rc geninfo_all_blocks=1 00:07:58.100 --rc geninfo_unexecuted_blocks=1 00:07:58.100 00:07:58.100 ' 00:07:58.100 15:02:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:58.100 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:58.100 --rc genhtml_branch_coverage=1 00:07:58.100 --rc genhtml_function_coverage=1 00:07:58.100 --rc genhtml_legend=1 00:07:58.100 --rc geninfo_all_blocks=1 00:07:58.100 --rc geninfo_unexecuted_blocks=1 00:07:58.100 00:07:58.100 ' 00:07:58.100 15:02:58 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:58.100 15:02:58 -- nvmf/common.sh@7 -- # uname -s 00:07:58.100 15:02:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:58.100 15:02:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:58.100 15:02:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:58.100 15:02:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:58.100 15:02:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:58.100 15:02:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:58.100 15:02:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:58.100 15:02:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:58.100 15:02:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:58.100 15:02:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:58.100 15:02:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:58.100 15:02:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:58.100 15:02:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:58.100 15:02:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:58.100 15:02:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:58.100 15:02:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:58.100 15:02:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:58.100 15:02:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:58.100 15:02:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:58.100 15:02:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:58.100 15:02:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:58.100 15:02:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:58.100 15:02:58 -- paths/export.sh@5 -- # export PATH 00:07:58.100 15:02:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:58.100 15:02:58 -- nvmf/common.sh@46 -- # : 0 00:07:58.100 15:02:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:58.100 15:02:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:58.100 15:02:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:58.100 15:02:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:58.100 15:02:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:58.100 15:02:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:58.100 15:02:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:58.100 15:02:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:58.100 15:02:58 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:58.100 15:02:58 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:58.100 15:02:58 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:58.100 15:02:58 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:58.100 15:02:58 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:58.100 15:02:58 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:58.100 15:02:58 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:58.100 15:02:58 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:58.100 15:02:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:58.100 15:02:58 -- common/autotest_common.sh@10 -- # set +x 00:07:58.100 15:02:58 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:58.100 15:02:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:58.100 15:02:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:58.100 15:02:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:58.100 15:02:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:58.100 15:02:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:58.101 15:02:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:58.101 15:02:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:58.101 15:02:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:58.101 15:02:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:58.101 15:02:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:58.101 15:02:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:58.101 15:02:58 -- common/autotest_common.sh@10 -- # set +x 00:08:00.003 15:03:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:00.003 15:03:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:00.003 15:03:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:00.003 15:03:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:00.003 15:03:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:00.003 15:03:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:00.003 15:03:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:00.003 15:03:00 -- nvmf/common.sh@294 -- # net_devs=() 00:08:00.003 15:03:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:00.003 15:03:00 -- nvmf/common.sh@295 -- # e810=() 00:08:00.003 15:03:00 -- nvmf/common.sh@295 -- # local -ga e810 00:08:00.003 15:03:00 -- nvmf/common.sh@296 -- # x722=() 00:08:00.003 15:03:00 -- nvmf/common.sh@296 -- # local -ga x722 00:08:00.003 15:03:00 -- nvmf/common.sh@297 -- # mlx=() 00:08:00.003 15:03:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:00.003 15:03:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:00.003 15:03:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:00.003 15:03:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:00.004 15:03:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:00.004 15:03:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:00.004 15:03:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:00.004 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:00.004 15:03:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:00.004 15:03:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:00.004 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:00.004 15:03:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:00.004 15:03:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:00.004 15:03:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:00.004 15:03:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:00.004 15:03:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:00.004 15:03:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:00.004 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:00.004 15:03:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:00.004 15:03:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:00.004 15:03:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:00.004 15:03:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:00.004 15:03:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:00.004 15:03:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:00.004 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:00.004 15:03:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:00.004 15:03:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:00.004 15:03:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:00.004 15:03:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:00.004 15:03:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:00.004 15:03:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:00.004 15:03:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:00.004 15:03:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:00.004 15:03:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:00.004 15:03:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:00.004 15:03:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:00.004 15:03:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:00.004 15:03:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:00.004 15:03:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:00.004 15:03:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:00.004 15:03:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:00.004 15:03:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:00.004 15:03:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:00.004 15:03:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:00.004 15:03:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:00.004 15:03:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:00.004 15:03:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:00.004 15:03:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:00.004 15:03:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:00.004 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:00.004 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.410 ms 00:08:00.004 00:08:00.004 --- 10.0.0.2 ping statistics --- 00:08:00.004 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:00.004 rtt min/avg/max/mdev = 0.410/0.410/0.410/0.000 ms 00:08:00.004 15:03:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:00.004 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:00.004 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.053 ms 00:08:00.004 00:08:00.004 --- 10.0.0.1 ping statistics --- 00:08:00.004 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:00.004 rtt min/avg/max/mdev = 0.053/0.053/0.053/0.000 ms 00:08:00.004 15:03:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:00.004 15:03:00 -- nvmf/common.sh@410 -- # return 0 00:08:00.004 15:03:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:00.004 15:03:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:00.004 15:03:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:00.004 15:03:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:00.004 15:03:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:00.004 15:03:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:00.263 15:03:00 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:08:00.263 15:03:00 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:08:00.263 15:03:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:00.263 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.263 15:03:00 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:08:00.263 15:03:00 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:08:00.263 15:03:00 -- target/nvmf_example.sh@34 -- # nvmfpid=605130 00:08:00.263 15:03:00 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:08:00.263 15:03:00 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:08:00.263 15:03:00 -- target/nvmf_example.sh@36 -- # waitforlisten 605130 00:08:00.263 15:03:00 -- common/autotest_common.sh@829 -- # '[' -z 605130 ']' 00:08:00.263 15:03:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:00.263 15:03:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:00.263 15:03:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:00.263 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:00.263 15:03:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:00.263 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.263 EAL: No free 2048 kB hugepages reported on node 1 00:08:00.521 15:03:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:00.521 15:03:00 -- common/autotest_common.sh@862 -- # return 0 00:08:00.521 15:03:00 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:08:00.521 15:03:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:00.521 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.521 15:03:00 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:00.521 15:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.521 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.521 15:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.521 15:03:00 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:08:00.521 15:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.521 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.521 15:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.521 15:03:00 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:08:00.521 15:03:00 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:00.521 15:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.521 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.521 15:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.521 15:03:00 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:08:00.521 15:03:00 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:00.521 15:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.521 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.521 15:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.521 15:03:00 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:00.521 15:03:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.521 15:03:00 -- common/autotest_common.sh@10 -- # set +x 00:08:00.521 15:03:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.521 15:03:00 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:08:00.521 15:03:00 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:08:00.521 EAL: No free 2048 kB hugepages reported on node 1 00:08:12.722 Initializing NVMe Controllers 00:08:12.722 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:12.722 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:12.722 Initialization complete. Launching workers. 00:08:12.722 ======================================================== 00:08:12.722 Latency(us) 00:08:12.722 Device Information : IOPS MiB/s Average min max 00:08:12.722 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15095.90 58.97 4239.60 900.95 15719.24 00:08:12.722 ======================================================== 00:08:12.722 Total : 15095.90 58.97 4239.60 900.95 15719.24 00:08:12.722 00:08:12.722 15:03:10 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:12.722 15:03:10 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:12.722 15:03:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:12.722 15:03:10 -- nvmf/common.sh@116 -- # sync 00:08:12.722 15:03:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:12.722 15:03:10 -- nvmf/common.sh@119 -- # set +e 00:08:12.722 15:03:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:12.722 15:03:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:12.722 rmmod nvme_tcp 00:08:12.722 rmmod nvme_fabrics 00:08:12.722 rmmod nvme_keyring 00:08:12.722 15:03:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:12.722 15:03:10 -- nvmf/common.sh@123 -- # set -e 00:08:12.722 15:03:10 -- nvmf/common.sh@124 -- # return 0 00:08:12.722 15:03:10 -- nvmf/common.sh@477 -- # '[' -n 605130 ']' 00:08:12.722 15:03:10 -- nvmf/common.sh@478 -- # killprocess 605130 00:08:12.722 15:03:10 -- common/autotest_common.sh@936 -- # '[' -z 605130 ']' 00:08:12.722 15:03:10 -- common/autotest_common.sh@940 -- # kill -0 605130 00:08:12.722 15:03:10 -- common/autotest_common.sh@941 -- # uname 00:08:12.722 15:03:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:12.722 15:03:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 605130 00:08:12.722 15:03:10 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:12.722 15:03:10 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:12.722 15:03:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 605130' 00:08:12.722 killing process with pid 605130 00:08:12.722 15:03:10 -- common/autotest_common.sh@955 -- # kill 605130 00:08:12.722 15:03:10 -- common/autotest_common.sh@960 -- # wait 605130 00:08:12.722 nvmf threads initialize successfully 00:08:12.722 bdev subsystem init successfully 00:08:12.722 created a nvmf target service 00:08:12.722 create targets's poll groups done 00:08:12.722 all subsystems of target started 00:08:12.722 nvmf target is running 00:08:12.722 all subsystems of target stopped 00:08:12.722 destroy targets's poll groups done 00:08:12.722 destroyed the nvmf target service 00:08:12.722 bdev subsystem finish successfully 00:08:12.722 nvmf threads destroy successfully 00:08:12.722 15:03:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:12.722 15:03:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:12.722 15:03:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:12.722 15:03:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:12.722 15:03:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:12.722 15:03:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:12.722 15:03:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:12.722 15:03:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:13.293 15:03:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:13.293 15:03:13 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:13.293 15:03:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:13.293 15:03:13 -- common/autotest_common.sh@10 -- # set +x 00:08:13.293 00:08:13.293 real 0m15.229s 00:08:13.293 user 0m41.492s 00:08:13.293 sys 0m3.590s 00:08:13.293 15:03:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:13.293 15:03:13 -- common/autotest_common.sh@10 -- # set +x 00:08:13.293 ************************************ 00:08:13.293 END TEST nvmf_example 00:08:13.293 ************************************ 00:08:13.293 15:03:13 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:13.293 15:03:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:13.293 15:03:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:13.293 15:03:13 -- common/autotest_common.sh@10 -- # set +x 00:08:13.293 ************************************ 00:08:13.293 START TEST nvmf_filesystem 00:08:13.293 ************************************ 00:08:13.293 15:03:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:13.293 * Looking for test storage... 00:08:13.293 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.293 15:03:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:13.293 15:03:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:13.293 15:03:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:13.293 15:03:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:13.293 15:03:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:13.293 15:03:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:13.293 15:03:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:13.293 15:03:13 -- scripts/common.sh@335 -- # IFS=.-: 00:08:13.293 15:03:13 -- scripts/common.sh@335 -- # read -ra ver1 00:08:13.293 15:03:13 -- scripts/common.sh@336 -- # IFS=.-: 00:08:13.293 15:03:13 -- scripts/common.sh@336 -- # read -ra ver2 00:08:13.293 15:03:13 -- scripts/common.sh@337 -- # local 'op=<' 00:08:13.293 15:03:13 -- scripts/common.sh@339 -- # ver1_l=2 00:08:13.293 15:03:13 -- scripts/common.sh@340 -- # ver2_l=1 00:08:13.293 15:03:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:13.293 15:03:13 -- scripts/common.sh@343 -- # case "$op" in 00:08:13.293 15:03:13 -- scripts/common.sh@344 -- # : 1 00:08:13.293 15:03:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:13.293 15:03:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:13.293 15:03:13 -- scripts/common.sh@364 -- # decimal 1 00:08:13.293 15:03:13 -- scripts/common.sh@352 -- # local d=1 00:08:13.293 15:03:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:13.293 15:03:13 -- scripts/common.sh@354 -- # echo 1 00:08:13.293 15:03:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:13.293 15:03:13 -- scripts/common.sh@365 -- # decimal 2 00:08:13.293 15:03:13 -- scripts/common.sh@352 -- # local d=2 00:08:13.293 15:03:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:13.293 15:03:13 -- scripts/common.sh@354 -- # echo 2 00:08:13.293 15:03:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:13.293 15:03:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:13.293 15:03:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:13.293 15:03:13 -- scripts/common.sh@367 -- # return 0 00:08:13.293 15:03:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:13.293 15:03:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:13.293 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.293 --rc genhtml_branch_coverage=1 00:08:13.293 --rc genhtml_function_coverage=1 00:08:13.293 --rc genhtml_legend=1 00:08:13.293 --rc geninfo_all_blocks=1 00:08:13.293 --rc geninfo_unexecuted_blocks=1 00:08:13.293 00:08:13.293 ' 00:08:13.294 15:03:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:13.294 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.294 --rc genhtml_branch_coverage=1 00:08:13.294 --rc genhtml_function_coverage=1 00:08:13.294 --rc genhtml_legend=1 00:08:13.294 --rc geninfo_all_blocks=1 00:08:13.294 --rc geninfo_unexecuted_blocks=1 00:08:13.294 00:08:13.294 ' 00:08:13.294 15:03:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:13.294 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.294 --rc genhtml_branch_coverage=1 00:08:13.294 --rc genhtml_function_coverage=1 00:08:13.294 --rc genhtml_legend=1 00:08:13.294 --rc geninfo_all_blocks=1 00:08:13.294 --rc geninfo_unexecuted_blocks=1 00:08:13.294 00:08:13.294 ' 00:08:13.294 15:03:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:13.294 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.294 --rc genhtml_branch_coverage=1 00:08:13.294 --rc genhtml_function_coverage=1 00:08:13.294 --rc genhtml_legend=1 00:08:13.294 --rc geninfo_all_blocks=1 00:08:13.294 --rc geninfo_unexecuted_blocks=1 00:08:13.294 00:08:13.294 ' 00:08:13.294 15:03:13 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:13.294 15:03:13 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:13.294 15:03:13 -- common/autotest_common.sh@34 -- # set -e 00:08:13.294 15:03:13 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:13.294 15:03:13 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:13.294 15:03:13 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:13.294 15:03:13 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:13.294 15:03:13 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:13.294 15:03:13 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:13.294 15:03:13 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:13.294 15:03:13 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:13.294 15:03:13 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:13.294 15:03:13 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:13.294 15:03:13 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:13.294 15:03:13 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:13.294 15:03:13 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:13.294 15:03:13 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:13.294 15:03:13 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:13.294 15:03:13 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:13.294 15:03:13 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:13.294 15:03:13 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:13.294 15:03:13 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:13.294 15:03:13 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:13.294 15:03:13 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:13.294 15:03:13 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:13.294 15:03:13 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:13.294 15:03:13 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:13.294 15:03:13 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:13.294 15:03:13 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:13.294 15:03:13 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:13.294 15:03:13 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:13.294 15:03:13 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:13.294 15:03:13 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:13.294 15:03:13 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:13.294 15:03:13 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:13.294 15:03:13 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:13.294 15:03:13 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:13.294 15:03:13 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:13.294 15:03:13 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:13.294 15:03:13 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:13.294 15:03:13 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:13.294 15:03:13 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:13.294 15:03:13 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:13.294 15:03:13 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:13.294 15:03:13 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:13.294 15:03:13 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:13.294 15:03:13 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:13.294 15:03:13 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:13.294 15:03:13 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:13.294 15:03:13 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:13.294 15:03:13 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:13.294 15:03:13 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:13.294 15:03:13 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:13.294 15:03:13 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:13.294 15:03:13 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:13.294 15:03:13 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:13.294 15:03:13 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:13.294 15:03:13 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:13.294 15:03:13 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:13.294 15:03:13 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:13.294 15:03:13 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:13.294 15:03:13 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:13.294 15:03:13 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:13.294 15:03:13 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:13.294 15:03:13 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:13.294 15:03:13 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:13.294 15:03:13 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:13.294 15:03:13 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.294 15:03:13 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:13.294 15:03:13 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:13.294 15:03:13 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:13.294 15:03:13 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:13.294 15:03:13 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:13.294 15:03:13 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:13.294 15:03:13 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:13.294 15:03:13 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:13.294 15:03:13 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:13.294 15:03:13 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:13.294 15:03:13 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:13.294 15:03:13 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:13.294 15:03:13 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:13.294 15:03:13 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:13.294 15:03:13 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:13.294 15:03:13 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:13.294 15:03:13 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:13.294 15:03:13 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:13.294 15:03:13 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:13.294 15:03:13 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:13.294 15:03:13 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:13.294 15:03:13 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:13.294 15:03:13 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:13.294 15:03:13 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:13.294 15:03:13 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:13.294 15:03:13 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:13.294 15:03:13 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:13.294 15:03:13 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:13.294 15:03:13 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:13.294 15:03:13 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:13.294 15:03:13 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:13.294 15:03:13 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:13.294 15:03:13 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:13.294 15:03:13 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:13.294 #define SPDK_CONFIG_H 00:08:13.294 #define SPDK_CONFIG_APPS 1 00:08:13.294 #define SPDK_CONFIG_ARCH native 00:08:13.294 #undef SPDK_CONFIG_ASAN 00:08:13.294 #undef SPDK_CONFIG_AVAHI 00:08:13.294 #undef SPDK_CONFIG_CET 00:08:13.294 #define SPDK_CONFIG_COVERAGE 1 00:08:13.294 #define SPDK_CONFIG_CROSS_PREFIX 00:08:13.294 #undef SPDK_CONFIG_CRYPTO 00:08:13.294 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:13.294 #undef SPDK_CONFIG_CUSTOMOCF 00:08:13.294 #undef SPDK_CONFIG_DAOS 00:08:13.294 #define SPDK_CONFIG_DAOS_DIR 00:08:13.294 #define SPDK_CONFIG_DEBUG 1 00:08:13.294 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:13.294 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:13.294 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:13.294 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.294 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:13.294 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:13.294 #define SPDK_CONFIG_EXAMPLES 1 00:08:13.294 #undef SPDK_CONFIG_FC 00:08:13.294 #define SPDK_CONFIG_FC_PATH 00:08:13.294 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:13.294 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:13.294 #undef SPDK_CONFIG_FUSE 00:08:13.294 #undef SPDK_CONFIG_FUZZER 00:08:13.294 #define SPDK_CONFIG_FUZZER_LIB 00:08:13.294 #undef SPDK_CONFIG_GOLANG 00:08:13.294 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:13.294 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:13.294 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:13.294 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:13.294 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:13.295 #define SPDK_CONFIG_IDXD 1 00:08:13.295 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:13.295 #undef SPDK_CONFIG_IPSEC_MB 00:08:13.295 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:13.295 #define SPDK_CONFIG_ISAL 1 00:08:13.295 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:13.295 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:13.295 #define SPDK_CONFIG_LIBDIR 00:08:13.295 #undef SPDK_CONFIG_LTO 00:08:13.295 #define SPDK_CONFIG_MAX_LCORES 00:08:13.295 #define SPDK_CONFIG_NVME_CUSE 1 00:08:13.295 #undef SPDK_CONFIG_OCF 00:08:13.295 #define SPDK_CONFIG_OCF_PATH 00:08:13.295 #define SPDK_CONFIG_OPENSSL_PATH 00:08:13.295 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:13.295 #undef SPDK_CONFIG_PGO_USE 00:08:13.295 #define SPDK_CONFIG_PREFIX /usr/local 00:08:13.295 #undef SPDK_CONFIG_RAID5F 00:08:13.295 #undef SPDK_CONFIG_RBD 00:08:13.295 #define SPDK_CONFIG_RDMA 1 00:08:13.295 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:13.295 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:13.295 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:13.295 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:13.295 #define SPDK_CONFIG_SHARED 1 00:08:13.295 #undef SPDK_CONFIG_SMA 00:08:13.295 #define SPDK_CONFIG_TESTS 1 00:08:13.295 #undef SPDK_CONFIG_TSAN 00:08:13.295 #define SPDK_CONFIG_UBLK 1 00:08:13.295 #define SPDK_CONFIG_UBSAN 1 00:08:13.295 #undef SPDK_CONFIG_UNIT_TESTS 00:08:13.295 #undef SPDK_CONFIG_URING 00:08:13.295 #define SPDK_CONFIG_URING_PATH 00:08:13.295 #undef SPDK_CONFIG_URING_ZNS 00:08:13.295 #undef SPDK_CONFIG_USDT 00:08:13.295 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:13.295 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:13.295 #define SPDK_CONFIG_VFIO_USER 1 00:08:13.295 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:13.295 #define SPDK_CONFIG_VHOST 1 00:08:13.295 #define SPDK_CONFIG_VIRTIO 1 00:08:13.295 #undef SPDK_CONFIG_VTUNE 00:08:13.295 #define SPDK_CONFIG_VTUNE_DIR 00:08:13.295 #define SPDK_CONFIG_WERROR 1 00:08:13.295 #define SPDK_CONFIG_WPDK_DIR 00:08:13.295 #undef SPDK_CONFIG_XNVME 00:08:13.295 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:13.295 15:03:13 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:13.295 15:03:13 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:13.295 15:03:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:13.295 15:03:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:13.295 15:03:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:13.295 15:03:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.295 15:03:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.295 15:03:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.295 15:03:13 -- paths/export.sh@5 -- # export PATH 00:08:13.295 15:03:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.295 15:03:13 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:13.295 15:03:13 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:13.295 15:03:13 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:13.295 15:03:13 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:13.295 15:03:13 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:13.295 15:03:13 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:13.295 15:03:13 -- pm/common@16 -- # TEST_TAG=N/A 00:08:13.295 15:03:13 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:13.295 15:03:13 -- common/autotest_common.sh@52 -- # : 1 00:08:13.295 15:03:13 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:13.295 15:03:13 -- common/autotest_common.sh@56 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:13.295 15:03:13 -- common/autotest_common.sh@58 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:13.295 15:03:13 -- common/autotest_common.sh@60 -- # : 1 00:08:13.295 15:03:13 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:13.295 15:03:13 -- common/autotest_common.sh@62 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:13.295 15:03:13 -- common/autotest_common.sh@64 -- # : 00:08:13.295 15:03:13 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:13.295 15:03:13 -- common/autotest_common.sh@66 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:13.295 15:03:13 -- common/autotest_common.sh@68 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:13.295 15:03:13 -- common/autotest_common.sh@70 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:13.295 15:03:13 -- common/autotest_common.sh@72 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:13.295 15:03:13 -- common/autotest_common.sh@74 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:13.295 15:03:13 -- common/autotest_common.sh@76 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:13.295 15:03:13 -- common/autotest_common.sh@78 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:13.295 15:03:13 -- common/autotest_common.sh@80 -- # : 1 00:08:13.295 15:03:13 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:13.295 15:03:13 -- common/autotest_common.sh@82 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:13.295 15:03:13 -- common/autotest_common.sh@84 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:13.295 15:03:13 -- common/autotest_common.sh@86 -- # : 1 00:08:13.295 15:03:13 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:13.295 15:03:13 -- common/autotest_common.sh@88 -- # : 1 00:08:13.295 15:03:13 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:13.295 15:03:13 -- common/autotest_common.sh@90 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:13.295 15:03:13 -- common/autotest_common.sh@92 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:13.295 15:03:13 -- common/autotest_common.sh@94 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:13.295 15:03:13 -- common/autotest_common.sh@96 -- # : tcp 00:08:13.295 15:03:13 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:13.295 15:03:13 -- common/autotest_common.sh@98 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:13.295 15:03:13 -- common/autotest_common.sh@100 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:13.295 15:03:13 -- common/autotest_common.sh@102 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:13.295 15:03:13 -- common/autotest_common.sh@104 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:13.295 15:03:13 -- common/autotest_common.sh@106 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:13.295 15:03:13 -- common/autotest_common.sh@108 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:13.295 15:03:13 -- common/autotest_common.sh@110 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:13.295 15:03:13 -- common/autotest_common.sh@112 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:13.295 15:03:13 -- common/autotest_common.sh@114 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:13.295 15:03:13 -- common/autotest_common.sh@116 -- # : 1 00:08:13.295 15:03:13 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:13.295 15:03:13 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:13.295 15:03:13 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:13.295 15:03:13 -- common/autotest_common.sh@120 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:13.295 15:03:13 -- common/autotest_common.sh@122 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:13.295 15:03:13 -- common/autotest_common.sh@124 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:13.295 15:03:13 -- common/autotest_common.sh@126 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:13.295 15:03:13 -- common/autotest_common.sh@128 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:13.295 15:03:13 -- common/autotest_common.sh@130 -- # : 0 00:08:13.295 15:03:13 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:13.295 15:03:13 -- common/autotest_common.sh@132 -- # : v22.11.4 00:08:13.295 15:03:13 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:13.295 15:03:13 -- common/autotest_common.sh@134 -- # : true 00:08:13.296 15:03:13 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:13.296 15:03:13 -- common/autotest_common.sh@136 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:13.296 15:03:13 -- common/autotest_common.sh@138 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:13.296 15:03:13 -- common/autotest_common.sh@140 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:13.296 15:03:13 -- common/autotest_common.sh@142 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:13.296 15:03:13 -- common/autotest_common.sh@144 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:13.296 15:03:13 -- common/autotest_common.sh@146 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:13.296 15:03:13 -- common/autotest_common.sh@148 -- # : e810 00:08:13.296 15:03:13 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:13.296 15:03:13 -- common/autotest_common.sh@150 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:13.296 15:03:13 -- common/autotest_common.sh@152 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:13.296 15:03:13 -- common/autotest_common.sh@154 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:13.296 15:03:13 -- common/autotest_common.sh@156 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:13.296 15:03:13 -- common/autotest_common.sh@158 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:13.296 15:03:13 -- common/autotest_common.sh@160 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:13.296 15:03:13 -- common/autotest_common.sh@163 -- # : 00:08:13.296 15:03:13 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:13.296 15:03:13 -- common/autotest_common.sh@165 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:13.296 15:03:13 -- common/autotest_common.sh@167 -- # : 0 00:08:13.296 15:03:13 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:13.296 15:03:13 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:13.296 15:03:13 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:13.296 15:03:13 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:13.296 15:03:13 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:13.296 15:03:13 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:13.296 15:03:13 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:13.296 15:03:13 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:13.296 15:03:13 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:13.296 15:03:13 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:13.296 15:03:13 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:13.296 15:03:13 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:13.296 15:03:13 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:13.296 15:03:13 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:13.296 15:03:13 -- common/autotest_common.sh@196 -- # cat 00:08:13.296 15:03:13 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:13.296 15:03:13 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:13.296 15:03:13 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:13.296 15:03:13 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:13.296 15:03:13 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:13.296 15:03:13 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:13.296 15:03:13 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:13.296 15:03:13 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:13.296 15:03:13 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:13.296 15:03:13 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:13.296 15:03:13 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:13.296 15:03:13 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:13.296 15:03:13 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:13.296 15:03:13 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:13.296 15:03:13 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:13.296 15:03:13 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:13.296 15:03:13 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:13.296 15:03:13 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:13.296 15:03:13 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:13.296 15:03:13 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:13.296 15:03:13 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:13.296 15:03:13 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:13.296 15:03:13 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:13.296 15:03:13 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:13.296 15:03:13 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:13.296 15:03:13 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:13.296 15:03:13 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:13.296 15:03:13 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:13.296 15:03:13 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:13.296 15:03:13 -- common/autotest_common.sh@259 -- # valgrind= 00:08:13.296 15:03:13 -- common/autotest_common.sh@265 -- # uname -s 00:08:13.296 15:03:13 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:13.296 15:03:13 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:13.296 15:03:13 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:13.296 15:03:13 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:13.296 15:03:13 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:13.296 15:03:13 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:13.296 15:03:13 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:13.296 15:03:13 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:13.296 15:03:13 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:13.296 15:03:13 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:13.296 15:03:13 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:13.296 15:03:13 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:13.296 15:03:13 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:13.296 15:03:13 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:13.296 15:03:13 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:13.296 15:03:13 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:13.296 15:03:13 -- common/autotest_common.sh@319 -- # [[ -z 607398 ]] 00:08:13.296 15:03:13 -- common/autotest_common.sh@319 -- # kill -0 607398 00:08:13.296 15:03:13 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:13.296 15:03:13 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:13.296 15:03:13 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:13.296 15:03:13 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:13.296 15:03:13 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:13.296 15:03:13 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:13.297 15:03:13 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:13.297 15:03:13 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:13.297 15:03:13 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.UKFDLM 00:08:13.297 15:03:13 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:13.297 15:03:13 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.UKFDLM/tests/target /tmp/spdk.UKFDLM 00:08:13.297 15:03:13 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@328 -- # df -T 00:08:13.297 15:03:13 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=54171639808 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=7816880128 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993002496 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388921344 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=8785920 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993920000 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=339968 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:13.297 15:03:13 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:13.297 15:03:13 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:13.297 15:03:13 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:13.297 15:03:13 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:13.297 * Looking for test storage... 00:08:13.297 15:03:13 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:13.297 15:03:13 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:13.297 15:03:13 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.297 15:03:13 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:13.297 15:03:13 -- common/autotest_common.sh@373 -- # mount=/ 00:08:13.297 15:03:13 -- common/autotest_common.sh@375 -- # target_space=54171639808 00:08:13.297 15:03:13 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:13.297 15:03:13 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:13.297 15:03:13 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@382 -- # new_size=10031472640 00:08:13.297 15:03:13 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:13.297 15:03:13 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.297 15:03:13 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.297 15:03:13 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.297 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:13.297 15:03:13 -- common/autotest_common.sh@390 -- # return 0 00:08:13.297 15:03:13 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:13.297 15:03:13 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:13.297 15:03:13 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:13.297 15:03:13 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:13.297 15:03:13 -- common/autotest_common.sh@1682 -- # true 00:08:13.297 15:03:13 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:13.297 15:03:13 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@27 -- # exec 00:08:13.297 15:03:13 -- common/autotest_common.sh@29 -- # exec 00:08:13.297 15:03:13 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:13.297 15:03:13 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:13.297 15:03:13 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:13.297 15:03:13 -- common/autotest_common.sh@18 -- # set -x 00:08:13.297 15:03:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:13.297 15:03:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:13.297 15:03:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:13.557 15:03:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:13.557 15:03:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:13.557 15:03:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:13.557 15:03:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:13.557 15:03:13 -- scripts/common.sh@335 -- # IFS=.-: 00:08:13.557 15:03:13 -- scripts/common.sh@335 -- # read -ra ver1 00:08:13.557 15:03:13 -- scripts/common.sh@336 -- # IFS=.-: 00:08:13.557 15:03:13 -- scripts/common.sh@336 -- # read -ra ver2 00:08:13.557 15:03:13 -- scripts/common.sh@337 -- # local 'op=<' 00:08:13.557 15:03:13 -- scripts/common.sh@339 -- # ver1_l=2 00:08:13.557 15:03:13 -- scripts/common.sh@340 -- # ver2_l=1 00:08:13.557 15:03:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:13.557 15:03:13 -- scripts/common.sh@343 -- # case "$op" in 00:08:13.557 15:03:13 -- scripts/common.sh@344 -- # : 1 00:08:13.557 15:03:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:13.557 15:03:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:13.557 15:03:13 -- scripts/common.sh@364 -- # decimal 1 00:08:13.557 15:03:13 -- scripts/common.sh@352 -- # local d=1 00:08:13.557 15:03:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:13.557 15:03:13 -- scripts/common.sh@354 -- # echo 1 00:08:13.557 15:03:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:13.557 15:03:13 -- scripts/common.sh@365 -- # decimal 2 00:08:13.557 15:03:13 -- scripts/common.sh@352 -- # local d=2 00:08:13.557 15:03:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:13.557 15:03:13 -- scripts/common.sh@354 -- # echo 2 00:08:13.557 15:03:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:13.557 15:03:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:13.557 15:03:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:13.557 15:03:13 -- scripts/common.sh@367 -- # return 0 00:08:13.557 15:03:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:13.557 15:03:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:13.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.557 --rc genhtml_branch_coverage=1 00:08:13.557 --rc genhtml_function_coverage=1 00:08:13.557 --rc genhtml_legend=1 00:08:13.557 --rc geninfo_all_blocks=1 00:08:13.557 --rc geninfo_unexecuted_blocks=1 00:08:13.557 00:08:13.557 ' 00:08:13.557 15:03:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:13.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.557 --rc genhtml_branch_coverage=1 00:08:13.557 --rc genhtml_function_coverage=1 00:08:13.557 --rc genhtml_legend=1 00:08:13.557 --rc geninfo_all_blocks=1 00:08:13.557 --rc geninfo_unexecuted_blocks=1 00:08:13.557 00:08:13.557 ' 00:08:13.557 15:03:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:13.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.558 --rc genhtml_branch_coverage=1 00:08:13.558 --rc genhtml_function_coverage=1 00:08:13.558 --rc genhtml_legend=1 00:08:13.558 --rc geninfo_all_blocks=1 00:08:13.558 --rc geninfo_unexecuted_blocks=1 00:08:13.558 00:08:13.558 ' 00:08:13.558 15:03:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:13.558 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:13.558 --rc genhtml_branch_coverage=1 00:08:13.558 --rc genhtml_function_coverage=1 00:08:13.558 --rc genhtml_legend=1 00:08:13.558 --rc geninfo_all_blocks=1 00:08:13.558 --rc geninfo_unexecuted_blocks=1 00:08:13.558 00:08:13.558 ' 00:08:13.558 15:03:13 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:13.558 15:03:13 -- nvmf/common.sh@7 -- # uname -s 00:08:13.558 15:03:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:13.558 15:03:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:13.558 15:03:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:13.558 15:03:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:13.558 15:03:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:13.558 15:03:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:13.558 15:03:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:13.558 15:03:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:13.558 15:03:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:13.558 15:03:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:13.558 15:03:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:13.558 15:03:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:13.558 15:03:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:13.558 15:03:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:13.558 15:03:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:13.558 15:03:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:13.558 15:03:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:13.558 15:03:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:13.558 15:03:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:13.558 15:03:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.558 15:03:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.558 15:03:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.558 15:03:13 -- paths/export.sh@5 -- # export PATH 00:08:13.558 15:03:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:13.558 15:03:13 -- nvmf/common.sh@46 -- # : 0 00:08:13.558 15:03:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:13.558 15:03:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:13.558 15:03:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:13.558 15:03:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:13.558 15:03:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:13.558 15:03:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:13.558 15:03:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:13.558 15:03:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:13.558 15:03:13 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:13.558 15:03:13 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:13.558 15:03:13 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:13.558 15:03:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:13.558 15:03:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:13.558 15:03:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:13.558 15:03:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:13.558 15:03:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:13.558 15:03:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:13.558 15:03:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:13.558 15:03:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:13.558 15:03:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:13.558 15:03:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:13.558 15:03:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:13.558 15:03:13 -- common/autotest_common.sh@10 -- # set +x 00:08:15.462 15:03:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:15.462 15:03:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:15.462 15:03:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:15.462 15:03:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:15.462 15:03:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:15.462 15:03:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:15.462 15:03:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:15.462 15:03:15 -- nvmf/common.sh@294 -- # net_devs=() 00:08:15.462 15:03:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:15.462 15:03:15 -- nvmf/common.sh@295 -- # e810=() 00:08:15.462 15:03:15 -- nvmf/common.sh@295 -- # local -ga e810 00:08:15.462 15:03:15 -- nvmf/common.sh@296 -- # x722=() 00:08:15.462 15:03:15 -- nvmf/common.sh@296 -- # local -ga x722 00:08:15.462 15:03:15 -- nvmf/common.sh@297 -- # mlx=() 00:08:15.462 15:03:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:15.462 15:03:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:15.462 15:03:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:15.462 15:03:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:15.462 15:03:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:15.462 15:03:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:15.462 15:03:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:15.462 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:15.462 15:03:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:15.462 15:03:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:15.462 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:15.462 15:03:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:15.462 15:03:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:15.462 15:03:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:15.462 15:03:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:15.462 15:03:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:15.462 15:03:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:15.462 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:15.462 15:03:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:15.462 15:03:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:15.462 15:03:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:15.462 15:03:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:15.462 15:03:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:15.462 15:03:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:15.462 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:15.462 15:03:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:15.462 15:03:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:15.462 15:03:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:15.462 15:03:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:15.462 15:03:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:15.463 15:03:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:15.463 15:03:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:15.463 15:03:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:15.463 15:03:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:15.463 15:03:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:15.463 15:03:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:15.463 15:03:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:15.463 15:03:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:15.463 15:03:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:15.463 15:03:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:15.463 15:03:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:15.463 15:03:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:15.463 15:03:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:15.463 15:03:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:15.721 15:03:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:15.721 15:03:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:15.721 15:03:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:15.721 15:03:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:15.721 15:03:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:15.721 15:03:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:15.721 15:03:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:15.721 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:15.721 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.215 ms 00:08:15.721 00:08:15.721 --- 10.0.0.2 ping statistics --- 00:08:15.721 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:15.721 rtt min/avg/max/mdev = 0.215/0.215/0.215/0.000 ms 00:08:15.721 15:03:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:15.721 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:15.721 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:08:15.721 00:08:15.721 --- 10.0.0.1 ping statistics --- 00:08:15.721 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:15.721 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:08:15.721 15:03:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:15.721 15:03:15 -- nvmf/common.sh@410 -- # return 0 00:08:15.722 15:03:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:15.722 15:03:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:15.722 15:03:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:15.722 15:03:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:15.722 15:03:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:15.722 15:03:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:15.722 15:03:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:15.722 15:03:15 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:15.722 15:03:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:15.722 15:03:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:15.722 15:03:15 -- common/autotest_common.sh@10 -- # set +x 00:08:15.722 ************************************ 00:08:15.722 START TEST nvmf_filesystem_no_in_capsule 00:08:15.722 ************************************ 00:08:15.722 15:03:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:15.722 15:03:15 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:15.722 15:03:15 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:15.722 15:03:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:15.722 15:03:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:15.722 15:03:15 -- common/autotest_common.sh@10 -- # set +x 00:08:15.722 15:03:15 -- nvmf/common.sh@469 -- # nvmfpid=609112 00:08:15.722 15:03:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:15.722 15:03:15 -- nvmf/common.sh@470 -- # waitforlisten 609112 00:08:15.722 15:03:15 -- common/autotest_common.sh@829 -- # '[' -z 609112 ']' 00:08:15.722 15:03:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:15.722 15:03:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:15.722 15:03:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:15.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:15.722 15:03:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:15.722 15:03:15 -- common/autotest_common.sh@10 -- # set +x 00:08:15.722 [2024-11-28 15:03:15.867625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:15.722 [2024-11-28 15:03:15.867696] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:15.722 EAL: No free 2048 kB hugepages reported on node 1 00:08:15.722 [2024-11-28 15:03:15.930679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:15.980 [2024-11-28 15:03:16.018165] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:15.980 [2024-11-28 15:03:16.018332] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:15.980 [2024-11-28 15:03:16.018349] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:15.980 [2024-11-28 15:03:16.018361] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:15.980 [2024-11-28 15:03:16.018430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:15.980 [2024-11-28 15:03:16.018479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:15.980 [2024-11-28 15:03:16.018532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:15.980 [2024-11-28 15:03:16.018535] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:16.913 15:03:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:16.913 15:03:16 -- common/autotest_common.sh@862 -- # return 0 00:08:16.913 15:03:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:16.913 15:03:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:16.913 15:03:16 -- common/autotest_common.sh@10 -- # set +x 00:08:16.913 15:03:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:16.913 15:03:16 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:16.913 15:03:16 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:16.913 15:03:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.913 15:03:16 -- common/autotest_common.sh@10 -- # set +x 00:08:16.913 [2024-11-28 15:03:16.949110] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:16.913 15:03:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.913 15:03:16 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:16.913 15:03:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.913 15:03:16 -- common/autotest_common.sh@10 -- # set +x 00:08:16.913 Malloc1 00:08:16.913 15:03:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.913 15:03:17 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:16.913 15:03:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.913 15:03:17 -- common/autotest_common.sh@10 -- # set +x 00:08:16.913 15:03:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.913 15:03:17 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:16.913 15:03:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.913 15:03:17 -- common/autotest_common.sh@10 -- # set +x 00:08:16.913 15:03:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.913 15:03:17 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:16.913 15:03:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.913 15:03:17 -- common/autotest_common.sh@10 -- # set +x 00:08:16.913 [2024-11-28 15:03:17.135615] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:16.913 15:03:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:16.913 15:03:17 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:16.913 15:03:17 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:16.913 15:03:17 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:16.913 15:03:17 -- common/autotest_common.sh@1369 -- # local bs 00:08:16.913 15:03:17 -- common/autotest_common.sh@1370 -- # local nb 00:08:16.913 15:03:17 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:16.913 15:03:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:16.913 15:03:17 -- common/autotest_common.sh@10 -- # set +x 00:08:17.171 15:03:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:17.171 15:03:17 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:17.171 { 00:08:17.171 "name": "Malloc1", 00:08:17.171 "aliases": [ 00:08:17.171 "75be292a-bcf0-46df-aab0-565a155a4eca" 00:08:17.171 ], 00:08:17.171 "product_name": "Malloc disk", 00:08:17.171 "block_size": 512, 00:08:17.171 "num_blocks": 1048576, 00:08:17.171 "uuid": "75be292a-bcf0-46df-aab0-565a155a4eca", 00:08:17.171 "assigned_rate_limits": { 00:08:17.171 "rw_ios_per_sec": 0, 00:08:17.171 "rw_mbytes_per_sec": 0, 00:08:17.171 "r_mbytes_per_sec": 0, 00:08:17.171 "w_mbytes_per_sec": 0 00:08:17.171 }, 00:08:17.171 "claimed": true, 00:08:17.171 "claim_type": "exclusive_write", 00:08:17.171 "zoned": false, 00:08:17.171 "supported_io_types": { 00:08:17.171 "read": true, 00:08:17.171 "write": true, 00:08:17.171 "unmap": true, 00:08:17.171 "write_zeroes": true, 00:08:17.171 "flush": true, 00:08:17.171 "reset": true, 00:08:17.171 "compare": false, 00:08:17.171 "compare_and_write": false, 00:08:17.171 "abort": true, 00:08:17.171 "nvme_admin": false, 00:08:17.171 "nvme_io": false 00:08:17.171 }, 00:08:17.171 "memory_domains": [ 00:08:17.171 { 00:08:17.171 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:17.171 "dma_device_type": 2 00:08:17.171 } 00:08:17.171 ], 00:08:17.171 "driver_specific": {} 00:08:17.171 } 00:08:17.171 ]' 00:08:17.171 15:03:17 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:17.171 15:03:17 -- common/autotest_common.sh@1372 -- # bs=512 00:08:17.171 15:03:17 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:17.171 15:03:17 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:17.171 15:03:17 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:17.171 15:03:17 -- common/autotest_common.sh@1377 -- # echo 512 00:08:17.171 15:03:17 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:17.171 15:03:17 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:17.736 15:03:17 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:17.736 15:03:17 -- common/autotest_common.sh@1187 -- # local i=0 00:08:17.736 15:03:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:17.736 15:03:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:17.736 15:03:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:20.264 15:03:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:20.264 15:03:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:20.265 15:03:19 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:20.265 15:03:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:20.265 15:03:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:20.265 15:03:19 -- common/autotest_common.sh@1197 -- # return 0 00:08:20.265 15:03:19 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:20.265 15:03:19 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:20.265 15:03:19 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:20.265 15:03:19 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:20.265 15:03:19 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:20.265 15:03:19 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:20.265 15:03:19 -- setup/common.sh@80 -- # echo 536870912 00:08:20.265 15:03:19 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:20.265 15:03:19 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:20.265 15:03:19 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:20.265 15:03:19 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:20.265 15:03:20 -- target/filesystem.sh@69 -- # partprobe 00:08:20.523 15:03:20 -- target/filesystem.sh@70 -- # sleep 1 00:08:21.896 15:03:21 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:21.896 15:03:21 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:21.896 15:03:21 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:21.896 15:03:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:21.896 15:03:21 -- common/autotest_common.sh@10 -- # set +x 00:08:21.896 ************************************ 00:08:21.896 START TEST filesystem_ext4 00:08:21.896 ************************************ 00:08:21.896 15:03:21 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:21.896 15:03:21 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:21.896 15:03:21 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:21.896 15:03:21 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:21.896 15:03:21 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:21.896 15:03:21 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:21.896 15:03:21 -- common/autotest_common.sh@914 -- # local i=0 00:08:21.896 15:03:21 -- common/autotest_common.sh@915 -- # local force 00:08:21.896 15:03:21 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:21.896 15:03:21 -- common/autotest_common.sh@918 -- # force=-F 00:08:21.896 15:03:21 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:21.896 mke2fs 1.47.0 (5-Feb-2023) 00:08:21.896 Discarding device blocks: 0/522240 done 00:08:21.896 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:21.896 Filesystem UUID: ba78412d-7f87-4049-a4a4-f2a07bf3a03e 00:08:21.896 Superblock backups stored on blocks: 00:08:21.896 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:21.896 00:08:21.896 Allocating group tables: 0/64 done 00:08:21.896 Writing inode tables: 0/64 done 00:08:22.462 Creating journal (8192 blocks): done 00:08:22.462 Writing superblocks and filesystem accounting information: 0/64 done 00:08:22.462 00:08:22.462 15:03:22 -- common/autotest_common.sh@931 -- # return 0 00:08:22.462 15:03:22 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.019 15:03:27 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.019 15:03:28 -- target/filesystem.sh@25 -- # sync 00:08:29.019 15:03:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.019 15:03:28 -- target/filesystem.sh@27 -- # sync 00:08:29.019 15:03:28 -- target/filesystem.sh@29 -- # i=0 00:08:29.019 15:03:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.019 15:03:28 -- target/filesystem.sh@37 -- # kill -0 609112 00:08:29.019 15:03:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.019 15:03:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.019 15:03:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.019 15:03:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.019 00:08:29.019 real 0m6.344s 00:08:29.019 user 0m0.017s 00:08:29.019 sys 0m0.068s 00:08:29.019 15:03:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:29.019 15:03:28 -- common/autotest_common.sh@10 -- # set +x 00:08:29.019 ************************************ 00:08:29.019 END TEST filesystem_ext4 00:08:29.019 ************************************ 00:08:29.019 15:03:28 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:29.019 15:03:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:29.019 15:03:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:29.019 15:03:28 -- common/autotest_common.sh@10 -- # set +x 00:08:29.019 ************************************ 00:08:29.019 START TEST filesystem_btrfs 00:08:29.019 ************************************ 00:08:29.019 15:03:28 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:29.019 15:03:28 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:29.019 15:03:28 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:29.019 15:03:28 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:29.019 15:03:28 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:29.019 15:03:28 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:29.019 15:03:28 -- common/autotest_common.sh@914 -- # local i=0 00:08:29.019 15:03:28 -- common/autotest_common.sh@915 -- # local force 00:08:29.019 15:03:28 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:29.019 15:03:28 -- common/autotest_common.sh@920 -- # force=-f 00:08:29.019 15:03:28 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:29.019 btrfs-progs v6.8.1 00:08:29.019 See https://btrfs.readthedocs.io for more information. 00:08:29.019 00:08:29.019 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:29.019 NOTE: several default settings have changed in version 5.15, please make sure 00:08:29.019 this does not affect your deployments: 00:08:29.019 - DUP for metadata (-m dup) 00:08:29.019 - enabled no-holes (-O no-holes) 00:08:29.019 - enabled free-space-tree (-R free-space-tree) 00:08:29.019 00:08:29.019 Label: (null) 00:08:29.019 UUID: 3cc09565-cf31-4b86-8198-7614c6bd1052 00:08:29.019 Node size: 16384 00:08:29.019 Sector size: 4096 (CPU page size: 4096) 00:08:29.019 Filesystem size: 510.00MiB 00:08:29.019 Block group profiles: 00:08:29.019 Data: single 8.00MiB 00:08:29.019 Metadata: DUP 32.00MiB 00:08:29.019 System: DUP 8.00MiB 00:08:29.019 SSD detected: yes 00:08:29.019 Zoned device: no 00:08:29.019 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:29.019 Checksum: crc32c 00:08:29.019 Number of devices: 1 00:08:29.019 Devices: 00:08:29.019 ID SIZE PATH 00:08:29.019 1 510.00MiB /dev/nvme0n1p1 00:08:29.019 00:08:29.019 15:03:28 -- common/autotest_common.sh@931 -- # return 0 00:08:29.019 15:03:28 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:29.277 15:03:29 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:29.277 15:03:29 -- target/filesystem.sh@25 -- # sync 00:08:29.277 15:03:29 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:29.277 15:03:29 -- target/filesystem.sh@27 -- # sync 00:08:29.277 15:03:29 -- target/filesystem.sh@29 -- # i=0 00:08:29.277 15:03:29 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:29.277 15:03:29 -- target/filesystem.sh@37 -- # kill -0 609112 00:08:29.277 15:03:29 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:29.277 15:03:29 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:29.277 15:03:29 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:29.277 15:03:29 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:29.277 00:08:29.277 real 0m1.313s 00:08:29.277 user 0m0.015s 00:08:29.277 sys 0m0.101s 00:08:29.277 15:03:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:29.277 15:03:29 -- common/autotest_common.sh@10 -- # set +x 00:08:29.277 ************************************ 00:08:29.277 END TEST filesystem_btrfs 00:08:29.277 ************************************ 00:08:29.277 15:03:29 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:29.277 15:03:29 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:29.277 15:03:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:29.277 15:03:29 -- common/autotest_common.sh@10 -- # set +x 00:08:29.277 ************************************ 00:08:29.277 START TEST filesystem_xfs 00:08:29.277 ************************************ 00:08:29.277 15:03:29 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:29.277 15:03:29 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:29.277 15:03:29 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:29.277 15:03:29 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:29.277 15:03:29 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:29.277 15:03:29 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:29.277 15:03:29 -- common/autotest_common.sh@914 -- # local i=0 00:08:29.277 15:03:29 -- common/autotest_common.sh@915 -- # local force 00:08:29.277 15:03:29 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:29.277 15:03:29 -- common/autotest_common.sh@920 -- # force=-f 00:08:29.277 15:03:29 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:29.536 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:29.536 = sectsz=512 attr=2, projid32bit=1 00:08:29.536 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:29.536 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:29.536 data = bsize=4096 blocks=130560, imaxpct=25 00:08:29.536 = sunit=0 swidth=0 blks 00:08:29.536 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:29.536 log =internal log bsize=4096 blocks=16384, version=2 00:08:29.536 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:29.536 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:30.910 Discarding blocks...Done. 00:08:30.910 15:03:30 -- common/autotest_common.sh@931 -- # return 0 00:08:30.910 15:03:30 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:33.464 15:03:33 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:33.464 15:03:33 -- target/filesystem.sh@25 -- # sync 00:08:33.464 15:03:33 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:33.464 15:03:33 -- target/filesystem.sh@27 -- # sync 00:08:33.464 15:03:33 -- target/filesystem.sh@29 -- # i=0 00:08:33.464 15:03:33 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:33.464 15:03:33 -- target/filesystem.sh@37 -- # kill -0 609112 00:08:33.464 15:03:33 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:33.464 15:03:33 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:33.464 15:03:33 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:33.464 15:03:33 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:33.464 00:08:33.464 real 0m3.894s 00:08:33.464 user 0m0.020s 00:08:33.464 sys 0m0.061s 00:08:33.464 15:03:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:33.464 15:03:33 -- common/autotest_common.sh@10 -- # set +x 00:08:33.464 ************************************ 00:08:33.464 END TEST filesystem_xfs 00:08:33.464 ************************************ 00:08:33.464 15:03:33 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:33.464 15:03:33 -- target/filesystem.sh@93 -- # sync 00:08:33.464 15:03:33 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:33.464 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.464 15:03:33 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:33.464 15:03:33 -- common/autotest_common.sh@1208 -- # local i=0 00:08:33.464 15:03:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:33.464 15:03:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:33.464 15:03:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:33.464 15:03:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:33.464 15:03:33 -- common/autotest_common.sh@1220 -- # return 0 00:08:33.464 15:03:33 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:33.464 15:03:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:33.464 15:03:33 -- common/autotest_common.sh@10 -- # set +x 00:08:33.464 15:03:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:33.464 15:03:33 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:33.464 15:03:33 -- target/filesystem.sh@101 -- # killprocess 609112 00:08:33.464 15:03:33 -- common/autotest_common.sh@936 -- # '[' -z 609112 ']' 00:08:33.464 15:03:33 -- common/autotest_common.sh@940 -- # kill -0 609112 00:08:33.464 15:03:33 -- common/autotest_common.sh@941 -- # uname 00:08:33.464 15:03:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:33.464 15:03:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 609112 00:08:33.464 15:03:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:33.464 15:03:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:33.464 15:03:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 609112' 00:08:33.464 killing process with pid 609112 00:08:33.464 15:03:33 -- common/autotest_common.sh@955 -- # kill 609112 00:08:33.464 15:03:33 -- common/autotest_common.sh@960 -- # wait 609112 00:08:34.031 15:03:34 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:34.031 00:08:34.031 real 0m18.195s 00:08:34.031 user 1m10.644s 00:08:34.031 sys 0m2.232s 00:08:34.031 15:03:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:34.031 15:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:34.031 ************************************ 00:08:34.031 END TEST nvmf_filesystem_no_in_capsule 00:08:34.031 ************************************ 00:08:34.031 15:03:34 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:34.031 15:03:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:34.031 15:03:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.031 15:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:34.031 ************************************ 00:08:34.031 START TEST nvmf_filesystem_in_capsule 00:08:34.031 ************************************ 00:08:34.031 15:03:34 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:34.031 15:03:34 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:34.031 15:03:34 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:34.031 15:03:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:34.031 15:03:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:34.031 15:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:34.031 15:03:34 -- nvmf/common.sh@469 -- # nvmfpid=611539 00:08:34.031 15:03:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:34.032 15:03:34 -- nvmf/common.sh@470 -- # waitforlisten 611539 00:08:34.032 15:03:34 -- common/autotest_common.sh@829 -- # '[' -z 611539 ']' 00:08:34.032 15:03:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:34.032 15:03:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:34.032 15:03:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:34.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:34.032 15:03:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:34.032 15:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:34.032 [2024-11-28 15:03:34.096249] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:34.032 [2024-11-28 15:03:34.096331] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:34.032 EAL: No free 2048 kB hugepages reported on node 1 00:08:34.032 [2024-11-28 15:03:34.162622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:34.032 [2024-11-28 15:03:34.250160] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:34.032 [2024-11-28 15:03:34.250322] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:34.032 [2024-11-28 15:03:34.250342] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:34.032 [2024-11-28 15:03:34.250356] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:34.032 [2024-11-28 15:03:34.250439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:34.032 [2024-11-28 15:03:34.250495] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:34.032 [2024-11-28 15:03:34.250613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:34.032 [2024-11-28 15:03:34.250616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:34.994 15:03:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:34.994 15:03:35 -- common/autotest_common.sh@862 -- # return 0 00:08:34.994 15:03:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:34.994 15:03:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:34.994 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:34.994 15:03:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:34.994 15:03:35 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:34.994 15:03:35 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:34.994 15:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.994 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:34.994 [2024-11-28 15:03:35.106901] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:34.994 15:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:34.994 15:03:35 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:34.994 15:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:34.994 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:35.303 Malloc1 00:08:35.303 15:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.303 15:03:35 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:35.303 15:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.303 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:35.303 15:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.303 15:03:35 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:35.303 15:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.303 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:35.303 15:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.303 15:03:35 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:35.303 15:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.303 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:35.303 [2024-11-28 15:03:35.289544] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:35.303 15:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.303 15:03:35 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:35.303 15:03:35 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:35.303 15:03:35 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:35.303 15:03:35 -- common/autotest_common.sh@1369 -- # local bs 00:08:35.303 15:03:35 -- common/autotest_common.sh@1370 -- # local nb 00:08:35.303 15:03:35 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:35.303 15:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:35.303 15:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:35.303 15:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:35.303 15:03:35 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:35.303 { 00:08:35.303 "name": "Malloc1", 00:08:35.303 "aliases": [ 00:08:35.303 "53f36e68-11c9-4f7c-bb22-8fc5534fe63f" 00:08:35.303 ], 00:08:35.303 "product_name": "Malloc disk", 00:08:35.303 "block_size": 512, 00:08:35.303 "num_blocks": 1048576, 00:08:35.303 "uuid": "53f36e68-11c9-4f7c-bb22-8fc5534fe63f", 00:08:35.303 "assigned_rate_limits": { 00:08:35.303 "rw_ios_per_sec": 0, 00:08:35.303 "rw_mbytes_per_sec": 0, 00:08:35.303 "r_mbytes_per_sec": 0, 00:08:35.303 "w_mbytes_per_sec": 0 00:08:35.303 }, 00:08:35.303 "claimed": true, 00:08:35.303 "claim_type": "exclusive_write", 00:08:35.303 "zoned": false, 00:08:35.303 "supported_io_types": { 00:08:35.303 "read": true, 00:08:35.303 "write": true, 00:08:35.303 "unmap": true, 00:08:35.303 "write_zeroes": true, 00:08:35.303 "flush": true, 00:08:35.303 "reset": true, 00:08:35.303 "compare": false, 00:08:35.303 "compare_and_write": false, 00:08:35.303 "abort": true, 00:08:35.303 "nvme_admin": false, 00:08:35.303 "nvme_io": false 00:08:35.303 }, 00:08:35.303 "memory_domains": [ 00:08:35.303 { 00:08:35.303 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:35.303 "dma_device_type": 2 00:08:35.303 } 00:08:35.303 ], 00:08:35.303 "driver_specific": {} 00:08:35.303 } 00:08:35.303 ]' 00:08:35.303 15:03:35 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:35.303 15:03:35 -- common/autotest_common.sh@1372 -- # bs=512 00:08:35.303 15:03:35 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:35.303 15:03:35 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:35.303 15:03:35 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:35.303 15:03:35 -- common/autotest_common.sh@1377 -- # echo 512 00:08:35.303 15:03:35 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:35.303 15:03:35 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:35.894 15:03:35 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:35.894 15:03:35 -- common/autotest_common.sh@1187 -- # local i=0 00:08:35.894 15:03:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:35.894 15:03:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:35.894 15:03:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:37.792 15:03:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:37.792 15:03:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:37.792 15:03:37 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:37.792 15:03:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:37.792 15:03:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:37.792 15:03:38 -- common/autotest_common.sh@1197 -- # return 0 00:08:37.792 15:03:38 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:37.792 15:03:38 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:37.792 15:03:38 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:37.792 15:03:38 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:37.792 15:03:38 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:37.792 15:03:38 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:37.792 15:03:38 -- setup/common.sh@80 -- # echo 536870912 00:08:37.792 15:03:38 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:37.792 15:03:38 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:37.792 15:03:38 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:37.792 15:03:38 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:38.356 15:03:38 -- target/filesystem.sh@69 -- # partprobe 00:08:38.921 15:03:39 -- target/filesystem.sh@70 -- # sleep 1 00:08:40.294 15:03:40 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:40.294 15:03:40 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:40.294 15:03:40 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.294 15:03:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.294 15:03:40 -- common/autotest_common.sh@10 -- # set +x 00:08:40.294 ************************************ 00:08:40.294 START TEST filesystem_in_capsule_ext4 00:08:40.294 ************************************ 00:08:40.294 15:03:40 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:40.294 15:03:40 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:40.294 15:03:40 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.294 15:03:40 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:40.294 15:03:40 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:40.294 15:03:40 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.294 15:03:40 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.294 15:03:40 -- common/autotest_common.sh@915 -- # local force 00:08:40.294 15:03:40 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:40.294 15:03:40 -- common/autotest_common.sh@918 -- # force=-F 00:08:40.294 15:03:40 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:40.294 mke2fs 1.47.0 (5-Feb-2023) 00:08:40.294 Discarding device blocks: 0/522240 done 00:08:40.294 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:40.294 Filesystem UUID: 4d0e83b5-bcb1-4669-aa2d-5f990250a38d 00:08:40.294 Superblock backups stored on blocks: 00:08:40.294 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:40.294 00:08:40.294 Allocating group tables: 0/64 done 00:08:40.294 Writing inode tables: 0/64 done 00:08:40.294 Creating journal (8192 blocks): done 00:08:40.294 Writing superblocks and filesystem accounting information: 0/64 done 00:08:40.294 00:08:40.294 15:03:40 -- common/autotest_common.sh@931 -- # return 0 00:08:40.294 15:03:40 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:45.552 15:03:45 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:45.552 15:03:45 -- target/filesystem.sh@25 -- # sync 00:08:45.552 15:03:45 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:45.552 15:03:45 -- target/filesystem.sh@27 -- # sync 00:08:45.552 15:03:45 -- target/filesystem.sh@29 -- # i=0 00:08:45.552 15:03:45 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:45.809 15:03:45 -- target/filesystem.sh@37 -- # kill -0 611539 00:08:45.809 15:03:45 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:45.809 15:03:45 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:45.809 15:03:45 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:45.809 15:03:45 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:45.809 00:08:45.809 real 0m5.725s 00:08:45.809 user 0m0.024s 00:08:45.809 sys 0m0.059s 00:08:45.809 15:03:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:45.809 15:03:45 -- common/autotest_common.sh@10 -- # set +x 00:08:45.809 ************************************ 00:08:45.809 END TEST filesystem_in_capsule_ext4 00:08:45.809 ************************************ 00:08:45.809 15:03:45 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:45.809 15:03:45 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:45.809 15:03:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:45.809 15:03:45 -- common/autotest_common.sh@10 -- # set +x 00:08:45.809 ************************************ 00:08:45.809 START TEST filesystem_in_capsule_btrfs 00:08:45.809 ************************************ 00:08:45.809 15:03:45 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:45.809 15:03:45 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:45.809 15:03:45 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:45.809 15:03:45 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:45.809 15:03:45 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:45.809 15:03:45 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:45.809 15:03:45 -- common/autotest_common.sh@914 -- # local i=0 00:08:45.809 15:03:45 -- common/autotest_common.sh@915 -- # local force 00:08:45.809 15:03:45 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:45.809 15:03:45 -- common/autotest_common.sh@920 -- # force=-f 00:08:45.809 15:03:45 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:45.809 btrfs-progs v6.8.1 00:08:45.809 See https://btrfs.readthedocs.io for more information. 00:08:45.809 00:08:45.809 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:45.809 NOTE: several default settings have changed in version 5.15, please make sure 00:08:45.809 this does not affect your deployments: 00:08:45.809 - DUP for metadata (-m dup) 00:08:45.809 - enabled no-holes (-O no-holes) 00:08:45.809 - enabled free-space-tree (-R free-space-tree) 00:08:45.809 00:08:45.809 Label: (null) 00:08:45.809 UUID: 817d711a-ccf9-4e20-a1c1-b784354fc3e9 00:08:45.809 Node size: 16384 00:08:45.809 Sector size: 4096 (CPU page size: 4096) 00:08:45.809 Filesystem size: 510.00MiB 00:08:45.809 Block group profiles: 00:08:45.809 Data: single 8.00MiB 00:08:45.809 Metadata: DUP 32.00MiB 00:08:45.809 System: DUP 8.00MiB 00:08:45.809 SSD detected: yes 00:08:45.809 Zoned device: no 00:08:45.809 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:45.809 Checksum: crc32c 00:08:45.809 Number of devices: 1 00:08:45.809 Devices: 00:08:45.809 ID SIZE PATH 00:08:45.809 1 510.00MiB /dev/nvme0n1p1 00:08:45.809 00:08:45.809 15:03:46 -- common/autotest_common.sh@931 -- # return 0 00:08:45.809 15:03:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:46.373 15:03:46 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:46.373 15:03:46 -- target/filesystem.sh@25 -- # sync 00:08:46.373 15:03:46 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:46.630 15:03:46 -- target/filesystem.sh@27 -- # sync 00:08:46.630 15:03:46 -- target/filesystem.sh@29 -- # i=0 00:08:46.630 15:03:46 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:46.630 15:03:46 -- target/filesystem.sh@37 -- # kill -0 611539 00:08:46.630 15:03:46 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:46.630 15:03:46 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:46.630 15:03:46 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:46.630 15:03:46 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:46.630 00:08:46.630 real 0m0.809s 00:08:46.631 user 0m0.022s 00:08:46.631 sys 0m0.088s 00:08:46.631 15:03:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:46.631 15:03:46 -- common/autotest_common.sh@10 -- # set +x 00:08:46.631 ************************************ 00:08:46.631 END TEST filesystem_in_capsule_btrfs 00:08:46.631 ************************************ 00:08:46.631 15:03:46 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:46.631 15:03:46 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:46.631 15:03:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:46.631 15:03:46 -- common/autotest_common.sh@10 -- # set +x 00:08:46.631 ************************************ 00:08:46.631 START TEST filesystem_in_capsule_xfs 00:08:46.631 ************************************ 00:08:46.631 15:03:46 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:46.631 15:03:46 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:46.631 15:03:46 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:46.631 15:03:46 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:46.631 15:03:46 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:46.631 15:03:46 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:46.631 15:03:46 -- common/autotest_common.sh@914 -- # local i=0 00:08:46.631 15:03:46 -- common/autotest_common.sh@915 -- # local force 00:08:46.631 15:03:46 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:46.631 15:03:46 -- common/autotest_common.sh@920 -- # force=-f 00:08:46.631 15:03:46 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:46.631 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:46.631 = sectsz=512 attr=2, projid32bit=1 00:08:46.631 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:46.631 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:46.631 data = bsize=4096 blocks=130560, imaxpct=25 00:08:46.631 = sunit=0 swidth=0 blks 00:08:46.631 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:46.631 log =internal log bsize=4096 blocks=16384, version=2 00:08:46.631 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:46.631 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:48.002 Discarding blocks...Done. 00:08:48.002 15:03:47 -- common/autotest_common.sh@931 -- # return 0 00:08:48.002 15:03:47 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:50.530 15:03:50 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:50.530 15:03:50 -- target/filesystem.sh@25 -- # sync 00:08:50.530 15:03:50 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:50.530 15:03:50 -- target/filesystem.sh@27 -- # sync 00:08:50.530 15:03:50 -- target/filesystem.sh@29 -- # i=0 00:08:50.530 15:03:50 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:50.530 15:03:50 -- target/filesystem.sh@37 -- # kill -0 611539 00:08:50.530 15:03:50 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:50.530 15:03:50 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:50.530 15:03:50 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:50.530 15:03:50 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:50.530 00:08:50.530 real 0m3.543s 00:08:50.530 user 0m0.018s 00:08:50.530 sys 0m0.064s 00:08:50.530 15:03:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:50.530 15:03:50 -- common/autotest_common.sh@10 -- # set +x 00:08:50.530 ************************************ 00:08:50.530 END TEST filesystem_in_capsule_xfs 00:08:50.530 ************************************ 00:08:50.530 15:03:50 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:50.530 15:03:50 -- target/filesystem.sh@93 -- # sync 00:08:50.530 15:03:50 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:50.530 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:50.530 15:03:50 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:50.530 15:03:50 -- common/autotest_common.sh@1208 -- # local i=0 00:08:50.530 15:03:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:50.530 15:03:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:50.530 15:03:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:50.530 15:03:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:50.530 15:03:50 -- common/autotest_common.sh@1220 -- # return 0 00:08:50.530 15:03:50 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:50.530 15:03:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:50.530 15:03:50 -- common/autotest_common.sh@10 -- # set +x 00:08:50.531 15:03:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:50.531 15:03:50 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:50.531 15:03:50 -- target/filesystem.sh@101 -- # killprocess 611539 00:08:50.531 15:03:50 -- common/autotest_common.sh@936 -- # '[' -z 611539 ']' 00:08:50.531 15:03:50 -- common/autotest_common.sh@940 -- # kill -0 611539 00:08:50.531 15:03:50 -- common/autotest_common.sh@941 -- # uname 00:08:50.531 15:03:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:50.531 15:03:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 611539 00:08:50.531 15:03:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:50.531 15:03:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:50.531 15:03:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 611539' 00:08:50.531 killing process with pid 611539 00:08:50.531 15:03:50 -- common/autotest_common.sh@955 -- # kill 611539 00:08:50.531 15:03:50 -- common/autotest_common.sh@960 -- # wait 611539 00:08:51.099 15:03:51 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:51.099 00:08:51.099 real 0m17.071s 00:08:51.099 user 1m6.181s 00:08:51.099 sys 0m2.147s 00:08:51.099 15:03:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:51.099 15:03:51 -- common/autotest_common.sh@10 -- # set +x 00:08:51.099 ************************************ 00:08:51.099 END TEST nvmf_filesystem_in_capsule 00:08:51.099 ************************************ 00:08:51.099 15:03:51 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:51.099 15:03:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:51.099 15:03:51 -- nvmf/common.sh@116 -- # sync 00:08:51.099 15:03:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:51.099 15:03:51 -- nvmf/common.sh@119 -- # set +e 00:08:51.099 15:03:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:51.099 15:03:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:51.099 rmmod nvme_tcp 00:08:51.099 rmmod nvme_fabrics 00:08:51.099 rmmod nvme_keyring 00:08:51.099 15:03:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:51.099 15:03:51 -- nvmf/common.sh@123 -- # set -e 00:08:51.099 15:03:51 -- nvmf/common.sh@124 -- # return 0 00:08:51.099 15:03:51 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:51.099 15:03:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:51.099 15:03:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:51.099 15:03:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:51.099 15:03:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:51.099 15:03:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:51.099 15:03:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.099 15:03:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.099 15:03:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:53.632 15:03:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:53.632 00:08:53.632 real 0m39.962s 00:08:53.632 user 2m17.869s 00:08:53.632 sys 0m6.046s 00:08:53.632 15:03:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:53.632 15:03:53 -- common/autotest_common.sh@10 -- # set +x 00:08:53.632 ************************************ 00:08:53.632 END TEST nvmf_filesystem 00:08:53.632 ************************************ 00:08:53.632 15:03:53 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:53.632 15:03:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:53.633 15:03:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:53.633 15:03:53 -- common/autotest_common.sh@10 -- # set +x 00:08:53.633 ************************************ 00:08:53.633 START TEST nvmf_discovery 00:08:53.633 ************************************ 00:08:53.633 15:03:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:53.633 * Looking for test storage... 00:08:53.633 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:53.633 15:03:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:53.633 15:03:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:53.633 15:03:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:53.633 15:03:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:53.633 15:03:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:53.633 15:03:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:53.633 15:03:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:53.633 15:03:53 -- scripts/common.sh@335 -- # IFS=.-: 00:08:53.633 15:03:53 -- scripts/common.sh@335 -- # read -ra ver1 00:08:53.633 15:03:53 -- scripts/common.sh@336 -- # IFS=.-: 00:08:53.633 15:03:53 -- scripts/common.sh@336 -- # read -ra ver2 00:08:53.633 15:03:53 -- scripts/common.sh@337 -- # local 'op=<' 00:08:53.633 15:03:53 -- scripts/common.sh@339 -- # ver1_l=2 00:08:53.633 15:03:53 -- scripts/common.sh@340 -- # ver2_l=1 00:08:53.633 15:03:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:53.633 15:03:53 -- scripts/common.sh@343 -- # case "$op" in 00:08:53.633 15:03:53 -- scripts/common.sh@344 -- # : 1 00:08:53.633 15:03:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:53.633 15:03:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:53.633 15:03:53 -- scripts/common.sh@364 -- # decimal 1 00:08:53.633 15:03:53 -- scripts/common.sh@352 -- # local d=1 00:08:53.633 15:03:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:53.633 15:03:53 -- scripts/common.sh@354 -- # echo 1 00:08:53.633 15:03:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:53.633 15:03:53 -- scripts/common.sh@365 -- # decimal 2 00:08:53.633 15:03:53 -- scripts/common.sh@352 -- # local d=2 00:08:53.633 15:03:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:53.633 15:03:53 -- scripts/common.sh@354 -- # echo 2 00:08:53.633 15:03:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:53.633 15:03:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:53.633 15:03:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:53.633 15:03:53 -- scripts/common.sh@367 -- # return 0 00:08:53.633 15:03:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:53.633 15:03:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:53.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.633 --rc genhtml_branch_coverage=1 00:08:53.633 --rc genhtml_function_coverage=1 00:08:53.633 --rc genhtml_legend=1 00:08:53.633 --rc geninfo_all_blocks=1 00:08:53.633 --rc geninfo_unexecuted_blocks=1 00:08:53.633 00:08:53.633 ' 00:08:53.633 15:03:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:53.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.633 --rc genhtml_branch_coverage=1 00:08:53.633 --rc genhtml_function_coverage=1 00:08:53.633 --rc genhtml_legend=1 00:08:53.633 --rc geninfo_all_blocks=1 00:08:53.633 --rc geninfo_unexecuted_blocks=1 00:08:53.633 00:08:53.633 ' 00:08:53.633 15:03:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:53.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.633 --rc genhtml_branch_coverage=1 00:08:53.633 --rc genhtml_function_coverage=1 00:08:53.633 --rc genhtml_legend=1 00:08:53.633 --rc geninfo_all_blocks=1 00:08:53.633 --rc geninfo_unexecuted_blocks=1 00:08:53.633 00:08:53.633 ' 00:08:53.633 15:03:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:53.633 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:53.633 --rc genhtml_branch_coverage=1 00:08:53.633 --rc genhtml_function_coverage=1 00:08:53.633 --rc genhtml_legend=1 00:08:53.633 --rc geninfo_all_blocks=1 00:08:53.633 --rc geninfo_unexecuted_blocks=1 00:08:53.633 00:08:53.633 ' 00:08:53.633 15:03:53 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:53.633 15:03:53 -- nvmf/common.sh@7 -- # uname -s 00:08:53.633 15:03:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:53.633 15:03:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:53.633 15:03:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:53.633 15:03:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:53.633 15:03:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:53.633 15:03:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:53.633 15:03:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:53.633 15:03:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:53.633 15:03:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:53.633 15:03:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:53.633 15:03:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:53.633 15:03:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:53.633 15:03:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:53.633 15:03:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:53.633 15:03:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:53.633 15:03:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:53.633 15:03:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:53.633 15:03:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:53.633 15:03:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:53.633 15:03:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.633 15:03:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.633 15:03:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.633 15:03:53 -- paths/export.sh@5 -- # export PATH 00:08:53.633 15:03:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:53.633 15:03:53 -- nvmf/common.sh@46 -- # : 0 00:08:53.633 15:03:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:53.633 15:03:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:53.633 15:03:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:53.633 15:03:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:53.633 15:03:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:53.633 15:03:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:53.633 15:03:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:53.633 15:03:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:53.633 15:03:53 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:53.633 15:03:53 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:53.633 15:03:53 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:53.633 15:03:53 -- target/discovery.sh@15 -- # hash nvme 00:08:53.633 15:03:53 -- target/discovery.sh@20 -- # nvmftestinit 00:08:53.633 15:03:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:53.633 15:03:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:53.633 15:03:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:53.633 15:03:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:53.633 15:03:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:53.633 15:03:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:53.633 15:03:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:53.633 15:03:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:53.633 15:03:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:53.633 15:03:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:53.633 15:03:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:53.633 15:03:53 -- common/autotest_common.sh@10 -- # set +x 00:08:55.535 15:03:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:55.535 15:03:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:55.535 15:03:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:55.535 15:03:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:55.535 15:03:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:55.535 15:03:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:55.535 15:03:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:55.535 15:03:55 -- nvmf/common.sh@294 -- # net_devs=() 00:08:55.535 15:03:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:55.535 15:03:55 -- nvmf/common.sh@295 -- # e810=() 00:08:55.535 15:03:55 -- nvmf/common.sh@295 -- # local -ga e810 00:08:55.535 15:03:55 -- nvmf/common.sh@296 -- # x722=() 00:08:55.535 15:03:55 -- nvmf/common.sh@296 -- # local -ga x722 00:08:55.535 15:03:55 -- nvmf/common.sh@297 -- # mlx=() 00:08:55.535 15:03:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:55.535 15:03:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:55.535 15:03:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:55.535 15:03:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:55.535 15:03:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:55.535 15:03:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:55.535 15:03:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:55.535 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:55.535 15:03:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:55.535 15:03:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:55.535 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:55.535 15:03:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:55.535 15:03:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:55.535 15:03:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.535 15:03:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:55.535 15:03:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.535 15:03:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:55.535 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:55.535 15:03:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.535 15:03:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:55.535 15:03:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:55.535 15:03:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:55.535 15:03:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:55.535 15:03:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:55.535 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:55.535 15:03:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:55.535 15:03:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:55.535 15:03:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:55.535 15:03:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:55.535 15:03:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:55.535 15:03:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:55.536 15:03:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:55.536 15:03:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:55.536 15:03:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:55.536 15:03:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:55.536 15:03:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:55.536 15:03:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:55.536 15:03:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:55.536 15:03:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:55.536 15:03:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:55.536 15:03:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:55.536 15:03:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:55.536 15:03:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:55.536 15:03:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:55.536 15:03:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:55.536 15:03:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:55.536 15:03:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:55.536 15:03:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:55.536 15:03:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:55.536 15:03:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:55.536 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:55.536 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:08:55.536 00:08:55.536 --- 10.0.0.2 ping statistics --- 00:08:55.536 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:55.536 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:08:55.536 15:03:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:55.536 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:55.536 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.082 ms 00:08:55.536 00:08:55.536 --- 10.0.0.1 ping statistics --- 00:08:55.536 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:55.536 rtt min/avg/max/mdev = 0.082/0.082/0.082/0.000 ms 00:08:55.536 15:03:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:55.536 15:03:55 -- nvmf/common.sh@410 -- # return 0 00:08:55.536 15:03:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:55.536 15:03:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:55.536 15:03:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:55.536 15:03:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:55.536 15:03:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:55.536 15:03:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:55.536 15:03:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:55.536 15:03:55 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:55.536 15:03:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:55.536 15:03:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:55.536 15:03:55 -- common/autotest_common.sh@10 -- # set +x 00:08:55.536 15:03:55 -- nvmf/common.sh@469 -- # nvmfpid=615677 00:08:55.536 15:03:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:55.536 15:03:55 -- nvmf/common.sh@470 -- # waitforlisten 615677 00:08:55.536 15:03:55 -- common/autotest_common.sh@829 -- # '[' -z 615677 ']' 00:08:55.536 15:03:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:55.536 15:03:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:55.536 15:03:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:55.536 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:55.536 15:03:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:55.536 15:03:55 -- common/autotest_common.sh@10 -- # set +x 00:08:55.536 [2024-11-28 15:03:55.643012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:08:55.536 [2024-11-28 15:03:55.643108] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:55.536 EAL: No free 2048 kB hugepages reported on node 1 00:08:55.536 [2024-11-28 15:03:55.712601] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:55.794 [2024-11-28 15:03:55.801721] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:55.794 [2024-11-28 15:03:55.801888] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:55.794 [2024-11-28 15:03:55.801907] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:55.794 [2024-11-28 15:03:55.801921] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:55.794 [2024-11-28 15:03:55.802001] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:55.794 [2024-11-28 15:03:55.802057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:55.794 [2024-11-28 15:03:55.802176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:55.794 [2024-11-28 15:03:55.802179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:56.360 15:03:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:56.360 15:03:56 -- common/autotest_common.sh@862 -- # return 0 00:08:56.360 15:03:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:56.360 15:03:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:56.360 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:56.618 15:03:56 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 [2024-11-28 15:03:56.621802] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@26 -- # seq 1 4 00:08:56.618 15:03:56 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:56.618 15:03:56 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 Null1 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 [2024-11-28 15:03:56.662061] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:56.618 15:03:56 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 Null2 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:56.618 15:03:56 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 Null3 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:56.618 15:03:56 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.618 Null4 00:08:56.618 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.618 15:03:56 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:56.618 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.618 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.619 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.619 15:03:56 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:56.619 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.619 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.619 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.619 15:03:56 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:56.619 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.619 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.619 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.619 15:03:56 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:56.619 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.619 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.619 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.619 15:03:56 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:56.619 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.619 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.619 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.619 15:03:56 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:56.877 00:08:56.877 Discovery Log Number of Records 6, Generation counter 6 00:08:56.877 =====Discovery Log Entry 0====== 00:08:56.877 trtype: tcp 00:08:56.877 adrfam: ipv4 00:08:56.877 subtype: current discovery subsystem 00:08:56.877 treq: not required 00:08:56.877 portid: 0 00:08:56.877 trsvcid: 4420 00:08:56.877 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:56.877 traddr: 10.0.0.2 00:08:56.877 eflags: explicit discovery connections, duplicate discovery information 00:08:56.877 sectype: none 00:08:56.877 =====Discovery Log Entry 1====== 00:08:56.877 trtype: tcp 00:08:56.877 adrfam: ipv4 00:08:56.877 subtype: nvme subsystem 00:08:56.877 treq: not required 00:08:56.877 portid: 0 00:08:56.877 trsvcid: 4420 00:08:56.877 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:56.877 traddr: 10.0.0.2 00:08:56.877 eflags: none 00:08:56.877 sectype: none 00:08:56.877 =====Discovery Log Entry 2====== 00:08:56.877 trtype: tcp 00:08:56.877 adrfam: ipv4 00:08:56.877 subtype: nvme subsystem 00:08:56.877 treq: not required 00:08:56.877 portid: 0 00:08:56.877 trsvcid: 4420 00:08:56.877 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:56.877 traddr: 10.0.0.2 00:08:56.877 eflags: none 00:08:56.877 sectype: none 00:08:56.877 =====Discovery Log Entry 3====== 00:08:56.877 trtype: tcp 00:08:56.877 adrfam: ipv4 00:08:56.877 subtype: nvme subsystem 00:08:56.877 treq: not required 00:08:56.877 portid: 0 00:08:56.877 trsvcid: 4420 00:08:56.877 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:56.877 traddr: 10.0.0.2 00:08:56.877 eflags: none 00:08:56.877 sectype: none 00:08:56.877 =====Discovery Log Entry 4====== 00:08:56.877 trtype: tcp 00:08:56.877 adrfam: ipv4 00:08:56.877 subtype: nvme subsystem 00:08:56.877 treq: not required 00:08:56.877 portid: 0 00:08:56.877 trsvcid: 4420 00:08:56.877 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:56.877 traddr: 10.0.0.2 00:08:56.877 eflags: none 00:08:56.877 sectype: none 00:08:56.877 =====Discovery Log Entry 5====== 00:08:56.877 trtype: tcp 00:08:56.877 adrfam: ipv4 00:08:56.877 subtype: discovery subsystem referral 00:08:56.877 treq: not required 00:08:56.877 portid: 0 00:08:56.877 trsvcid: 4430 00:08:56.877 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:56.877 traddr: 10.0.0.2 00:08:56.877 eflags: none 00:08:56.877 sectype: none 00:08:56.877 15:03:56 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:56.877 Perform nvmf subsystem discovery via RPC 00:08:56.877 15:03:56 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:56.877 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.877 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.877 [2024-11-28 15:03:56.954889] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:56.877 [ 00:08:56.877 { 00:08:56.877 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:56.877 "subtype": "Discovery", 00:08:56.877 "listen_addresses": [ 00:08:56.877 { 00:08:56.877 "transport": "TCP", 00:08:56.877 "trtype": "TCP", 00:08:56.877 "adrfam": "IPv4", 00:08:56.877 "traddr": "10.0.0.2", 00:08:56.877 "trsvcid": "4420" 00:08:56.877 } 00:08:56.877 ], 00:08:56.877 "allow_any_host": true, 00:08:56.877 "hosts": [] 00:08:56.877 }, 00:08:56.877 { 00:08:56.877 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:56.877 "subtype": "NVMe", 00:08:56.877 "listen_addresses": [ 00:08:56.877 { 00:08:56.877 "transport": "TCP", 00:08:56.877 "trtype": "TCP", 00:08:56.877 "adrfam": "IPv4", 00:08:56.877 "traddr": "10.0.0.2", 00:08:56.877 "trsvcid": "4420" 00:08:56.877 } 00:08:56.877 ], 00:08:56.877 "allow_any_host": true, 00:08:56.877 "hosts": [], 00:08:56.877 "serial_number": "SPDK00000000000001", 00:08:56.877 "model_number": "SPDK bdev Controller", 00:08:56.877 "max_namespaces": 32, 00:08:56.877 "min_cntlid": 1, 00:08:56.877 "max_cntlid": 65519, 00:08:56.877 "namespaces": [ 00:08:56.877 { 00:08:56.877 "nsid": 1, 00:08:56.877 "bdev_name": "Null1", 00:08:56.877 "name": "Null1", 00:08:56.878 "nguid": "F633D6E898844E6197680381D388F52A", 00:08:56.878 "uuid": "f633d6e8-9884-4e61-9768-0381d388f52a" 00:08:56.878 } 00:08:56.878 ] 00:08:56.878 }, 00:08:56.878 { 00:08:56.878 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:56.878 "subtype": "NVMe", 00:08:56.878 "listen_addresses": [ 00:08:56.878 { 00:08:56.878 "transport": "TCP", 00:08:56.878 "trtype": "TCP", 00:08:56.878 "adrfam": "IPv4", 00:08:56.878 "traddr": "10.0.0.2", 00:08:56.878 "trsvcid": "4420" 00:08:56.878 } 00:08:56.878 ], 00:08:56.878 "allow_any_host": true, 00:08:56.878 "hosts": [], 00:08:56.878 "serial_number": "SPDK00000000000002", 00:08:56.878 "model_number": "SPDK bdev Controller", 00:08:56.878 "max_namespaces": 32, 00:08:56.878 "min_cntlid": 1, 00:08:56.878 "max_cntlid": 65519, 00:08:56.878 "namespaces": [ 00:08:56.878 { 00:08:56.878 "nsid": 1, 00:08:56.878 "bdev_name": "Null2", 00:08:56.878 "name": "Null2", 00:08:56.878 "nguid": "9321E36AEC0E44E7B3701995BEBD70B0", 00:08:56.878 "uuid": "9321e36a-ec0e-44e7-b370-1995bebd70b0" 00:08:56.878 } 00:08:56.878 ] 00:08:56.878 }, 00:08:56.878 { 00:08:56.878 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:56.878 "subtype": "NVMe", 00:08:56.878 "listen_addresses": [ 00:08:56.878 { 00:08:56.878 "transport": "TCP", 00:08:56.878 "trtype": "TCP", 00:08:56.878 "adrfam": "IPv4", 00:08:56.878 "traddr": "10.0.0.2", 00:08:56.878 "trsvcid": "4420" 00:08:56.878 } 00:08:56.878 ], 00:08:56.878 "allow_any_host": true, 00:08:56.878 "hosts": [], 00:08:56.878 "serial_number": "SPDK00000000000003", 00:08:56.878 "model_number": "SPDK bdev Controller", 00:08:56.878 "max_namespaces": 32, 00:08:56.878 "min_cntlid": 1, 00:08:56.878 "max_cntlid": 65519, 00:08:56.878 "namespaces": [ 00:08:56.878 { 00:08:56.878 "nsid": 1, 00:08:56.878 "bdev_name": "Null3", 00:08:56.878 "name": "Null3", 00:08:56.878 "nguid": "7338B951A9CD45C888424FA1A85A75A1", 00:08:56.878 "uuid": "7338b951-a9cd-45c8-8842-4fa1a85a75a1" 00:08:56.878 } 00:08:56.878 ] 00:08:56.878 }, 00:08:56.878 { 00:08:56.878 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:56.878 "subtype": "NVMe", 00:08:56.878 "listen_addresses": [ 00:08:56.878 { 00:08:56.878 "transport": "TCP", 00:08:56.878 "trtype": "TCP", 00:08:56.878 "adrfam": "IPv4", 00:08:56.878 "traddr": "10.0.0.2", 00:08:56.878 "trsvcid": "4420" 00:08:56.878 } 00:08:56.878 ], 00:08:56.878 "allow_any_host": true, 00:08:56.878 "hosts": [], 00:08:56.878 "serial_number": "SPDK00000000000004", 00:08:56.878 "model_number": "SPDK bdev Controller", 00:08:56.878 "max_namespaces": 32, 00:08:56.878 "min_cntlid": 1, 00:08:56.878 "max_cntlid": 65519, 00:08:56.878 "namespaces": [ 00:08:56.878 { 00:08:56.878 "nsid": 1, 00:08:56.878 "bdev_name": "Null4", 00:08:56.878 "name": "Null4", 00:08:56.878 "nguid": "0B2EA89A9EA541D5B6B87E295F9AF7F6", 00:08:56.878 "uuid": "0b2ea89a-9ea5-41d5-b6b8-7e295f9af7f6" 00:08:56.878 } 00:08:56.878 ] 00:08:56.878 } 00:08:56.878 ] 00:08:56.878 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:56 -- target/discovery.sh@42 -- # seq 1 4 00:08:56.878 15:03:56 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.878 15:03:56 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:56.878 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:56 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:56.878 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:56 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.878 15:03:56 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:56.878 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:56 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:56.878 15:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:56 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.878 15:03:57 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:56.878 15:03:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:57 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:56.878 15:03:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:57 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:56.878 15:03:57 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:56.878 15:03:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:57 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:56.878 15:03:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:57 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:56.878 15:03:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:57 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:56.878 15:03:57 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:56.878 15:03:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:56.878 15:03:57 -- common/autotest_common.sh@10 -- # set +x 00:08:56.878 15:03:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:56.878 15:03:57 -- target/discovery.sh@49 -- # check_bdevs= 00:08:56.878 15:03:57 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:56.878 15:03:57 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:56.878 15:03:57 -- target/discovery.sh@57 -- # nvmftestfini 00:08:56.878 15:03:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:56.878 15:03:57 -- nvmf/common.sh@116 -- # sync 00:08:56.878 15:03:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:56.878 15:03:57 -- nvmf/common.sh@119 -- # set +e 00:08:56.878 15:03:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:56.878 15:03:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:56.878 rmmod nvme_tcp 00:08:56.878 rmmod nvme_fabrics 00:08:57.137 rmmod nvme_keyring 00:08:57.137 15:03:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:57.137 15:03:57 -- nvmf/common.sh@123 -- # set -e 00:08:57.137 15:03:57 -- nvmf/common.sh@124 -- # return 0 00:08:57.137 15:03:57 -- nvmf/common.sh@477 -- # '[' -n 615677 ']' 00:08:57.137 15:03:57 -- nvmf/common.sh@478 -- # killprocess 615677 00:08:57.137 15:03:57 -- common/autotest_common.sh@936 -- # '[' -z 615677 ']' 00:08:57.137 15:03:57 -- common/autotest_common.sh@940 -- # kill -0 615677 00:08:57.137 15:03:57 -- common/autotest_common.sh@941 -- # uname 00:08:57.137 15:03:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:57.137 15:03:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 615677 00:08:57.137 15:03:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:57.137 15:03:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:57.137 15:03:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 615677' 00:08:57.137 killing process with pid 615677 00:08:57.137 15:03:57 -- common/autotest_common.sh@955 -- # kill 615677 00:08:57.137 [2024-11-28 15:03:57.185949] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:57.137 15:03:57 -- common/autotest_common.sh@960 -- # wait 615677 00:08:57.396 15:03:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:57.396 15:03:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:57.396 15:03:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:57.396 15:03:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:57.396 15:03:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:57.396 15:03:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:57.396 15:03:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:57.396 15:03:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.300 15:03:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:59.300 00:08:59.300 real 0m6.191s 00:08:59.300 user 0m7.478s 00:08:59.300 sys 0m1.897s 00:08:59.300 15:03:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:59.300 15:03:59 -- common/autotest_common.sh@10 -- # set +x 00:08:59.300 ************************************ 00:08:59.300 END TEST nvmf_discovery 00:08:59.300 ************************************ 00:08:59.300 15:03:59 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:59.300 15:03:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:59.300 15:03:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:59.300 15:03:59 -- common/autotest_common.sh@10 -- # set +x 00:08:59.300 ************************************ 00:08:59.300 START TEST nvmf_referrals 00:08:59.300 ************************************ 00:08:59.300 15:03:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:59.559 * Looking for test storage... 00:08:59.559 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:59.559 15:03:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:59.559 15:03:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:59.559 15:03:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:59.559 15:03:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:59.559 15:03:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:59.559 15:03:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:59.559 15:03:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:59.559 15:03:59 -- scripts/common.sh@335 -- # IFS=.-: 00:08:59.559 15:03:59 -- scripts/common.sh@335 -- # read -ra ver1 00:08:59.559 15:03:59 -- scripts/common.sh@336 -- # IFS=.-: 00:08:59.559 15:03:59 -- scripts/common.sh@336 -- # read -ra ver2 00:08:59.559 15:03:59 -- scripts/common.sh@337 -- # local 'op=<' 00:08:59.559 15:03:59 -- scripts/common.sh@339 -- # ver1_l=2 00:08:59.559 15:03:59 -- scripts/common.sh@340 -- # ver2_l=1 00:08:59.559 15:03:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:59.559 15:03:59 -- scripts/common.sh@343 -- # case "$op" in 00:08:59.559 15:03:59 -- scripts/common.sh@344 -- # : 1 00:08:59.559 15:03:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:59.559 15:03:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:59.559 15:03:59 -- scripts/common.sh@364 -- # decimal 1 00:08:59.559 15:03:59 -- scripts/common.sh@352 -- # local d=1 00:08:59.559 15:03:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:59.559 15:03:59 -- scripts/common.sh@354 -- # echo 1 00:08:59.559 15:03:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:59.559 15:03:59 -- scripts/common.sh@365 -- # decimal 2 00:08:59.559 15:03:59 -- scripts/common.sh@352 -- # local d=2 00:08:59.559 15:03:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:59.559 15:03:59 -- scripts/common.sh@354 -- # echo 2 00:08:59.559 15:03:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:59.559 15:03:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:59.559 15:03:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:59.559 15:03:59 -- scripts/common.sh@367 -- # return 0 00:08:59.559 15:03:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:59.559 15:03:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:59.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.559 --rc genhtml_branch_coverage=1 00:08:59.559 --rc genhtml_function_coverage=1 00:08:59.559 --rc genhtml_legend=1 00:08:59.559 --rc geninfo_all_blocks=1 00:08:59.559 --rc geninfo_unexecuted_blocks=1 00:08:59.559 00:08:59.559 ' 00:08:59.559 15:03:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:59.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.559 --rc genhtml_branch_coverage=1 00:08:59.559 --rc genhtml_function_coverage=1 00:08:59.559 --rc genhtml_legend=1 00:08:59.559 --rc geninfo_all_blocks=1 00:08:59.559 --rc geninfo_unexecuted_blocks=1 00:08:59.559 00:08:59.559 ' 00:08:59.559 15:03:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:59.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.559 --rc genhtml_branch_coverage=1 00:08:59.559 --rc genhtml_function_coverage=1 00:08:59.559 --rc genhtml_legend=1 00:08:59.559 --rc geninfo_all_blocks=1 00:08:59.559 --rc geninfo_unexecuted_blocks=1 00:08:59.559 00:08:59.559 ' 00:08:59.559 15:03:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:59.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:59.559 --rc genhtml_branch_coverage=1 00:08:59.559 --rc genhtml_function_coverage=1 00:08:59.559 --rc genhtml_legend=1 00:08:59.559 --rc geninfo_all_blocks=1 00:08:59.559 --rc geninfo_unexecuted_blocks=1 00:08:59.559 00:08:59.559 ' 00:08:59.559 15:03:59 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:59.559 15:03:59 -- nvmf/common.sh@7 -- # uname -s 00:08:59.559 15:03:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:59.559 15:03:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:59.559 15:03:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:59.559 15:03:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:59.559 15:03:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:59.559 15:03:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:59.559 15:03:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:59.559 15:03:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:59.559 15:03:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:59.559 15:03:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:59.559 15:03:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:59.559 15:03:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:59.559 15:03:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:59.559 15:03:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:59.559 15:03:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:59.559 15:03:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:59.559 15:03:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:59.559 15:03:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:59.559 15:03:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:59.559 15:03:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.559 15:03:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.559 15:03:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.559 15:03:59 -- paths/export.sh@5 -- # export PATH 00:08:59.559 15:03:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:59.559 15:03:59 -- nvmf/common.sh@46 -- # : 0 00:08:59.559 15:03:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:59.559 15:03:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:59.559 15:03:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:59.559 15:03:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:59.560 15:03:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:59.560 15:03:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:59.560 15:03:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:59.560 15:03:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:59.560 15:03:59 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:59.560 15:03:59 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:59.560 15:03:59 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:59.560 15:03:59 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:59.560 15:03:59 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:59.560 15:03:59 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:59.560 15:03:59 -- target/referrals.sh@37 -- # nvmftestinit 00:08:59.560 15:03:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:59.560 15:03:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:59.560 15:03:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:59.560 15:03:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:59.560 15:03:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:59.560 15:03:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.560 15:03:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:59.560 15:03:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:59.560 15:03:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:59.560 15:03:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:59.560 15:03:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:59.560 15:03:59 -- common/autotest_common.sh@10 -- # set +x 00:09:02.091 15:04:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:02.091 15:04:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:02.091 15:04:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:02.091 15:04:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:02.091 15:04:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:02.091 15:04:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:02.091 15:04:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:02.091 15:04:01 -- nvmf/common.sh@294 -- # net_devs=() 00:09:02.091 15:04:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:02.091 15:04:01 -- nvmf/common.sh@295 -- # e810=() 00:09:02.091 15:04:01 -- nvmf/common.sh@295 -- # local -ga e810 00:09:02.091 15:04:01 -- nvmf/common.sh@296 -- # x722=() 00:09:02.091 15:04:01 -- nvmf/common.sh@296 -- # local -ga x722 00:09:02.091 15:04:01 -- nvmf/common.sh@297 -- # mlx=() 00:09:02.091 15:04:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:02.091 15:04:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:02.091 15:04:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:02.091 15:04:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:02.091 15:04:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:02.091 15:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:02.091 15:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:02.091 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:02.091 15:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:02.091 15:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:02.092 15:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:02.092 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:02.092 15:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:02.092 15:04:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:02.092 15:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:02.092 15:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:02.092 15:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:02.092 15:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:02.092 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:02.092 15:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:02.092 15:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:02.092 15:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:02.092 15:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:02.092 15:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:02.092 15:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:02.092 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:02.092 15:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:02.092 15:04:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:02.092 15:04:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:02.092 15:04:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:02.092 15:04:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:02.092 15:04:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:02.092 15:04:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:02.092 15:04:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:02.092 15:04:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:02.092 15:04:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:02.092 15:04:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:02.092 15:04:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:02.092 15:04:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:02.092 15:04:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:02.092 15:04:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:02.092 15:04:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:02.092 15:04:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:02.092 15:04:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:02.092 15:04:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:02.092 15:04:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:02.092 15:04:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:02.092 15:04:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:02.092 15:04:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:02.092 15:04:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:02.092 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:02.092 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:09:02.092 00:09:02.092 --- 10.0.0.2 ping statistics --- 00:09:02.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:02.092 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:09:02.092 15:04:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:02.092 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:02.092 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.170 ms 00:09:02.092 00:09:02.092 --- 10.0.0.1 ping statistics --- 00:09:02.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:02.092 rtt min/avg/max/mdev = 0.170/0.170/0.170/0.000 ms 00:09:02.092 15:04:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:02.092 15:04:01 -- nvmf/common.sh@410 -- # return 0 00:09:02.092 15:04:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:02.092 15:04:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:02.092 15:04:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:02.092 15:04:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:02.092 15:04:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:02.092 15:04:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:02.092 15:04:01 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:09:02.092 15:04:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:02.092 15:04:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:02.092 15:04:01 -- common/autotest_common.sh@10 -- # set +x 00:09:02.092 15:04:01 -- nvmf/common.sh@469 -- # nvmfpid=617889 00:09:02.092 15:04:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:02.092 15:04:01 -- nvmf/common.sh@470 -- # waitforlisten 617889 00:09:02.092 15:04:01 -- common/autotest_common.sh@829 -- # '[' -z 617889 ']' 00:09:02.092 15:04:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:02.092 15:04:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:02.092 15:04:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:02.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:02.092 15:04:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:02.092 15:04:01 -- common/autotest_common.sh@10 -- # set +x 00:09:02.092 [2024-11-28 15:04:01.924653] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:02.092 [2024-11-28 15:04:01.924741] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:02.092 EAL: No free 2048 kB hugepages reported on node 1 00:09:02.092 [2024-11-28 15:04:02.002081] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:02.092 [2024-11-28 15:04:02.097103] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:02.092 [2024-11-28 15:04:02.097266] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:02.092 [2024-11-28 15:04:02.097294] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:02.092 [2024-11-28 15:04:02.097310] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:02.092 [2024-11-28 15:04:02.097390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:02.092 [2024-11-28 15:04:02.097446] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:02.092 [2024-11-28 15:04:02.097485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:02.092 [2024-11-28 15:04:02.097491] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:03.025 15:04:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:03.025 15:04:02 -- common/autotest_common.sh@862 -- # return 0 00:09:03.025 15:04:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:03.025 15:04:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:03.025 15:04:02 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 15:04:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:03.025 15:04:02 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:09:03.025 15:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:02 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 [2024-11-28 15:04:02.977908] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:03.025 15:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:02 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:09:03.025 15:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:02 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 [2024-11-28 15:04:02.990119] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:09:03.025 15:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:02 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:09:03.025 15:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:02 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:03 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:09:03.025 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:03 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:09:03.025 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:03 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:03.025 15:04:03 -- target/referrals.sh@48 -- # jq length 00:09:03.025 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:03 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:09:03.025 15:04:03 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:09:03.025 15:04:03 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:03.025 15:04:03 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:03.025 15:04:03 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:03.025 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.025 15:04:03 -- target/referrals.sh@21 -- # sort 00:09:03.025 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.025 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.025 15:04:03 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:03.025 15:04:03 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:03.025 15:04:03 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:09:03.025 15:04:03 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:03.025 15:04:03 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:03.025 15:04:03 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.025 15:04:03 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:03.025 15:04:03 -- target/referrals.sh@26 -- # sort 00:09:03.282 15:04:03 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:09:03.282 15:04:03 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:09:03.282 15:04:03 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:09:03.282 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.282 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.282 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.282 15:04:03 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:09:03.282 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.282 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.282 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.282 15:04:03 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:09:03.282 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.282 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.282 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.282 15:04:03 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:03.282 15:04:03 -- target/referrals.sh@56 -- # jq length 00:09:03.282 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.282 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.282 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.282 15:04:03 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:09:03.282 15:04:03 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:09:03.282 15:04:03 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:03.282 15:04:03 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:03.282 15:04:03 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.282 15:04:03 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:03.282 15:04:03 -- target/referrals.sh@26 -- # sort 00:09:03.540 15:04:03 -- target/referrals.sh@26 -- # echo 00:09:03.540 15:04:03 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:09:03.540 15:04:03 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:09:03.540 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.540 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.540 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.540 15:04:03 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:03.540 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.540 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.540 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.540 15:04:03 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:09:03.540 15:04:03 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:03.540 15:04:03 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:03.540 15:04:03 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:03.540 15:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:03.540 15:04:03 -- target/referrals.sh@21 -- # sort 00:09:03.540 15:04:03 -- common/autotest_common.sh@10 -- # set +x 00:09:03.540 15:04:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:03.540 15:04:03 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:09:03.540 15:04:03 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:03.540 15:04:03 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:09:03.540 15:04:03 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:03.540 15:04:03 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:03.540 15:04:03 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.540 15:04:03 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:03.540 15:04:03 -- target/referrals.sh@26 -- # sort 00:09:03.798 15:04:03 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:09:03.798 15:04:03 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:09:03.798 15:04:03 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:09:03.798 15:04:03 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:03.798 15:04:03 -- target/referrals.sh@67 -- # jq -r .subnqn 00:09:03.798 15:04:03 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.798 15:04:03 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:03.798 15:04:03 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:09:03.798 15:04:03 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:09:03.798 15:04:03 -- target/referrals.sh@68 -- # jq -r .subnqn 00:09:03.798 15:04:03 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:03.798 15:04:04 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:03.798 15:04:04 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:04.055 15:04:04 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:04.055 15:04:04 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:09:04.055 15:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.055 15:04:04 -- common/autotest_common.sh@10 -- # set +x 00:09:04.055 15:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.055 15:04:04 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:09:04.055 15:04:04 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:09:04.055 15:04:04 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:04.055 15:04:04 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:09:04.055 15:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.055 15:04:04 -- common/autotest_common.sh@10 -- # set +x 00:09:04.055 15:04:04 -- target/referrals.sh@21 -- # sort 00:09:04.055 15:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.055 15:04:04 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:09:04.055 15:04:04 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:04.055 15:04:04 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:09:04.055 15:04:04 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:04.055 15:04:04 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:04.055 15:04:04 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:04.055 15:04:04 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:04.055 15:04:04 -- target/referrals.sh@26 -- # sort 00:09:04.311 15:04:04 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:09:04.311 15:04:04 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:09:04.311 15:04:04 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:09:04.311 15:04:04 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:09:04.311 15:04:04 -- target/referrals.sh@75 -- # jq -r .subnqn 00:09:04.311 15:04:04 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:04.311 15:04:04 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:09:04.569 15:04:04 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:09:04.569 15:04:04 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:09:04.569 15:04:04 -- target/referrals.sh@76 -- # jq -r .subnqn 00:09:04.569 15:04:04 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:09:04.569 15:04:04 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:04.569 15:04:04 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:09:04.569 15:04:04 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:09:04.569 15:04:04 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:09:04.569 15:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.569 15:04:04 -- common/autotest_common.sh@10 -- # set +x 00:09:04.569 15:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.569 15:04:04 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:09:04.569 15:04:04 -- target/referrals.sh@82 -- # jq length 00:09:04.569 15:04:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:04.569 15:04:04 -- common/autotest_common.sh@10 -- # set +x 00:09:04.569 15:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:04.827 15:04:04 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:09:04.827 15:04:04 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:09:04.827 15:04:04 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:09:04.827 15:04:04 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:09:04.827 15:04:04 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:09:04.827 15:04:04 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:09:04.827 15:04:04 -- target/referrals.sh@26 -- # sort 00:09:04.827 15:04:04 -- target/referrals.sh@26 -- # echo 00:09:04.827 15:04:04 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:09:04.827 15:04:04 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:09:04.827 15:04:04 -- target/referrals.sh@86 -- # nvmftestfini 00:09:04.827 15:04:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:09:04.827 15:04:04 -- nvmf/common.sh@116 -- # sync 00:09:04.827 15:04:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:09:04.827 15:04:04 -- nvmf/common.sh@119 -- # set +e 00:09:04.827 15:04:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:09:04.827 15:04:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:09:04.827 rmmod nvme_tcp 00:09:04.827 rmmod nvme_fabrics 00:09:04.827 rmmod nvme_keyring 00:09:04.827 15:04:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:09:04.827 15:04:05 -- nvmf/common.sh@123 -- # set -e 00:09:04.827 15:04:05 -- nvmf/common.sh@124 -- # return 0 00:09:04.827 15:04:05 -- nvmf/common.sh@477 -- # '[' -n 617889 ']' 00:09:04.827 15:04:05 -- nvmf/common.sh@478 -- # killprocess 617889 00:09:04.827 15:04:05 -- common/autotest_common.sh@936 -- # '[' -z 617889 ']' 00:09:04.827 15:04:05 -- common/autotest_common.sh@940 -- # kill -0 617889 00:09:04.827 15:04:05 -- common/autotest_common.sh@941 -- # uname 00:09:04.827 15:04:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:09:04.827 15:04:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 617889 00:09:05.087 15:04:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:09:05.087 15:04:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:09:05.087 15:04:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 617889' 00:09:05.087 killing process with pid 617889 00:09:05.087 15:04:05 -- common/autotest_common.sh@955 -- # kill 617889 00:09:05.087 15:04:05 -- common/autotest_common.sh@960 -- # wait 617889 00:09:05.087 15:04:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:09:05.087 15:04:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:09:05.087 15:04:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:09:05.087 15:04:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:09:05.087 15:04:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:09:05.087 15:04:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:05.087 15:04:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:05.087 15:04:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:07.623 15:04:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:07.623 00:09:07.623 real 0m7.847s 00:09:07.623 user 0m14.517s 00:09:07.623 sys 0m2.290s 00:09:07.623 15:04:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:07.623 15:04:07 -- common/autotest_common.sh@10 -- # set +x 00:09:07.623 ************************************ 00:09:07.623 END TEST nvmf_referrals 00:09:07.623 ************************************ 00:09:07.623 15:04:07 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:07.623 15:04:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:07.623 15:04:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:07.623 15:04:07 -- common/autotest_common.sh@10 -- # set +x 00:09:07.623 ************************************ 00:09:07.623 START TEST nvmf_connect_disconnect 00:09:07.623 ************************************ 00:09:07.623 15:04:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:07.623 * Looking for test storage... 00:09:07.623 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:07.623 15:04:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:07.623 15:04:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:07.623 15:04:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:07.623 15:04:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:07.623 15:04:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:07.623 15:04:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:07.623 15:04:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:07.623 15:04:07 -- scripts/common.sh@335 -- # IFS=.-: 00:09:07.623 15:04:07 -- scripts/common.sh@335 -- # read -ra ver1 00:09:07.623 15:04:07 -- scripts/common.sh@336 -- # IFS=.-: 00:09:07.623 15:04:07 -- scripts/common.sh@336 -- # read -ra ver2 00:09:07.623 15:04:07 -- scripts/common.sh@337 -- # local 'op=<' 00:09:07.623 15:04:07 -- scripts/common.sh@339 -- # ver1_l=2 00:09:07.623 15:04:07 -- scripts/common.sh@340 -- # ver2_l=1 00:09:07.623 15:04:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:07.623 15:04:07 -- scripts/common.sh@343 -- # case "$op" in 00:09:07.623 15:04:07 -- scripts/common.sh@344 -- # : 1 00:09:07.623 15:04:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:07.623 15:04:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:07.623 15:04:07 -- scripts/common.sh@364 -- # decimal 1 00:09:07.623 15:04:07 -- scripts/common.sh@352 -- # local d=1 00:09:07.623 15:04:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:07.623 15:04:07 -- scripts/common.sh@354 -- # echo 1 00:09:07.623 15:04:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:07.623 15:04:07 -- scripts/common.sh@365 -- # decimal 2 00:09:07.623 15:04:07 -- scripts/common.sh@352 -- # local d=2 00:09:07.623 15:04:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:07.623 15:04:07 -- scripts/common.sh@354 -- # echo 2 00:09:07.623 15:04:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:07.623 15:04:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:07.623 15:04:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:07.623 15:04:07 -- scripts/common.sh@367 -- # return 0 00:09:07.623 15:04:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:07.623 15:04:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:07.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.623 --rc genhtml_branch_coverage=1 00:09:07.623 --rc genhtml_function_coverage=1 00:09:07.623 --rc genhtml_legend=1 00:09:07.623 --rc geninfo_all_blocks=1 00:09:07.623 --rc geninfo_unexecuted_blocks=1 00:09:07.623 00:09:07.623 ' 00:09:07.623 15:04:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:07.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.623 --rc genhtml_branch_coverage=1 00:09:07.623 --rc genhtml_function_coverage=1 00:09:07.623 --rc genhtml_legend=1 00:09:07.623 --rc geninfo_all_blocks=1 00:09:07.623 --rc geninfo_unexecuted_blocks=1 00:09:07.623 00:09:07.623 ' 00:09:07.623 15:04:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:07.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.623 --rc genhtml_branch_coverage=1 00:09:07.623 --rc genhtml_function_coverage=1 00:09:07.623 --rc genhtml_legend=1 00:09:07.623 --rc geninfo_all_blocks=1 00:09:07.623 --rc geninfo_unexecuted_blocks=1 00:09:07.623 00:09:07.623 ' 00:09:07.623 15:04:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:07.623 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:07.623 --rc genhtml_branch_coverage=1 00:09:07.623 --rc genhtml_function_coverage=1 00:09:07.623 --rc genhtml_legend=1 00:09:07.623 --rc geninfo_all_blocks=1 00:09:07.623 --rc geninfo_unexecuted_blocks=1 00:09:07.623 00:09:07.623 ' 00:09:07.623 15:04:07 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:07.623 15:04:07 -- nvmf/common.sh@7 -- # uname -s 00:09:07.623 15:04:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:07.623 15:04:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:07.623 15:04:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:07.623 15:04:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:07.623 15:04:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:07.623 15:04:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:07.623 15:04:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:07.623 15:04:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:07.623 15:04:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:07.623 15:04:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:07.623 15:04:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:07.623 15:04:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:07.623 15:04:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:07.623 15:04:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:07.623 15:04:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:07.623 15:04:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:07.623 15:04:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:07.623 15:04:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:07.623 15:04:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:07.623 15:04:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.623 15:04:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.623 15:04:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.623 15:04:07 -- paths/export.sh@5 -- # export PATH 00:09:07.623 15:04:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:07.623 15:04:07 -- nvmf/common.sh@46 -- # : 0 00:09:07.623 15:04:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:07.623 15:04:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:07.623 15:04:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:07.623 15:04:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:07.623 15:04:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:07.623 15:04:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:07.623 15:04:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:07.623 15:04:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:07.623 15:04:07 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:07.623 15:04:07 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:07.623 15:04:07 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:07.623 15:04:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:07.623 15:04:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:07.623 15:04:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:07.623 15:04:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:07.623 15:04:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:07.623 15:04:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:07.623 15:04:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:07.623 15:04:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:07.623 15:04:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:07.623 15:04:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:07.623 15:04:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:07.623 15:04:07 -- common/autotest_common.sh@10 -- # set +x 00:09:09.525 15:04:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:09.525 15:04:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:09.525 15:04:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:09.525 15:04:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:09.525 15:04:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:09.525 15:04:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:09.525 15:04:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:09.526 15:04:09 -- nvmf/common.sh@294 -- # net_devs=() 00:09:09.526 15:04:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:09.526 15:04:09 -- nvmf/common.sh@295 -- # e810=() 00:09:09.526 15:04:09 -- nvmf/common.sh@295 -- # local -ga e810 00:09:09.526 15:04:09 -- nvmf/common.sh@296 -- # x722=() 00:09:09.526 15:04:09 -- nvmf/common.sh@296 -- # local -ga x722 00:09:09.526 15:04:09 -- nvmf/common.sh@297 -- # mlx=() 00:09:09.526 15:04:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:09.526 15:04:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:09.526 15:04:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:09.526 15:04:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:09.526 15:04:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:09.526 15:04:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:09.526 15:04:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:09.526 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:09.526 15:04:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:09.526 15:04:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:09.526 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:09.526 15:04:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:09.526 15:04:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:09.526 15:04:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:09.526 15:04:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:09.526 15:04:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:09.526 15:04:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:09.526 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:09.526 15:04:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:09.526 15:04:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:09.526 15:04:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:09.526 15:04:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:09.526 15:04:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:09.526 15:04:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:09.526 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:09.526 15:04:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:09.526 15:04:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:09.526 15:04:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:09.526 15:04:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:09.526 15:04:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:09.526 15:04:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:09.526 15:04:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:09.526 15:04:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:09.526 15:04:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:09.526 15:04:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:09.526 15:04:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:09.526 15:04:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:09.526 15:04:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:09.526 15:04:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:09.526 15:04:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:09.526 15:04:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:09.526 15:04:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:09.526 15:04:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:09.526 15:04:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:09.526 15:04:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:09.526 15:04:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:09.526 15:04:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:09.526 15:04:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:09.526 15:04:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:09.526 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:09.526 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.172 ms 00:09:09.526 00:09:09.526 --- 10.0.0.2 ping statistics --- 00:09:09.526 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:09.526 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:09:09.526 15:04:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:09.526 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:09.526 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:09:09.526 00:09:09.526 --- 10.0.0.1 ping statistics --- 00:09:09.526 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:09.526 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:09:09.526 15:04:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:09.526 15:04:09 -- nvmf/common.sh@410 -- # return 0 00:09:09.526 15:04:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:09.526 15:04:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:09.526 15:04:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:09.526 15:04:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:09.526 15:04:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:09.526 15:04:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:09.526 15:04:09 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:09.526 15:04:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:09.526 15:04:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:09.526 15:04:09 -- common/autotest_common.sh@10 -- # set +x 00:09:09.526 15:04:09 -- nvmf/common.sh@469 -- # nvmfpid=620343 00:09:09.526 15:04:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:09.526 15:04:09 -- nvmf/common.sh@470 -- # waitforlisten 620343 00:09:09.526 15:04:09 -- common/autotest_common.sh@829 -- # '[' -z 620343 ']' 00:09:09.526 15:04:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:09.526 15:04:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:09.526 15:04:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:09.526 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:09.526 15:04:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:09.526 15:04:09 -- common/autotest_common.sh@10 -- # set +x 00:09:09.785 [2024-11-28 15:04:09.790317] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:09:09.785 [2024-11-28 15:04:09.790421] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:09.785 EAL: No free 2048 kB hugepages reported on node 1 00:09:09.785 [2024-11-28 15:04:09.860562] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:09.785 [2024-11-28 15:04:09.952846] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:09.785 [2024-11-28 15:04:09.953029] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:09.785 [2024-11-28 15:04:09.953049] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:09.785 [2024-11-28 15:04:09.953063] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:09.785 [2024-11-28 15:04:09.953147] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:09.785 [2024-11-28 15:04:09.953210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:09.785 [2024-11-28 15:04:09.953264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:09.785 [2024-11-28 15:04:09.953268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:10.795 15:04:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:10.795 15:04:10 -- common/autotest_common.sh@862 -- # return 0 00:09:10.795 15:04:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:10.795 15:04:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:10.795 15:04:10 -- common/autotest_common.sh@10 -- # set +x 00:09:10.795 15:04:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:10.795 15:04:10 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:10.795 15:04:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.795 15:04:10 -- common/autotest_common.sh@10 -- # set +x 00:09:10.795 [2024-11-28 15:04:10.826946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:10.795 15:04:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.795 15:04:10 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:10.795 15:04:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.795 15:04:10 -- common/autotest_common.sh@10 -- # set +x 00:09:10.795 15:04:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.795 15:04:10 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:10.795 15:04:10 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:10.795 15:04:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.795 15:04:10 -- common/autotest_common.sh@10 -- # set +x 00:09:10.795 15:04:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.795 15:04:10 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:10.795 15:04:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.795 15:04:10 -- common/autotest_common.sh@10 -- # set +x 00:09:10.796 15:04:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.796 15:04:10 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:10.796 15:04:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:10.796 15:04:10 -- common/autotest_common.sh@10 -- # set +x 00:09:10.796 [2024-11-28 15:04:10.880413] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:10.796 15:04:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:10.796 15:04:10 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:10.796 15:04:10 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:10.796 15:04:10 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:10.796 15:04:10 -- target/connect_disconnect.sh@34 -- # set +x 00:09:13.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.849 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.748 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.278 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.804 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.701 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.708 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.128 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.653 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.546 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.072 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.034 [2024-11-28 15:04:54.891881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f60210 is same with the state(5) to be set 00:09:55.034 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.666 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.090 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.613 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.508 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.033 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.558 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.456 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.506 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.928 [2024-11-28 15:05:22.779909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f600e0 is same with the state(5) to be set 00:10:22.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.453 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.351 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:29.878 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.403 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.825 [2024-11-28 15:05:36.835792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f600e0 is same with the state(5) to be set 00:10:36.825 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.351 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.984 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.879 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.302 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.831 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.254 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.782 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.205 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.637 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.693 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.592 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.118 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.016 [2024-11-28 15:06:18.176780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f600e0 is same with the state(5) to be set 00:11:18.016 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.542 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.067 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.020 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.542 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.440 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.493 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.417 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.945 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.843 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.367 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.319 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.370 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.267 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.315 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.839 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.735 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.243 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.771 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.295 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.821 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.246 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.773 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.671 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.198 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.096 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.147 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.047 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:41.574 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.470 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:45.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:50.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.005 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:55.529 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.427 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:59.954 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.478 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.478 15:08:02 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:13:02.478 15:08:02 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:13:02.478 15:08:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:02.478 15:08:02 -- nvmf/common.sh@116 -- # sync 00:13:02.478 15:08:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:02.478 15:08:02 -- nvmf/common.sh@119 -- # set +e 00:13:02.478 15:08:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:02.478 15:08:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:02.478 rmmod nvme_tcp 00:13:02.478 rmmod nvme_fabrics 00:13:02.478 rmmod nvme_keyring 00:13:02.478 15:08:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:02.478 15:08:02 -- nvmf/common.sh@123 -- # set -e 00:13:02.478 15:08:02 -- nvmf/common.sh@124 -- # return 0 00:13:02.478 15:08:02 -- nvmf/common.sh@477 -- # '[' -n 620343 ']' 00:13:02.478 15:08:02 -- nvmf/common.sh@478 -- # killprocess 620343 00:13:02.478 15:08:02 -- common/autotest_common.sh@936 -- # '[' -z 620343 ']' 00:13:02.478 15:08:02 -- common/autotest_common.sh@940 -- # kill -0 620343 00:13:02.478 15:08:02 -- common/autotest_common.sh@941 -- # uname 00:13:02.478 15:08:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:02.478 15:08:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 620343 00:13:02.478 15:08:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:02.478 15:08:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:02.478 15:08:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 620343' 00:13:02.478 killing process with pid 620343 00:13:02.478 15:08:02 -- common/autotest_common.sh@955 -- # kill 620343 00:13:02.478 15:08:02 -- common/autotest_common.sh@960 -- # wait 620343 00:13:02.478 15:08:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:02.478 15:08:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:02.478 15:08:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:02.478 15:08:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:02.478 15:08:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:02.478 15:08:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:02.478 15:08:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:02.478 15:08:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:04.382 15:08:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:04.382 00:13:04.382 real 3m57.238s 00:13:04.382 user 15m4.522s 00:13:04.382 sys 0m34.975s 00:13:04.382 15:08:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:04.382 15:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:04.382 ************************************ 00:13:04.382 END TEST nvmf_connect_disconnect 00:13:04.382 ************************************ 00:13:04.641 15:08:04 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:04.641 15:08:04 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:04.641 15:08:04 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:04.641 15:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:04.641 ************************************ 00:13:04.641 START TEST nvmf_multitarget 00:13:04.641 ************************************ 00:13:04.641 15:08:04 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:04.641 * Looking for test storage... 00:13:04.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:04.642 15:08:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:04.642 15:08:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:04.642 15:08:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:04.642 15:08:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:04.642 15:08:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:04.642 15:08:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:04.642 15:08:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:04.642 15:08:04 -- scripts/common.sh@335 -- # IFS=.-: 00:13:04.642 15:08:04 -- scripts/common.sh@335 -- # read -ra ver1 00:13:04.642 15:08:04 -- scripts/common.sh@336 -- # IFS=.-: 00:13:04.642 15:08:04 -- scripts/common.sh@336 -- # read -ra ver2 00:13:04.642 15:08:04 -- scripts/common.sh@337 -- # local 'op=<' 00:13:04.642 15:08:04 -- scripts/common.sh@339 -- # ver1_l=2 00:13:04.642 15:08:04 -- scripts/common.sh@340 -- # ver2_l=1 00:13:04.642 15:08:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:04.642 15:08:04 -- scripts/common.sh@343 -- # case "$op" in 00:13:04.642 15:08:04 -- scripts/common.sh@344 -- # : 1 00:13:04.642 15:08:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:04.642 15:08:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:04.642 15:08:04 -- scripts/common.sh@364 -- # decimal 1 00:13:04.642 15:08:04 -- scripts/common.sh@352 -- # local d=1 00:13:04.642 15:08:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:04.642 15:08:04 -- scripts/common.sh@354 -- # echo 1 00:13:04.642 15:08:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:04.642 15:08:04 -- scripts/common.sh@365 -- # decimal 2 00:13:04.642 15:08:04 -- scripts/common.sh@352 -- # local d=2 00:13:04.642 15:08:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:04.642 15:08:04 -- scripts/common.sh@354 -- # echo 2 00:13:04.642 15:08:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:04.642 15:08:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:04.642 15:08:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:04.642 15:08:04 -- scripts/common.sh@367 -- # return 0 00:13:04.642 15:08:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:04.642 15:08:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:04.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.642 --rc genhtml_branch_coverage=1 00:13:04.642 --rc genhtml_function_coverage=1 00:13:04.642 --rc genhtml_legend=1 00:13:04.642 --rc geninfo_all_blocks=1 00:13:04.642 --rc geninfo_unexecuted_blocks=1 00:13:04.642 00:13:04.642 ' 00:13:04.642 15:08:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:04.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.642 --rc genhtml_branch_coverage=1 00:13:04.642 --rc genhtml_function_coverage=1 00:13:04.642 --rc genhtml_legend=1 00:13:04.642 --rc geninfo_all_blocks=1 00:13:04.642 --rc geninfo_unexecuted_blocks=1 00:13:04.642 00:13:04.642 ' 00:13:04.642 15:08:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:04.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.642 --rc genhtml_branch_coverage=1 00:13:04.642 --rc genhtml_function_coverage=1 00:13:04.642 --rc genhtml_legend=1 00:13:04.642 --rc geninfo_all_blocks=1 00:13:04.642 --rc geninfo_unexecuted_blocks=1 00:13:04.642 00:13:04.642 ' 00:13:04.642 15:08:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:04.642 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:04.642 --rc genhtml_branch_coverage=1 00:13:04.642 --rc genhtml_function_coverage=1 00:13:04.642 --rc genhtml_legend=1 00:13:04.642 --rc geninfo_all_blocks=1 00:13:04.642 --rc geninfo_unexecuted_blocks=1 00:13:04.642 00:13:04.642 ' 00:13:04.642 15:08:04 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:04.642 15:08:04 -- nvmf/common.sh@7 -- # uname -s 00:13:04.642 15:08:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:04.642 15:08:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:04.642 15:08:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:04.642 15:08:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:04.642 15:08:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:04.642 15:08:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:04.642 15:08:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:04.642 15:08:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:04.642 15:08:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:04.642 15:08:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:04.642 15:08:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:04.642 15:08:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:04.642 15:08:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:04.642 15:08:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:04.642 15:08:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:04.642 15:08:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:04.642 15:08:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:04.642 15:08:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:04.642 15:08:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:04.642 15:08:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.642 15:08:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.642 15:08:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.642 15:08:04 -- paths/export.sh@5 -- # export PATH 00:13:04.642 15:08:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:04.642 15:08:04 -- nvmf/common.sh@46 -- # : 0 00:13:04.642 15:08:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:04.642 15:08:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:04.642 15:08:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:04.642 15:08:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:04.642 15:08:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:04.642 15:08:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:04.642 15:08:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:04.642 15:08:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:04.642 15:08:04 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:04.642 15:08:04 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:04.642 15:08:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:04.642 15:08:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:04.642 15:08:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:04.642 15:08:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:04.642 15:08:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:04.642 15:08:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:04.642 15:08:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:04.642 15:08:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:04.642 15:08:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:04.642 15:08:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:04.642 15:08:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:04.642 15:08:04 -- common/autotest_common.sh@10 -- # set +x 00:13:07.177 15:08:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:07.177 15:08:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:07.177 15:08:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:07.177 15:08:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:07.177 15:08:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:07.177 15:08:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:07.177 15:08:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:07.177 15:08:06 -- nvmf/common.sh@294 -- # net_devs=() 00:13:07.177 15:08:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:07.177 15:08:06 -- nvmf/common.sh@295 -- # e810=() 00:13:07.177 15:08:06 -- nvmf/common.sh@295 -- # local -ga e810 00:13:07.177 15:08:06 -- nvmf/common.sh@296 -- # x722=() 00:13:07.177 15:08:06 -- nvmf/common.sh@296 -- # local -ga x722 00:13:07.177 15:08:06 -- nvmf/common.sh@297 -- # mlx=() 00:13:07.177 15:08:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:07.177 15:08:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:07.177 15:08:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:07.177 15:08:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:07.177 15:08:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:07.177 15:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:07.177 15:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:07.177 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:07.177 15:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:07.177 15:08:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:07.177 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:07.177 15:08:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:07.177 15:08:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:07.177 15:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:07.177 15:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:07.177 15:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:07.177 15:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:07.177 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:07.177 15:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:07.177 15:08:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:07.177 15:08:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:07.177 15:08:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:07.177 15:08:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:07.177 15:08:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:07.177 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:07.177 15:08:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:07.177 15:08:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:07.177 15:08:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:07.177 15:08:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:07.177 15:08:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:07.177 15:08:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:07.177 15:08:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:07.177 15:08:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:07.177 15:08:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:07.177 15:08:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:07.177 15:08:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:07.177 15:08:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:07.177 15:08:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:07.177 15:08:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:07.177 15:08:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:07.177 15:08:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:07.177 15:08:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:07.177 15:08:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:07.177 15:08:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:07.177 15:08:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:07.177 15:08:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:07.177 15:08:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:07.177 15:08:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:07.177 15:08:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:07.177 15:08:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:07.177 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:07.177 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.225 ms 00:13:07.177 00:13:07.177 --- 10.0.0.2 ping statistics --- 00:13:07.177 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:07.177 rtt min/avg/max/mdev = 0.225/0.225/0.225/0.000 ms 00:13:07.177 15:08:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:07.177 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:07.177 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:13:07.177 00:13:07.177 --- 10.0.0.1 ping statistics --- 00:13:07.177 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:07.177 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:13:07.177 15:08:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:07.177 15:08:07 -- nvmf/common.sh@410 -- # return 0 00:13:07.177 15:08:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:07.177 15:08:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:07.177 15:08:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:07.177 15:08:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:07.177 15:08:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:07.177 15:08:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:07.178 15:08:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:07.178 15:08:07 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:07.178 15:08:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:07.178 15:08:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:07.178 15:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:07.178 15:08:07 -- nvmf/common.sh@469 -- # nvmfpid=652492 00:13:07.178 15:08:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:07.178 15:08:07 -- nvmf/common.sh@470 -- # waitforlisten 652492 00:13:07.178 15:08:07 -- common/autotest_common.sh@829 -- # '[' -z 652492 ']' 00:13:07.178 15:08:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:07.178 15:08:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:07.178 15:08:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:07.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:07.178 15:08:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:07.178 15:08:07 -- common/autotest_common.sh@10 -- # set +x 00:13:07.178 [2024-11-28 15:08:07.152162] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:07.178 [2024-11-28 15:08:07.152233] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:07.178 EAL: No free 2048 kB hugepages reported on node 1 00:13:07.178 [2024-11-28 15:08:07.222231] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:07.178 [2024-11-28 15:08:07.314951] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:07.178 [2024-11-28 15:08:07.315133] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:07.178 [2024-11-28 15:08:07.315155] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:07.178 [2024-11-28 15:08:07.315171] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:07.178 [2024-11-28 15:08:07.315233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:07.178 [2024-11-28 15:08:07.315291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:07.178 [2024-11-28 15:08:07.315343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:07.178 [2024-11-28 15:08:07.315347] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:08.111 15:08:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:08.111 15:08:08 -- common/autotest_common.sh@862 -- # return 0 00:13:08.111 15:08:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:08.111 15:08:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:08.111 15:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:08.111 15:08:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:08.111 15:08:08 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:08.111 15:08:08 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:08.111 15:08:08 -- target/multitarget.sh@21 -- # jq length 00:13:08.111 15:08:08 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:08.111 15:08:08 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:08.369 "nvmf_tgt_1" 00:13:08.369 15:08:08 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:08.369 "nvmf_tgt_2" 00:13:08.369 15:08:08 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:08.369 15:08:08 -- target/multitarget.sh@28 -- # jq length 00:13:08.627 15:08:08 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:08.627 15:08:08 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:08.627 true 00:13:08.627 15:08:08 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:08.627 true 00:13:08.627 15:08:08 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:08.627 15:08:08 -- target/multitarget.sh@35 -- # jq length 00:13:08.885 15:08:08 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:08.885 15:08:08 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:08.885 15:08:08 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:08.885 15:08:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:08.885 15:08:08 -- nvmf/common.sh@116 -- # sync 00:13:08.885 15:08:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:08.885 15:08:08 -- nvmf/common.sh@119 -- # set +e 00:13:08.885 15:08:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:08.885 15:08:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:08.885 rmmod nvme_tcp 00:13:08.885 rmmod nvme_fabrics 00:13:08.885 rmmod nvme_keyring 00:13:08.885 15:08:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:08.885 15:08:09 -- nvmf/common.sh@123 -- # set -e 00:13:08.885 15:08:09 -- nvmf/common.sh@124 -- # return 0 00:13:08.885 15:08:09 -- nvmf/common.sh@477 -- # '[' -n 652492 ']' 00:13:08.885 15:08:09 -- nvmf/common.sh@478 -- # killprocess 652492 00:13:08.885 15:08:09 -- common/autotest_common.sh@936 -- # '[' -z 652492 ']' 00:13:08.885 15:08:09 -- common/autotest_common.sh@940 -- # kill -0 652492 00:13:08.885 15:08:09 -- common/autotest_common.sh@941 -- # uname 00:13:08.885 15:08:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:08.885 15:08:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 652492 00:13:08.885 15:08:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:08.885 15:08:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:08.885 15:08:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 652492' 00:13:08.885 killing process with pid 652492 00:13:08.885 15:08:09 -- common/autotest_common.sh@955 -- # kill 652492 00:13:08.885 15:08:09 -- common/autotest_common.sh@960 -- # wait 652492 00:13:09.144 15:08:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:09.144 15:08:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:09.144 15:08:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:09.144 15:08:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:09.144 15:08:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:09.144 15:08:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.144 15:08:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.144 15:08:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.680 15:08:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:11.680 00:13:11.680 real 0m6.696s 00:13:11.680 user 0m9.659s 00:13:11.680 sys 0m1.988s 00:13:11.680 15:08:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:11.680 15:08:11 -- common/autotest_common.sh@10 -- # set +x 00:13:11.680 ************************************ 00:13:11.680 END TEST nvmf_multitarget 00:13:11.680 ************************************ 00:13:11.680 15:08:11 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:11.680 15:08:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:11.680 15:08:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:11.680 15:08:11 -- common/autotest_common.sh@10 -- # set +x 00:13:11.680 ************************************ 00:13:11.680 START TEST nvmf_rpc 00:13:11.680 ************************************ 00:13:11.680 15:08:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:11.680 * Looking for test storage... 00:13:11.680 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:11.680 15:08:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:11.680 15:08:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:11.680 15:08:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:11.680 15:08:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:11.680 15:08:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:11.680 15:08:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:11.680 15:08:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:11.680 15:08:11 -- scripts/common.sh@335 -- # IFS=.-: 00:13:11.680 15:08:11 -- scripts/common.sh@335 -- # read -ra ver1 00:13:11.680 15:08:11 -- scripts/common.sh@336 -- # IFS=.-: 00:13:11.680 15:08:11 -- scripts/common.sh@336 -- # read -ra ver2 00:13:11.680 15:08:11 -- scripts/common.sh@337 -- # local 'op=<' 00:13:11.680 15:08:11 -- scripts/common.sh@339 -- # ver1_l=2 00:13:11.680 15:08:11 -- scripts/common.sh@340 -- # ver2_l=1 00:13:11.680 15:08:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:11.680 15:08:11 -- scripts/common.sh@343 -- # case "$op" in 00:13:11.680 15:08:11 -- scripts/common.sh@344 -- # : 1 00:13:11.680 15:08:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:11.680 15:08:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:11.680 15:08:11 -- scripts/common.sh@364 -- # decimal 1 00:13:11.680 15:08:11 -- scripts/common.sh@352 -- # local d=1 00:13:11.680 15:08:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:11.680 15:08:11 -- scripts/common.sh@354 -- # echo 1 00:13:11.680 15:08:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:11.680 15:08:11 -- scripts/common.sh@365 -- # decimal 2 00:13:11.680 15:08:11 -- scripts/common.sh@352 -- # local d=2 00:13:11.680 15:08:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:11.680 15:08:11 -- scripts/common.sh@354 -- # echo 2 00:13:11.680 15:08:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:11.680 15:08:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:11.680 15:08:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:11.680 15:08:11 -- scripts/common.sh@367 -- # return 0 00:13:11.680 15:08:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:11.680 15:08:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:11.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.680 --rc genhtml_branch_coverage=1 00:13:11.680 --rc genhtml_function_coverage=1 00:13:11.680 --rc genhtml_legend=1 00:13:11.680 --rc geninfo_all_blocks=1 00:13:11.680 --rc geninfo_unexecuted_blocks=1 00:13:11.680 00:13:11.680 ' 00:13:11.680 15:08:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:11.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.680 --rc genhtml_branch_coverage=1 00:13:11.680 --rc genhtml_function_coverage=1 00:13:11.680 --rc genhtml_legend=1 00:13:11.680 --rc geninfo_all_blocks=1 00:13:11.680 --rc geninfo_unexecuted_blocks=1 00:13:11.680 00:13:11.680 ' 00:13:11.680 15:08:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:11.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.680 --rc genhtml_branch_coverage=1 00:13:11.680 --rc genhtml_function_coverage=1 00:13:11.680 --rc genhtml_legend=1 00:13:11.680 --rc geninfo_all_blocks=1 00:13:11.680 --rc geninfo_unexecuted_blocks=1 00:13:11.680 00:13:11.680 ' 00:13:11.680 15:08:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:11.680 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:11.680 --rc genhtml_branch_coverage=1 00:13:11.680 --rc genhtml_function_coverage=1 00:13:11.680 --rc genhtml_legend=1 00:13:11.680 --rc geninfo_all_blocks=1 00:13:11.680 --rc geninfo_unexecuted_blocks=1 00:13:11.680 00:13:11.680 ' 00:13:11.680 15:08:11 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:11.680 15:08:11 -- nvmf/common.sh@7 -- # uname -s 00:13:11.680 15:08:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:11.680 15:08:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:11.680 15:08:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:11.680 15:08:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:11.680 15:08:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:11.680 15:08:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:11.680 15:08:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:11.680 15:08:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:11.680 15:08:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:11.680 15:08:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:11.680 15:08:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.680 15:08:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.680 15:08:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:11.680 15:08:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:11.680 15:08:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:11.680 15:08:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:11.680 15:08:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:11.680 15:08:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:11.680 15:08:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:11.680 15:08:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.680 15:08:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.680 15:08:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.680 15:08:11 -- paths/export.sh@5 -- # export PATH 00:13:11.680 15:08:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:11.680 15:08:11 -- nvmf/common.sh@46 -- # : 0 00:13:11.680 15:08:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:11.680 15:08:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:11.680 15:08:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:11.681 15:08:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:11.681 15:08:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:11.681 15:08:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:11.681 15:08:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:11.681 15:08:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:11.681 15:08:11 -- target/rpc.sh@11 -- # loops=5 00:13:11.681 15:08:11 -- target/rpc.sh@23 -- # nvmftestinit 00:13:11.681 15:08:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:11.681 15:08:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:11.681 15:08:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:11.681 15:08:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:11.681 15:08:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:11.681 15:08:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.681 15:08:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.681 15:08:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:11.681 15:08:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:11.681 15:08:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:11.681 15:08:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:11.681 15:08:11 -- common/autotest_common.sh@10 -- # set +x 00:13:13.586 15:08:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:13.586 15:08:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:13.586 15:08:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:13.586 15:08:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:13.586 15:08:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:13.586 15:08:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:13.586 15:08:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:13.586 15:08:13 -- nvmf/common.sh@294 -- # net_devs=() 00:13:13.586 15:08:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:13.586 15:08:13 -- nvmf/common.sh@295 -- # e810=() 00:13:13.586 15:08:13 -- nvmf/common.sh@295 -- # local -ga e810 00:13:13.586 15:08:13 -- nvmf/common.sh@296 -- # x722=() 00:13:13.586 15:08:13 -- nvmf/common.sh@296 -- # local -ga x722 00:13:13.586 15:08:13 -- nvmf/common.sh@297 -- # mlx=() 00:13:13.586 15:08:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:13.586 15:08:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:13.586 15:08:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:13.586 15:08:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:13.586 15:08:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:13.586 15:08:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.586 15:08:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:13.586 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:13.586 15:08:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:13.586 15:08:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:13.586 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:13.586 15:08:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:13.586 15:08:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.586 15:08:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.586 15:08:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.586 15:08:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.586 15:08:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:13.586 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:13.586 15:08:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.586 15:08:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:13.586 15:08:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:13.586 15:08:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:13.586 15:08:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:13.586 15:08:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:13.586 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:13.586 15:08:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:13.586 15:08:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:13.586 15:08:13 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:13.586 15:08:13 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:13.586 15:08:13 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:13.586 15:08:13 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:13.586 15:08:13 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:13.586 15:08:13 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:13.586 15:08:13 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:13.586 15:08:13 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:13.586 15:08:13 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:13.586 15:08:13 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:13.586 15:08:13 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:13.587 15:08:13 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:13.587 15:08:13 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:13.587 15:08:13 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:13.587 15:08:13 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:13.587 15:08:13 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:13.587 15:08:13 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:13.587 15:08:13 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:13.587 15:08:13 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:13.587 15:08:13 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:13.587 15:08:13 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:13.587 15:08:13 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:13.587 15:08:13 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:13.587 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:13.587 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:13:13.587 00:13:13.587 --- 10.0.0.2 ping statistics --- 00:13:13.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.587 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:13:13.587 15:08:13 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:13.587 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:13.587 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:13:13.587 00:13:13.587 --- 10.0.0.1 ping statistics --- 00:13:13.587 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:13.587 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:13:13.587 15:08:13 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:13.587 15:08:13 -- nvmf/common.sh@410 -- # return 0 00:13:13.587 15:08:13 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:13.587 15:08:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:13.587 15:08:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:13.587 15:08:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:13.587 15:08:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:13.587 15:08:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:13.587 15:08:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:13.587 15:08:13 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:13.587 15:08:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:13.587 15:08:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:13.587 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:13.587 15:08:13 -- nvmf/common.sh@469 -- # nvmfpid=654662 00:13:13.587 15:08:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:13.587 15:08:13 -- nvmf/common.sh@470 -- # waitforlisten 654662 00:13:13.587 15:08:13 -- common/autotest_common.sh@829 -- # '[' -z 654662 ']' 00:13:13.587 15:08:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:13.587 15:08:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:13.587 15:08:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:13.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:13.587 15:08:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:13.587 15:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:13.587 [2024-11-28 15:08:13.758798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:13.587 [2024-11-28 15:08:13.758901] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:13.587 EAL: No free 2048 kB hugepages reported on node 1 00:13:13.847 [2024-11-28 15:08:13.831578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:13.847 [2024-11-28 15:08:13.928234] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:13.847 [2024-11-28 15:08:13.928425] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:13.847 [2024-11-28 15:08:13.928446] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:13.847 [2024-11-28 15:08:13.928462] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:13.847 [2024-11-28 15:08:13.928534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:13.847 [2024-11-28 15:08:13.928589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:13.847 [2024-11-28 15:08:13.928641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:13.847 [2024-11-28 15:08:13.928644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:14.781 15:08:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:14.781 15:08:14 -- common/autotest_common.sh@862 -- # return 0 00:13:14.781 15:08:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:14.781 15:08:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:14.781 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.781 15:08:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:14.781 15:08:14 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:14.781 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.781 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.781 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.781 15:08:14 -- target/rpc.sh@26 -- # stats='{ 00:13:14.781 "tick_rate": 2700000000, 00:13:14.781 "poll_groups": [ 00:13:14.781 { 00:13:14.781 "name": "nvmf_tgt_poll_group_0", 00:13:14.781 "admin_qpairs": 0, 00:13:14.781 "io_qpairs": 0, 00:13:14.781 "current_admin_qpairs": 0, 00:13:14.781 "current_io_qpairs": 0, 00:13:14.781 "pending_bdev_io": 0, 00:13:14.781 "completed_nvme_io": 0, 00:13:14.781 "transports": [] 00:13:14.781 }, 00:13:14.781 { 00:13:14.781 "name": "nvmf_tgt_poll_group_1", 00:13:14.781 "admin_qpairs": 0, 00:13:14.781 "io_qpairs": 0, 00:13:14.781 "current_admin_qpairs": 0, 00:13:14.781 "current_io_qpairs": 0, 00:13:14.781 "pending_bdev_io": 0, 00:13:14.781 "completed_nvme_io": 0, 00:13:14.781 "transports": [] 00:13:14.781 }, 00:13:14.781 { 00:13:14.781 "name": "nvmf_tgt_poll_group_2", 00:13:14.781 "admin_qpairs": 0, 00:13:14.781 "io_qpairs": 0, 00:13:14.781 "current_admin_qpairs": 0, 00:13:14.781 "current_io_qpairs": 0, 00:13:14.781 "pending_bdev_io": 0, 00:13:14.781 "completed_nvme_io": 0, 00:13:14.781 "transports": [] 00:13:14.781 }, 00:13:14.781 { 00:13:14.781 "name": "nvmf_tgt_poll_group_3", 00:13:14.781 "admin_qpairs": 0, 00:13:14.781 "io_qpairs": 0, 00:13:14.781 "current_admin_qpairs": 0, 00:13:14.781 "current_io_qpairs": 0, 00:13:14.781 "pending_bdev_io": 0, 00:13:14.781 "completed_nvme_io": 0, 00:13:14.781 "transports": [] 00:13:14.781 } 00:13:14.781 ] 00:13:14.781 }' 00:13:14.781 15:08:14 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:14.781 15:08:14 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:14.781 15:08:14 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:14.781 15:08:14 -- target/rpc.sh@15 -- # wc -l 00:13:14.781 15:08:14 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:14.781 15:08:14 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:14.782 15:08:14 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:14.782 15:08:14 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 [2024-11-28 15:08:14.842041] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:14.782 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:14 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:14 -- target/rpc.sh@33 -- # stats='{ 00:13:14.782 "tick_rate": 2700000000, 00:13:14.782 "poll_groups": [ 00:13:14.782 { 00:13:14.782 "name": "nvmf_tgt_poll_group_0", 00:13:14.782 "admin_qpairs": 0, 00:13:14.782 "io_qpairs": 0, 00:13:14.782 "current_admin_qpairs": 0, 00:13:14.782 "current_io_qpairs": 0, 00:13:14.782 "pending_bdev_io": 0, 00:13:14.782 "completed_nvme_io": 0, 00:13:14.782 "transports": [ 00:13:14.782 { 00:13:14.782 "trtype": "TCP" 00:13:14.782 } 00:13:14.782 ] 00:13:14.782 }, 00:13:14.782 { 00:13:14.782 "name": "nvmf_tgt_poll_group_1", 00:13:14.782 "admin_qpairs": 0, 00:13:14.782 "io_qpairs": 0, 00:13:14.782 "current_admin_qpairs": 0, 00:13:14.782 "current_io_qpairs": 0, 00:13:14.782 "pending_bdev_io": 0, 00:13:14.782 "completed_nvme_io": 0, 00:13:14.782 "transports": [ 00:13:14.782 { 00:13:14.782 "trtype": "TCP" 00:13:14.782 } 00:13:14.782 ] 00:13:14.782 }, 00:13:14.782 { 00:13:14.782 "name": "nvmf_tgt_poll_group_2", 00:13:14.782 "admin_qpairs": 0, 00:13:14.782 "io_qpairs": 0, 00:13:14.782 "current_admin_qpairs": 0, 00:13:14.782 "current_io_qpairs": 0, 00:13:14.782 "pending_bdev_io": 0, 00:13:14.782 "completed_nvme_io": 0, 00:13:14.782 "transports": [ 00:13:14.782 { 00:13:14.782 "trtype": "TCP" 00:13:14.782 } 00:13:14.782 ] 00:13:14.782 }, 00:13:14.782 { 00:13:14.782 "name": "nvmf_tgt_poll_group_3", 00:13:14.782 "admin_qpairs": 0, 00:13:14.782 "io_qpairs": 0, 00:13:14.782 "current_admin_qpairs": 0, 00:13:14.782 "current_io_qpairs": 0, 00:13:14.782 "pending_bdev_io": 0, 00:13:14.782 "completed_nvme_io": 0, 00:13:14.782 "transports": [ 00:13:14.782 { 00:13:14.782 "trtype": "TCP" 00:13:14.782 } 00:13:14.782 ] 00:13:14.782 } 00:13:14.782 ] 00:13:14.782 }' 00:13:14.782 15:08:14 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:14.782 15:08:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:14.782 15:08:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:14.782 15:08:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:14.782 15:08:14 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:14.782 15:08:14 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:14.782 15:08:14 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:14.782 15:08:14 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:14.782 15:08:14 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:14.782 15:08:14 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:14.782 15:08:14 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:14.782 15:08:14 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:14.782 15:08:14 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:14.782 15:08:14 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 Malloc1 00:13:14.782 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:14 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:14 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:14 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 15:08:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:14 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:14.782 15:08:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:14.782 15:08:14 -- common/autotest_common.sh@10 -- # set +x 00:13:14.782 [2024-11-28 15:08:14.998397] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:14.782 15:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:14.782 15:08:15 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:14.782 15:08:15 -- common/autotest_common.sh@650 -- # local es=0 00:13:14.782 15:08:15 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:14.782 15:08:15 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:14.782 15:08:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:14.782 15:08:15 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:14.782 15:08:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:14.782 15:08:15 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:14.782 15:08:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:14.782 15:08:15 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:14.782 15:08:15 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:14.782 15:08:15 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:15.040 [2024-11-28 15:08:15.020921] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:15.040 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:15.040 could not add new controller: failed to write to nvme-fabrics device 00:13:15.040 15:08:15 -- common/autotest_common.sh@653 -- # es=1 00:13:15.040 15:08:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:15.040 15:08:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:15.040 15:08:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:15.040 15:08:15 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:15.040 15:08:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:15.040 15:08:15 -- common/autotest_common.sh@10 -- # set +x 00:13:15.040 15:08:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:15.040 15:08:15 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:15.605 15:08:15 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:15.605 15:08:15 -- common/autotest_common.sh@1187 -- # local i=0 00:13:15.605 15:08:15 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:15.605 15:08:15 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:15.605 15:08:15 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:18.134 15:08:17 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:18.134 15:08:17 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:18.134 15:08:17 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:18.134 15:08:17 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:18.134 15:08:17 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:18.134 15:08:17 -- common/autotest_common.sh@1197 -- # return 0 00:13:18.134 15:08:17 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:18.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:18.134 15:08:17 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:18.134 15:08:17 -- common/autotest_common.sh@1208 -- # local i=0 00:13:18.134 15:08:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:18.134 15:08:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:18.134 15:08:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:18.134 15:08:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:18.134 15:08:17 -- common/autotest_common.sh@1220 -- # return 0 00:13:18.134 15:08:17 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:18.134 15:08:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.134 15:08:17 -- common/autotest_common.sh@10 -- # set +x 00:13:18.134 15:08:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.134 15:08:17 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.134 15:08:17 -- common/autotest_common.sh@650 -- # local es=0 00:13:18.134 15:08:17 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.134 15:08:17 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:18.134 15:08:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:18.134 15:08:17 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:18.134 15:08:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:18.134 15:08:17 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:18.134 15:08:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:18.134 15:08:17 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:18.134 15:08:17 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:18.134 15:08:17 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.134 [2024-11-28 15:08:17.859815] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:18.134 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:18.134 could not add new controller: failed to write to nvme-fabrics device 00:13:18.134 15:08:17 -- common/autotest_common.sh@653 -- # es=1 00:13:18.134 15:08:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:18.134 15:08:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:18.134 15:08:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:18.134 15:08:17 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:18.134 15:08:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:18.134 15:08:17 -- common/autotest_common.sh@10 -- # set +x 00:13:18.134 15:08:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:18.134 15:08:17 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:18.392 15:08:18 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:18.392 15:08:18 -- common/autotest_common.sh@1187 -- # local i=0 00:13:18.392 15:08:18 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:18.392 15:08:18 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:18.393 15:08:18 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:20.291 15:08:20 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:20.291 15:08:20 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:20.291 15:08:20 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:20.291 15:08:20 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:20.291 15:08:20 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:20.291 15:08:20 -- common/autotest_common.sh@1197 -- # return 0 00:13:20.291 15:08:20 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:20.549 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:20.549 15:08:20 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:20.549 15:08:20 -- common/autotest_common.sh@1208 -- # local i=0 00:13:20.549 15:08:20 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:20.549 15:08:20 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.549 15:08:20 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:20.549 15:08:20 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:20.549 15:08:20 -- common/autotest_common.sh@1220 -- # return 0 00:13:20.549 15:08:20 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:20.549 15:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.549 15:08:20 -- common/autotest_common.sh@10 -- # set +x 00:13:20.549 15:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.549 15:08:20 -- target/rpc.sh@81 -- # seq 1 5 00:13:20.549 15:08:20 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:20.549 15:08:20 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:20.549 15:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.549 15:08:20 -- common/autotest_common.sh@10 -- # set +x 00:13:20.549 15:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.549 15:08:20 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:20.549 15:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.549 15:08:20 -- common/autotest_common.sh@10 -- # set +x 00:13:20.549 [2024-11-28 15:08:20.645850] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:20.549 15:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.549 15:08:20 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:20.549 15:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.549 15:08:20 -- common/autotest_common.sh@10 -- # set +x 00:13:20.549 15:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.549 15:08:20 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:20.549 15:08:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:20.549 15:08:20 -- common/autotest_common.sh@10 -- # set +x 00:13:20.549 15:08:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:20.549 15:08:20 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:21.115 15:08:21 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:21.115 15:08:21 -- common/autotest_common.sh@1187 -- # local i=0 00:13:21.115 15:08:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:21.115 15:08:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:21.115 15:08:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:23.641 15:08:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:23.641 15:08:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:23.641 15:08:23 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:23.641 15:08:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:23.641 15:08:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:23.641 15:08:23 -- common/autotest_common.sh@1197 -- # return 0 00:13:23.641 15:08:23 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:23.641 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:23.641 15:08:23 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:23.641 15:08:23 -- common/autotest_common.sh@1208 -- # local i=0 00:13:23.641 15:08:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:23.641 15:08:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.641 15:08:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:23.641 15:08:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:23.641 15:08:23 -- common/autotest_common.sh@1220 -- # return 0 00:13:23.641 15:08:23 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.641 15:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.641 15:08:23 -- common/autotest_common.sh@10 -- # set +x 00:13:23.641 15:08:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.641 15:08:23 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:23.641 15:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.641 15:08:23 -- common/autotest_common.sh@10 -- # set +x 00:13:23.641 15:08:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.641 15:08:23 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:23.641 15:08:23 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:23.641 15:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.641 15:08:23 -- common/autotest_common.sh@10 -- # set +x 00:13:23.641 15:08:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.641 15:08:23 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:23.641 15:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.641 15:08:23 -- common/autotest_common.sh@10 -- # set +x 00:13:23.641 [2024-11-28 15:08:23.474699] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:23.641 15:08:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.641 15:08:23 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:23.641 15:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.641 15:08:23 -- common/autotest_common.sh@10 -- # set +x 00:13:23.641 15:08:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.641 15:08:23 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:23.641 15:08:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:23.641 15:08:23 -- common/autotest_common.sh@10 -- # set +x 00:13:23.641 15:08:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:23.641 15:08:23 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:24.207 15:08:24 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:24.207 15:08:24 -- common/autotest_common.sh@1187 -- # local i=0 00:13:24.207 15:08:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:24.207 15:08:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:24.207 15:08:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:26.105 15:08:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:26.105 15:08:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:26.105 15:08:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:26.105 15:08:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:26.105 15:08:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:26.105 15:08:26 -- common/autotest_common.sh@1197 -- # return 0 00:13:26.105 15:08:26 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:26.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:26.105 15:08:26 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:26.105 15:08:26 -- common/autotest_common.sh@1208 -- # local i=0 00:13:26.105 15:08:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:26.105 15:08:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.105 15:08:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:26.105 15:08:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:26.105 15:08:26 -- common/autotest_common.sh@1220 -- # return 0 00:13:26.105 15:08:26 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.105 15:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.105 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:26.105 15:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.105 15:08:26 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:26.105 15:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.105 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:26.105 15:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.105 15:08:26 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:26.105 15:08:26 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:26.105 15:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.105 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:26.105 15:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.105 15:08:26 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:26.105 15:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.105 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:26.105 [2024-11-28 15:08:26.295204] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:26.105 15:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.105 15:08:26 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:26.105 15:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.105 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:26.105 15:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.105 15:08:26 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:26.105 15:08:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:26.105 15:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:26.105 15:08:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:26.105 15:08:26 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:27.040 15:08:26 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:27.040 15:08:26 -- common/autotest_common.sh@1187 -- # local i=0 00:13:27.040 15:08:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:27.040 15:08:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:27.040 15:08:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:28.939 15:08:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:28.939 15:08:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:28.939 15:08:28 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:28.939 15:08:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:28.939 15:08:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:28.939 15:08:28 -- common/autotest_common.sh@1197 -- # return 0 00:13:28.939 15:08:28 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:28.939 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:28.939 15:08:29 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:28.939 15:08:29 -- common/autotest_common.sh@1208 -- # local i=0 00:13:28.939 15:08:29 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:28.939 15:08:29 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:28.939 15:08:29 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:28.939 15:08:29 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:28.939 15:08:29 -- common/autotest_common.sh@1220 -- # return 0 00:13:28.939 15:08:29 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:28.939 15:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.939 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.939 15:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.939 15:08:29 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:28.939 15:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.939 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.939 15:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.939 15:08:29 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:28.939 15:08:29 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:28.939 15:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.939 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.939 15:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.939 15:08:29 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:28.939 15:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.939 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.939 [2024-11-28 15:08:29.066863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:28.939 15:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.939 15:08:29 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:28.939 15:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.939 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.939 15:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.939 15:08:29 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:28.939 15:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.939 15:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:28.939 15:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.939 15:08:29 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:29.505 15:08:29 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:29.505 15:08:29 -- common/autotest_common.sh@1187 -- # local i=0 00:13:29.505 15:08:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:29.505 15:08:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:29.505 15:08:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:31.535 15:08:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:31.535 15:08:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:31.536 15:08:31 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:31.536 15:08:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:31.536 15:08:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:31.536 15:08:31 -- common/autotest_common.sh@1197 -- # return 0 00:13:31.536 15:08:31 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:31.794 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:31.794 15:08:31 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:31.794 15:08:31 -- common/autotest_common.sh@1208 -- # local i=0 00:13:31.794 15:08:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:31.794 15:08:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:31.794 15:08:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:31.794 15:08:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:31.794 15:08:31 -- common/autotest_common.sh@1220 -- # return 0 00:13:31.794 15:08:31 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:31.794 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.794 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:13:31.794 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.794 15:08:31 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.794 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.794 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:13:31.794 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.794 15:08:31 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:31.794 15:08:31 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.794 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.794 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:13:31.794 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.794 15:08:31 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.794 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.794 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:13:31.794 [2024-11-28 15:08:31.846860] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.794 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.794 15:08:31 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:31.794 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.794 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:13:31.794 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.794 15:08:31 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.794 15:08:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.794 15:08:31 -- common/autotest_common.sh@10 -- # set +x 00:13:31.794 15:08:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.794 15:08:31 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:32.360 15:08:32 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:32.360 15:08:32 -- common/autotest_common.sh@1187 -- # local i=0 00:13:32.360 15:08:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:32.360 15:08:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:32.360 15:08:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:34.260 15:08:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:34.260 15:08:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:34.260 15:08:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:34.260 15:08:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:34.260 15:08:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:34.260 15:08:34 -- common/autotest_common.sh@1197 -- # return 0 00:13:34.260 15:08:34 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:34.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:34.518 15:08:34 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:34.518 15:08:34 -- common/autotest_common.sh@1208 -- # local i=0 00:13:34.518 15:08:34 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:34.518 15:08:34 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:34.518 15:08:34 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:34.518 15:08:34 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:34.518 15:08:34 -- common/autotest_common.sh@1220 -- # return 0 00:13:34.518 15:08:34 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:34.518 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.518 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@99 -- # seq 1 5 00:13:34.519 15:08:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.519 15:08:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 [2024-11-28 15:08:34.583628] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.519 15:08:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 [2024-11-28 15:08:34.631673] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.519 15:08:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 [2024-11-28 15:08:34.679848] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.519 15:08:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 [2024-11-28 15:08:34.728007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.519 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.519 15:08:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.519 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.519 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:34.778 15:08:34 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 [2024-11-28 15:08:34.776208] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:34.778 15:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.778 15:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.778 15:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.778 15:08:34 -- target/rpc.sh@110 -- # stats='{ 00:13:34.778 "tick_rate": 2700000000, 00:13:34.778 "poll_groups": [ 00:13:34.778 { 00:13:34.778 "name": "nvmf_tgt_poll_group_0", 00:13:34.778 "admin_qpairs": 2, 00:13:34.778 "io_qpairs": 84, 00:13:34.778 "current_admin_qpairs": 0, 00:13:34.778 "current_io_qpairs": 0, 00:13:34.778 "pending_bdev_io": 0, 00:13:34.778 "completed_nvme_io": 185, 00:13:34.778 "transports": [ 00:13:34.778 { 00:13:34.778 "trtype": "TCP" 00:13:34.778 } 00:13:34.778 ] 00:13:34.778 }, 00:13:34.778 { 00:13:34.778 "name": "nvmf_tgt_poll_group_1", 00:13:34.778 "admin_qpairs": 2, 00:13:34.778 "io_qpairs": 84, 00:13:34.778 "current_admin_qpairs": 0, 00:13:34.778 "current_io_qpairs": 0, 00:13:34.778 "pending_bdev_io": 0, 00:13:34.778 "completed_nvme_io": 136, 00:13:34.778 "transports": [ 00:13:34.778 { 00:13:34.778 "trtype": "TCP" 00:13:34.778 } 00:13:34.778 ] 00:13:34.778 }, 00:13:34.778 { 00:13:34.778 "name": "nvmf_tgt_poll_group_2", 00:13:34.778 "admin_qpairs": 1, 00:13:34.778 "io_qpairs": 84, 00:13:34.778 "current_admin_qpairs": 0, 00:13:34.778 "current_io_qpairs": 0, 00:13:34.778 "pending_bdev_io": 0, 00:13:34.778 "completed_nvme_io": 185, 00:13:34.778 "transports": [ 00:13:34.778 { 00:13:34.778 "trtype": "TCP" 00:13:34.778 } 00:13:34.778 ] 00:13:34.778 }, 00:13:34.778 { 00:13:34.778 "name": "nvmf_tgt_poll_group_3", 00:13:34.778 "admin_qpairs": 2, 00:13:34.778 "io_qpairs": 84, 00:13:34.778 "current_admin_qpairs": 0, 00:13:34.778 "current_io_qpairs": 0, 00:13:34.778 "pending_bdev_io": 0, 00:13:34.778 "completed_nvme_io": 180, 00:13:34.778 "transports": [ 00:13:34.778 { 00:13:34.778 "trtype": "TCP" 00:13:34.778 } 00:13:34.778 ] 00:13:34.778 } 00:13:34.778 ] 00:13:34.778 }' 00:13:34.778 15:08:34 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:34.778 15:08:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:34.778 15:08:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:34.778 15:08:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:34.778 15:08:34 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:34.778 15:08:34 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:34.778 15:08:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:34.778 15:08:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:34.778 15:08:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:34.778 15:08:34 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:34.778 15:08:34 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:34.778 15:08:34 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:34.778 15:08:34 -- target/rpc.sh@123 -- # nvmftestfini 00:13:34.778 15:08:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:34.778 15:08:34 -- nvmf/common.sh@116 -- # sync 00:13:34.778 15:08:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:34.778 15:08:34 -- nvmf/common.sh@119 -- # set +e 00:13:34.779 15:08:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:34.779 15:08:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:34.779 rmmod nvme_tcp 00:13:34.779 rmmod nvme_fabrics 00:13:34.779 rmmod nvme_keyring 00:13:34.779 15:08:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:34.779 15:08:34 -- nvmf/common.sh@123 -- # set -e 00:13:34.779 15:08:34 -- nvmf/common.sh@124 -- # return 0 00:13:34.779 15:08:34 -- nvmf/common.sh@477 -- # '[' -n 654662 ']' 00:13:34.779 15:08:34 -- nvmf/common.sh@478 -- # killprocess 654662 00:13:34.779 15:08:34 -- common/autotest_common.sh@936 -- # '[' -z 654662 ']' 00:13:34.779 15:08:34 -- common/autotest_common.sh@940 -- # kill -0 654662 00:13:34.779 15:08:34 -- common/autotest_common.sh@941 -- # uname 00:13:34.779 15:08:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:34.779 15:08:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 654662 00:13:34.779 15:08:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:34.779 15:08:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:34.779 15:08:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 654662' 00:13:34.779 killing process with pid 654662 00:13:34.779 15:08:35 -- common/autotest_common.sh@955 -- # kill 654662 00:13:34.779 15:08:35 -- common/autotest_common.sh@960 -- # wait 654662 00:13:35.041 15:08:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:35.041 15:08:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:35.041 15:08:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:35.042 15:08:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:35.042 15:08:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:35.042 15:08:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:35.042 15:08:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:35.042 15:08:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.583 15:08:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:37.583 00:13:37.583 real 0m25.917s 00:13:37.583 user 1m24.757s 00:13:37.583 sys 0m4.226s 00:13:37.583 15:08:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:37.583 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:13:37.583 ************************************ 00:13:37.583 END TEST nvmf_rpc 00:13:37.583 ************************************ 00:13:37.583 15:08:37 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:37.583 15:08:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:37.583 15:08:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:37.583 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:13:37.583 ************************************ 00:13:37.583 START TEST nvmf_invalid 00:13:37.583 ************************************ 00:13:37.583 15:08:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:37.583 * Looking for test storage... 00:13:37.583 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:37.583 15:08:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:37.583 15:08:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:37.583 15:08:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:37.583 15:08:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:37.583 15:08:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:37.583 15:08:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:37.583 15:08:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:37.583 15:08:37 -- scripts/common.sh@335 -- # IFS=.-: 00:13:37.583 15:08:37 -- scripts/common.sh@335 -- # read -ra ver1 00:13:37.583 15:08:37 -- scripts/common.sh@336 -- # IFS=.-: 00:13:37.583 15:08:37 -- scripts/common.sh@336 -- # read -ra ver2 00:13:37.583 15:08:37 -- scripts/common.sh@337 -- # local 'op=<' 00:13:37.583 15:08:37 -- scripts/common.sh@339 -- # ver1_l=2 00:13:37.583 15:08:37 -- scripts/common.sh@340 -- # ver2_l=1 00:13:37.583 15:08:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:37.583 15:08:37 -- scripts/common.sh@343 -- # case "$op" in 00:13:37.583 15:08:37 -- scripts/common.sh@344 -- # : 1 00:13:37.583 15:08:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:37.583 15:08:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:37.583 15:08:37 -- scripts/common.sh@364 -- # decimal 1 00:13:37.583 15:08:37 -- scripts/common.sh@352 -- # local d=1 00:13:37.583 15:08:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:37.583 15:08:37 -- scripts/common.sh@354 -- # echo 1 00:13:37.583 15:08:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:37.583 15:08:37 -- scripts/common.sh@365 -- # decimal 2 00:13:37.583 15:08:37 -- scripts/common.sh@352 -- # local d=2 00:13:37.583 15:08:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:37.583 15:08:37 -- scripts/common.sh@354 -- # echo 2 00:13:37.583 15:08:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:37.583 15:08:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:37.583 15:08:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:37.583 15:08:37 -- scripts/common.sh@367 -- # return 0 00:13:37.583 15:08:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:37.583 15:08:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:37.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.583 --rc genhtml_branch_coverage=1 00:13:37.583 --rc genhtml_function_coverage=1 00:13:37.583 --rc genhtml_legend=1 00:13:37.583 --rc geninfo_all_blocks=1 00:13:37.583 --rc geninfo_unexecuted_blocks=1 00:13:37.583 00:13:37.583 ' 00:13:37.583 15:08:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:37.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.583 --rc genhtml_branch_coverage=1 00:13:37.583 --rc genhtml_function_coverage=1 00:13:37.583 --rc genhtml_legend=1 00:13:37.583 --rc geninfo_all_blocks=1 00:13:37.583 --rc geninfo_unexecuted_blocks=1 00:13:37.583 00:13:37.583 ' 00:13:37.583 15:08:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:37.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.583 --rc genhtml_branch_coverage=1 00:13:37.583 --rc genhtml_function_coverage=1 00:13:37.583 --rc genhtml_legend=1 00:13:37.583 --rc geninfo_all_blocks=1 00:13:37.583 --rc geninfo_unexecuted_blocks=1 00:13:37.583 00:13:37.583 ' 00:13:37.583 15:08:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:37.583 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:37.583 --rc genhtml_branch_coverage=1 00:13:37.583 --rc genhtml_function_coverage=1 00:13:37.583 --rc genhtml_legend=1 00:13:37.583 --rc geninfo_all_blocks=1 00:13:37.583 --rc geninfo_unexecuted_blocks=1 00:13:37.583 00:13:37.583 ' 00:13:37.583 15:08:37 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:37.583 15:08:37 -- nvmf/common.sh@7 -- # uname -s 00:13:37.583 15:08:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:37.583 15:08:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:37.583 15:08:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:37.583 15:08:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:37.583 15:08:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:37.583 15:08:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:37.583 15:08:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:37.583 15:08:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:37.583 15:08:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:37.583 15:08:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:37.583 15:08:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.583 15:08:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:37.583 15:08:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:37.583 15:08:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:37.583 15:08:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:37.583 15:08:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:37.583 15:08:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:37.583 15:08:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:37.583 15:08:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:37.583 15:08:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.583 15:08:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.583 15:08:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.583 15:08:37 -- paths/export.sh@5 -- # export PATH 00:13:37.583 15:08:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:37.583 15:08:37 -- nvmf/common.sh@46 -- # : 0 00:13:37.583 15:08:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:37.583 15:08:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:37.583 15:08:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:37.583 15:08:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:37.583 15:08:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:37.583 15:08:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:37.583 15:08:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:37.583 15:08:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:37.583 15:08:37 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:37.583 15:08:37 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:37.583 15:08:37 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:37.583 15:08:37 -- target/invalid.sh@14 -- # target=foobar 00:13:37.583 15:08:37 -- target/invalid.sh@16 -- # RANDOM=0 00:13:37.583 15:08:37 -- target/invalid.sh@34 -- # nvmftestinit 00:13:37.583 15:08:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:37.583 15:08:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:37.583 15:08:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:37.583 15:08:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:37.583 15:08:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:37.583 15:08:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:37.583 15:08:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:37.583 15:08:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:37.584 15:08:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:37.584 15:08:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:37.584 15:08:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:37.584 15:08:37 -- common/autotest_common.sh@10 -- # set +x 00:13:39.488 15:08:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:39.488 15:08:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:39.488 15:08:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:39.488 15:08:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:39.488 15:08:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:39.489 15:08:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:39.489 15:08:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:39.489 15:08:39 -- nvmf/common.sh@294 -- # net_devs=() 00:13:39.489 15:08:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:39.489 15:08:39 -- nvmf/common.sh@295 -- # e810=() 00:13:39.489 15:08:39 -- nvmf/common.sh@295 -- # local -ga e810 00:13:39.489 15:08:39 -- nvmf/common.sh@296 -- # x722=() 00:13:39.489 15:08:39 -- nvmf/common.sh@296 -- # local -ga x722 00:13:39.489 15:08:39 -- nvmf/common.sh@297 -- # mlx=() 00:13:39.489 15:08:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:39.489 15:08:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:39.489 15:08:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:39.489 15:08:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:39.489 15:08:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:39.489 15:08:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.489 15:08:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:39.489 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:39.489 15:08:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:39.489 15:08:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:39.489 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:39.489 15:08:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:39.489 15:08:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.489 15:08:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.489 15:08:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.489 15:08:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.489 15:08:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:39.489 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:39.489 15:08:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.489 15:08:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:39.489 15:08:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:39.489 15:08:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:39.489 15:08:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:39.489 15:08:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:39.489 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:39.489 15:08:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:39.489 15:08:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:39.489 15:08:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:39.489 15:08:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:39.489 15:08:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:39.489 15:08:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:39.489 15:08:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:39.489 15:08:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:39.489 15:08:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:39.489 15:08:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:39.489 15:08:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:39.489 15:08:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:39.489 15:08:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:39.489 15:08:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:39.489 15:08:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:39.489 15:08:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:39.489 15:08:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:39.489 15:08:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:39.489 15:08:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:39.489 15:08:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:39.489 15:08:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:39.489 15:08:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:39.489 15:08:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:39.489 15:08:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:39.489 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:39.489 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.404 ms 00:13:39.489 00:13:39.489 --- 10.0.0.2 ping statistics --- 00:13:39.489 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.489 rtt min/avg/max/mdev = 0.404/0.404/0.404/0.000 ms 00:13:39.489 15:08:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:39.489 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:39.489 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:13:39.489 00:13:39.489 --- 10.0.0.1 ping statistics --- 00:13:39.489 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:39.489 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:13:39.489 15:08:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:39.489 15:08:39 -- nvmf/common.sh@410 -- # return 0 00:13:39.489 15:08:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:39.489 15:08:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:39.489 15:08:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:39.489 15:08:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:39.489 15:08:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:39.489 15:08:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:39.748 15:08:39 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:39.748 15:08:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:39.748 15:08:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:39.748 15:08:39 -- common/autotest_common.sh@10 -- # set +x 00:13:39.748 15:08:39 -- nvmf/common.sh@469 -- # nvmfpid=659369 00:13:39.748 15:08:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:39.748 15:08:39 -- nvmf/common.sh@470 -- # waitforlisten 659369 00:13:39.748 15:08:39 -- common/autotest_common.sh@829 -- # '[' -z 659369 ']' 00:13:39.748 15:08:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:39.748 15:08:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:39.748 15:08:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:39.748 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:39.748 15:08:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:39.748 15:08:39 -- common/autotest_common.sh@10 -- # set +x 00:13:39.748 [2024-11-28 15:08:39.786365] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:39.748 [2024-11-28 15:08:39.786452] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:39.748 EAL: No free 2048 kB hugepages reported on node 1 00:13:39.748 [2024-11-28 15:08:39.850055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:39.748 [2024-11-28 15:08:39.939350] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:39.748 [2024-11-28 15:08:39.939493] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:39.748 [2024-11-28 15:08:39.939518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:39.748 [2024-11-28 15:08:39.939532] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:39.748 [2024-11-28 15:08:39.939598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:39.748 [2024-11-28 15:08:39.939658] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:39.748 [2024-11-28 15:08:39.939709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:39.748 [2024-11-28 15:08:39.939712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:40.681 15:08:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:40.681 15:08:40 -- common/autotest_common.sh@862 -- # return 0 00:13:40.681 15:08:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:40.681 15:08:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:40.681 15:08:40 -- common/autotest_common.sh@10 -- # set +x 00:13:40.681 15:08:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:40.681 15:08:40 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:40.681 15:08:40 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode22615 00:13:40.941 [2024-11-28 15:08:41.009481] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:40.942 15:08:41 -- target/invalid.sh@40 -- # out='request: 00:13:40.942 { 00:13:40.942 "nqn": "nqn.2016-06.io.spdk:cnode22615", 00:13:40.942 "tgt_name": "foobar", 00:13:40.942 "method": "nvmf_create_subsystem", 00:13:40.942 "req_id": 1 00:13:40.942 } 00:13:40.942 Got JSON-RPC error response 00:13:40.942 response: 00:13:40.942 { 00:13:40.942 "code": -32603, 00:13:40.942 "message": "Unable to find target foobar" 00:13:40.942 }' 00:13:40.942 15:08:41 -- target/invalid.sh@41 -- # [[ request: 00:13:40.942 { 00:13:40.942 "nqn": "nqn.2016-06.io.spdk:cnode22615", 00:13:40.942 "tgt_name": "foobar", 00:13:40.942 "method": "nvmf_create_subsystem", 00:13:40.942 "req_id": 1 00:13:40.942 } 00:13:40.942 Got JSON-RPC error response 00:13:40.942 response: 00:13:40.942 { 00:13:40.942 "code": -32603, 00:13:40.942 "message": "Unable to find target foobar" 00:13:40.942 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:40.942 15:08:41 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:40.942 15:08:41 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode14241 00:13:41.199 [2024-11-28 15:08:41.286389] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14241: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:41.199 15:08:41 -- target/invalid.sh@45 -- # out='request: 00:13:41.199 { 00:13:41.199 "nqn": "nqn.2016-06.io.spdk:cnode14241", 00:13:41.199 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:41.199 "method": "nvmf_create_subsystem", 00:13:41.199 "req_id": 1 00:13:41.199 } 00:13:41.199 Got JSON-RPC error response 00:13:41.199 response: 00:13:41.199 { 00:13:41.199 "code": -32602, 00:13:41.199 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:41.199 }' 00:13:41.199 15:08:41 -- target/invalid.sh@46 -- # [[ request: 00:13:41.199 { 00:13:41.199 "nqn": "nqn.2016-06.io.spdk:cnode14241", 00:13:41.199 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:41.199 "method": "nvmf_create_subsystem", 00:13:41.199 "req_id": 1 00:13:41.199 } 00:13:41.199 Got JSON-RPC error response 00:13:41.199 response: 00:13:41.199 { 00:13:41.199 "code": -32602, 00:13:41.199 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:41.199 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:41.199 15:08:41 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:41.199 15:08:41 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode4650 00:13:41.457 [2024-11-28 15:08:41.535184] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4650: invalid model number 'SPDK_Controller' 00:13:41.457 15:08:41 -- target/invalid.sh@50 -- # out='request: 00:13:41.457 { 00:13:41.457 "nqn": "nqn.2016-06.io.spdk:cnode4650", 00:13:41.457 "model_number": "SPDK_Controller\u001f", 00:13:41.457 "method": "nvmf_create_subsystem", 00:13:41.457 "req_id": 1 00:13:41.457 } 00:13:41.457 Got JSON-RPC error response 00:13:41.457 response: 00:13:41.457 { 00:13:41.457 "code": -32602, 00:13:41.457 "message": "Invalid MN SPDK_Controller\u001f" 00:13:41.457 }' 00:13:41.457 15:08:41 -- target/invalid.sh@51 -- # [[ request: 00:13:41.457 { 00:13:41.457 "nqn": "nqn.2016-06.io.spdk:cnode4650", 00:13:41.457 "model_number": "SPDK_Controller\u001f", 00:13:41.457 "method": "nvmf_create_subsystem", 00:13:41.457 "req_id": 1 00:13:41.457 } 00:13:41.457 Got JSON-RPC error response 00:13:41.458 response: 00:13:41.458 { 00:13:41.458 "code": -32602, 00:13:41.458 "message": "Invalid MN SPDK_Controller\u001f" 00:13:41.458 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:41.458 15:08:41 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:41.458 15:08:41 -- target/invalid.sh@19 -- # local length=21 ll 00:13:41.458 15:08:41 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:41.458 15:08:41 -- target/invalid.sh@21 -- # local chars 00:13:41.458 15:08:41 -- target/invalid.sh@22 -- # local string 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 122 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=z 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 115 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=s 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 103 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=g 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 83 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=S 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 50 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=2 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 35 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x23' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+='#' 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 94 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x5e' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+='^' 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 60 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+='<' 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 119 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x77' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=w 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 97 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=a 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 117 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=u 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 46 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=. 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 49 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x31' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=1 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 66 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x42' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=B 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 60 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+='<' 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 110 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=n 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 39 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=\' 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 113 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=q 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 121 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=y 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 106 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=j 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # printf %x 53 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # echo -e '\x35' 00:13:41.458 15:08:41 -- target/invalid.sh@25 -- # string+=5 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:41.458 15:08:41 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:41.458 15:08:41 -- target/invalid.sh@28 -- # [[ z == \- ]] 00:13:41.458 15:08:41 -- target/invalid.sh@31 -- # echo 'zsgS2#^Zu={9N6%K,$~G' 00:13:41.975 15:08:41 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d '$"{p.B2`&iI_{_Ox=qmC'\''qJO0(U>Zu={9N6%K,$~G' nqn.2016-06.io.spdk:cnode11638 00:13:42.232 [2024-11-28 15:08:42.233477] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11638: invalid model number '$"{p.B2`&iI_{_Ox=qmC'qJO0(U>Zu={9N6%K,$~G' 00:13:42.232 15:08:42 -- target/invalid.sh@58 -- # out='request: 00:13:42.232 { 00:13:42.232 "nqn": "nqn.2016-06.io.spdk:cnode11638", 00:13:42.232 "model_number": "$\"{p.B2`&iI_{_Ox=qmC'\''qJO0(U>Zu={9N6%K,$~G", 00:13:42.232 "method": "nvmf_create_subsystem", 00:13:42.232 "req_id": 1 00:13:42.232 } 00:13:42.232 Got JSON-RPC error response 00:13:42.232 response: 00:13:42.232 { 00:13:42.232 "code": -32602, 00:13:42.232 "message": "Invalid MN $\"{p.B2`&iI_{_Ox=qmC'\''qJO0(U>Zu={9N6%K,$~G" 00:13:42.232 }' 00:13:42.232 15:08:42 -- target/invalid.sh@59 -- # [[ request: 00:13:42.232 { 00:13:42.232 "nqn": "nqn.2016-06.io.spdk:cnode11638", 00:13:42.232 "model_number": "$\"{p.B2`&iI_{_Ox=qmC'qJO0(U>Zu={9N6%K,$~G", 00:13:42.232 "method": "nvmf_create_subsystem", 00:13:42.232 "req_id": 1 00:13:42.232 } 00:13:42.232 Got JSON-RPC error response 00:13:42.232 response: 00:13:42.232 { 00:13:42.232 "code": -32602, 00:13:42.232 "message": "Invalid MN $\"{p.B2`&iI_{_Ox=qmC'qJO0(U>Zu={9N6%K,$~G" 00:13:42.232 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:42.232 15:08:42 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:42.489 [2024-11-28 15:08:42.490391] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:42.489 15:08:42 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:42.746 15:08:42 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:42.746 15:08:42 -- target/invalid.sh@67 -- # echo '' 00:13:42.746 15:08:42 -- target/invalid.sh@67 -- # head -n 1 00:13:42.746 15:08:42 -- target/invalid.sh@67 -- # IP= 00:13:42.746 15:08:42 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:43.003 [2024-11-28 15:08:42.988119] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:43.003 15:08:43 -- target/invalid.sh@69 -- # out='request: 00:13:43.003 { 00:13:43.003 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:43.003 "listen_address": { 00:13:43.003 "trtype": "tcp", 00:13:43.003 "traddr": "", 00:13:43.003 "trsvcid": "4421" 00:13:43.003 }, 00:13:43.003 "method": "nvmf_subsystem_remove_listener", 00:13:43.003 "req_id": 1 00:13:43.003 } 00:13:43.003 Got JSON-RPC error response 00:13:43.003 response: 00:13:43.003 { 00:13:43.003 "code": -32602, 00:13:43.003 "message": "Invalid parameters" 00:13:43.003 }' 00:13:43.003 15:08:43 -- target/invalid.sh@70 -- # [[ request: 00:13:43.003 { 00:13:43.003 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:43.003 "listen_address": { 00:13:43.003 "trtype": "tcp", 00:13:43.003 "traddr": "", 00:13:43.004 "trsvcid": "4421" 00:13:43.004 }, 00:13:43.004 "method": "nvmf_subsystem_remove_listener", 00:13:43.004 "req_id": 1 00:13:43.004 } 00:13:43.004 Got JSON-RPC error response 00:13:43.004 response: 00:13:43.004 { 00:13:43.004 "code": -32602, 00:13:43.004 "message": "Invalid parameters" 00:13:43.004 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:43.004 15:08:43 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode31869 -i 0 00:13:43.004 [2024-11-28 15:08:43.236884] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31869: invalid cntlid range [0-65519] 00:13:43.262 15:08:43 -- target/invalid.sh@73 -- # out='request: 00:13:43.262 { 00:13:43.262 "nqn": "nqn.2016-06.io.spdk:cnode31869", 00:13:43.262 "min_cntlid": 0, 00:13:43.262 "method": "nvmf_create_subsystem", 00:13:43.262 "req_id": 1 00:13:43.262 } 00:13:43.262 Got JSON-RPC error response 00:13:43.262 response: 00:13:43.262 { 00:13:43.262 "code": -32602, 00:13:43.262 "message": "Invalid cntlid range [0-65519]" 00:13:43.262 }' 00:13:43.262 15:08:43 -- target/invalid.sh@74 -- # [[ request: 00:13:43.262 { 00:13:43.262 "nqn": "nqn.2016-06.io.spdk:cnode31869", 00:13:43.262 "min_cntlid": 0, 00:13:43.262 "method": "nvmf_create_subsystem", 00:13:43.262 "req_id": 1 00:13:43.262 } 00:13:43.262 Got JSON-RPC error response 00:13:43.262 response: 00:13:43.262 { 00:13:43.262 "code": -32602, 00:13:43.262 "message": "Invalid cntlid range [0-65519]" 00:13:43.262 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.262 15:08:43 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3418 -i 65520 00:13:43.519 [2024-11-28 15:08:43.509827] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode3418: invalid cntlid range [65520-65519] 00:13:43.519 15:08:43 -- target/invalid.sh@75 -- # out='request: 00:13:43.519 { 00:13:43.519 "nqn": "nqn.2016-06.io.spdk:cnode3418", 00:13:43.519 "min_cntlid": 65520, 00:13:43.519 "method": "nvmf_create_subsystem", 00:13:43.519 "req_id": 1 00:13:43.519 } 00:13:43.519 Got JSON-RPC error response 00:13:43.519 response: 00:13:43.519 { 00:13:43.519 "code": -32602, 00:13:43.519 "message": "Invalid cntlid range [65520-65519]" 00:13:43.519 }' 00:13:43.519 15:08:43 -- target/invalid.sh@76 -- # [[ request: 00:13:43.519 { 00:13:43.519 "nqn": "nqn.2016-06.io.spdk:cnode3418", 00:13:43.519 "min_cntlid": 65520, 00:13:43.519 "method": "nvmf_create_subsystem", 00:13:43.519 "req_id": 1 00:13:43.519 } 00:13:43.519 Got JSON-RPC error response 00:13:43.519 response: 00:13:43.519 { 00:13:43.519 "code": -32602, 00:13:43.519 "message": "Invalid cntlid range [65520-65519]" 00:13:43.519 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.519 15:08:43 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8885 -I 0 00:13:43.776 [2024-11-28 15:08:43.754690] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8885: invalid cntlid range [1-0] 00:13:43.776 15:08:43 -- target/invalid.sh@77 -- # out='request: 00:13:43.776 { 00:13:43.776 "nqn": "nqn.2016-06.io.spdk:cnode8885", 00:13:43.776 "max_cntlid": 0, 00:13:43.776 "method": "nvmf_create_subsystem", 00:13:43.776 "req_id": 1 00:13:43.776 } 00:13:43.776 Got JSON-RPC error response 00:13:43.776 response: 00:13:43.776 { 00:13:43.776 "code": -32602, 00:13:43.776 "message": "Invalid cntlid range [1-0]" 00:13:43.776 }' 00:13:43.776 15:08:43 -- target/invalid.sh@78 -- # [[ request: 00:13:43.776 { 00:13:43.776 "nqn": "nqn.2016-06.io.spdk:cnode8885", 00:13:43.776 "max_cntlid": 0, 00:13:43.776 "method": "nvmf_create_subsystem", 00:13:43.776 "req_id": 1 00:13:43.776 } 00:13:43.776 Got JSON-RPC error response 00:13:43.776 response: 00:13:43.776 { 00:13:43.776 "code": -32602, 00:13:43.776 "message": "Invalid cntlid range [1-0]" 00:13:43.776 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:43.776 15:08:43 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode14628 -I 65520 00:13:43.776 [2024-11-28 15:08:44.007550] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode14628: invalid cntlid range [1-65520] 00:13:44.033 15:08:44 -- target/invalid.sh@79 -- # out='request: 00:13:44.033 { 00:13:44.033 "nqn": "nqn.2016-06.io.spdk:cnode14628", 00:13:44.033 "max_cntlid": 65520, 00:13:44.033 "method": "nvmf_create_subsystem", 00:13:44.033 "req_id": 1 00:13:44.033 } 00:13:44.033 Got JSON-RPC error response 00:13:44.033 response: 00:13:44.033 { 00:13:44.033 "code": -32602, 00:13:44.033 "message": "Invalid cntlid range [1-65520]" 00:13:44.033 }' 00:13:44.033 15:08:44 -- target/invalid.sh@80 -- # [[ request: 00:13:44.033 { 00:13:44.033 "nqn": "nqn.2016-06.io.spdk:cnode14628", 00:13:44.033 "max_cntlid": 65520, 00:13:44.033 "method": "nvmf_create_subsystem", 00:13:44.033 "req_id": 1 00:13:44.033 } 00:13:44.033 Got JSON-RPC error response 00:13:44.033 response: 00:13:44.033 { 00:13:44.033 "code": -32602, 00:13:44.033 "message": "Invalid cntlid range [1-65520]" 00:13:44.033 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:44.033 15:08:44 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11438 -i 6 -I 5 00:13:44.033 [2024-11-28 15:08:44.252404] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode11438: invalid cntlid range [6-5] 00:13:44.291 15:08:44 -- target/invalid.sh@83 -- # out='request: 00:13:44.291 { 00:13:44.291 "nqn": "nqn.2016-06.io.spdk:cnode11438", 00:13:44.291 "min_cntlid": 6, 00:13:44.291 "max_cntlid": 5, 00:13:44.291 "method": "nvmf_create_subsystem", 00:13:44.291 "req_id": 1 00:13:44.291 } 00:13:44.291 Got JSON-RPC error response 00:13:44.291 response: 00:13:44.291 { 00:13:44.291 "code": -32602, 00:13:44.291 "message": "Invalid cntlid range [6-5]" 00:13:44.291 }' 00:13:44.291 15:08:44 -- target/invalid.sh@84 -- # [[ request: 00:13:44.291 { 00:13:44.291 "nqn": "nqn.2016-06.io.spdk:cnode11438", 00:13:44.291 "min_cntlid": 6, 00:13:44.291 "max_cntlid": 5, 00:13:44.291 "method": "nvmf_create_subsystem", 00:13:44.291 "req_id": 1 00:13:44.291 } 00:13:44.291 Got JSON-RPC error response 00:13:44.291 response: 00:13:44.291 { 00:13:44.291 "code": -32602, 00:13:44.291 "message": "Invalid cntlid range [6-5]" 00:13:44.291 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:44.291 15:08:44 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:44.291 15:08:44 -- target/invalid.sh@87 -- # out='request: 00:13:44.291 { 00:13:44.291 "name": "foobar", 00:13:44.291 "method": "nvmf_delete_target", 00:13:44.291 "req_id": 1 00:13:44.291 } 00:13:44.291 Got JSON-RPC error response 00:13:44.291 response: 00:13:44.291 { 00:13:44.291 "code": -32602, 00:13:44.291 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:44.291 }' 00:13:44.291 15:08:44 -- target/invalid.sh@88 -- # [[ request: 00:13:44.291 { 00:13:44.291 "name": "foobar", 00:13:44.291 "method": "nvmf_delete_target", 00:13:44.291 "req_id": 1 00:13:44.291 } 00:13:44.291 Got JSON-RPC error response 00:13:44.291 response: 00:13:44.291 { 00:13:44.291 "code": -32602, 00:13:44.291 "message": "The specified target doesn't exist, cannot delete it." 00:13:44.291 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:44.291 15:08:44 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:44.291 15:08:44 -- target/invalid.sh@91 -- # nvmftestfini 00:13:44.291 15:08:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.291 15:08:44 -- nvmf/common.sh@116 -- # sync 00:13:44.291 15:08:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.291 15:08:44 -- nvmf/common.sh@119 -- # set +e 00:13:44.291 15:08:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.291 15:08:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.291 rmmod nvme_tcp 00:13:44.291 rmmod nvme_fabrics 00:13:44.291 rmmod nvme_keyring 00:13:44.291 15:08:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.291 15:08:44 -- nvmf/common.sh@123 -- # set -e 00:13:44.291 15:08:44 -- nvmf/common.sh@124 -- # return 0 00:13:44.291 15:08:44 -- nvmf/common.sh@477 -- # '[' -n 659369 ']' 00:13:44.291 15:08:44 -- nvmf/common.sh@478 -- # killprocess 659369 00:13:44.291 15:08:44 -- common/autotest_common.sh@936 -- # '[' -z 659369 ']' 00:13:44.291 15:08:44 -- common/autotest_common.sh@940 -- # kill -0 659369 00:13:44.291 15:08:44 -- common/autotest_common.sh@941 -- # uname 00:13:44.291 15:08:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:44.291 15:08:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 659369 00:13:44.291 15:08:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:44.291 15:08:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:44.291 15:08:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 659369' 00:13:44.291 killing process with pid 659369 00:13:44.291 15:08:44 -- common/autotest_common.sh@955 -- # kill 659369 00:13:44.291 15:08:44 -- common/autotest_common.sh@960 -- # wait 659369 00:13:44.549 15:08:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.549 15:08:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.549 15:08:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.549 15:08:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.549 15:08:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.549 15:08:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.549 15:08:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.549 15:08:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.085 15:08:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:47.085 00:13:47.085 real 0m9.413s 00:13:47.085 user 0m22.858s 00:13:47.085 sys 0m2.538s 00:13:47.085 15:08:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:47.085 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:13:47.085 ************************************ 00:13:47.085 END TEST nvmf_invalid 00:13:47.085 ************************************ 00:13:47.085 15:08:46 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:47.085 15:08:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:47.085 15:08:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:47.085 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:13:47.085 ************************************ 00:13:47.085 START TEST nvmf_abort 00:13:47.085 ************************************ 00:13:47.085 15:08:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:47.085 * Looking for test storage... 00:13:47.085 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:47.085 15:08:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:47.085 15:08:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:47.085 15:08:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:47.085 15:08:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:47.085 15:08:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:47.085 15:08:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:47.085 15:08:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:47.086 15:08:46 -- scripts/common.sh@335 -- # IFS=.-: 00:13:47.086 15:08:46 -- scripts/common.sh@335 -- # read -ra ver1 00:13:47.086 15:08:46 -- scripts/common.sh@336 -- # IFS=.-: 00:13:47.086 15:08:46 -- scripts/common.sh@336 -- # read -ra ver2 00:13:47.086 15:08:46 -- scripts/common.sh@337 -- # local 'op=<' 00:13:47.086 15:08:46 -- scripts/common.sh@339 -- # ver1_l=2 00:13:47.086 15:08:46 -- scripts/common.sh@340 -- # ver2_l=1 00:13:47.086 15:08:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:47.086 15:08:46 -- scripts/common.sh@343 -- # case "$op" in 00:13:47.086 15:08:46 -- scripts/common.sh@344 -- # : 1 00:13:47.086 15:08:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:47.086 15:08:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:47.086 15:08:46 -- scripts/common.sh@364 -- # decimal 1 00:13:47.086 15:08:46 -- scripts/common.sh@352 -- # local d=1 00:13:47.086 15:08:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:47.086 15:08:46 -- scripts/common.sh@354 -- # echo 1 00:13:47.086 15:08:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:47.086 15:08:46 -- scripts/common.sh@365 -- # decimal 2 00:13:47.086 15:08:46 -- scripts/common.sh@352 -- # local d=2 00:13:47.086 15:08:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:47.086 15:08:46 -- scripts/common.sh@354 -- # echo 2 00:13:47.086 15:08:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:47.086 15:08:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:47.086 15:08:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:47.086 15:08:46 -- scripts/common.sh@367 -- # return 0 00:13:47.086 15:08:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:47.086 15:08:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:47.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.086 --rc genhtml_branch_coverage=1 00:13:47.086 --rc genhtml_function_coverage=1 00:13:47.086 --rc genhtml_legend=1 00:13:47.086 --rc geninfo_all_blocks=1 00:13:47.086 --rc geninfo_unexecuted_blocks=1 00:13:47.086 00:13:47.086 ' 00:13:47.086 15:08:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:47.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.086 --rc genhtml_branch_coverage=1 00:13:47.086 --rc genhtml_function_coverage=1 00:13:47.086 --rc genhtml_legend=1 00:13:47.086 --rc geninfo_all_blocks=1 00:13:47.086 --rc geninfo_unexecuted_blocks=1 00:13:47.086 00:13:47.086 ' 00:13:47.086 15:08:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:47.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.086 --rc genhtml_branch_coverage=1 00:13:47.086 --rc genhtml_function_coverage=1 00:13:47.086 --rc genhtml_legend=1 00:13:47.086 --rc geninfo_all_blocks=1 00:13:47.086 --rc geninfo_unexecuted_blocks=1 00:13:47.086 00:13:47.086 ' 00:13:47.086 15:08:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:47.086 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:47.086 --rc genhtml_branch_coverage=1 00:13:47.086 --rc genhtml_function_coverage=1 00:13:47.086 --rc genhtml_legend=1 00:13:47.086 --rc geninfo_all_blocks=1 00:13:47.086 --rc geninfo_unexecuted_blocks=1 00:13:47.086 00:13:47.086 ' 00:13:47.086 15:08:46 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:47.086 15:08:46 -- nvmf/common.sh@7 -- # uname -s 00:13:47.086 15:08:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:47.086 15:08:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:47.086 15:08:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:47.086 15:08:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:47.086 15:08:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:47.086 15:08:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:47.086 15:08:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:47.086 15:08:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:47.086 15:08:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:47.086 15:08:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:47.086 15:08:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:47.086 15:08:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:47.086 15:08:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:47.086 15:08:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:47.086 15:08:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:47.086 15:08:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:47.086 15:08:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:47.086 15:08:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:47.086 15:08:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:47.086 15:08:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.086 15:08:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.086 15:08:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.086 15:08:46 -- paths/export.sh@5 -- # export PATH 00:13:47.086 15:08:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:47.086 15:08:46 -- nvmf/common.sh@46 -- # : 0 00:13:47.086 15:08:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:47.086 15:08:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:47.086 15:08:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:47.086 15:08:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:47.086 15:08:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:47.086 15:08:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:47.086 15:08:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:47.086 15:08:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:47.086 15:08:46 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:47.086 15:08:46 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:47.086 15:08:46 -- target/abort.sh@14 -- # nvmftestinit 00:13:47.086 15:08:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:47.086 15:08:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:47.086 15:08:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:47.086 15:08:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:47.086 15:08:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:47.086 15:08:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:47.086 15:08:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:47.086 15:08:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:47.086 15:08:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:47.086 15:08:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:47.086 15:08:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:47.086 15:08:46 -- common/autotest_common.sh@10 -- # set +x 00:13:48.989 15:08:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.989 15:08:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.989 15:08:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.989 15:08:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.989 15:08:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.989 15:08:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.989 15:08:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.989 15:08:48 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.989 15:08:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.989 15:08:48 -- nvmf/common.sh@295 -- # e810=() 00:13:48.989 15:08:48 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.989 15:08:48 -- nvmf/common.sh@296 -- # x722=() 00:13:48.989 15:08:48 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.989 15:08:48 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.989 15:08:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.989 15:08:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.989 15:08:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.989 15:08:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.989 15:08:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.989 15:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.989 15:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.989 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.989 15:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.989 15:08:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.989 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.989 15:08:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.989 15:08:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.989 15:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.989 15:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.989 15:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.989 15:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.989 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.989 15:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.989 15:08:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.989 15:08:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.989 15:08:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.989 15:08:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.989 15:08:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.989 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.989 15:08:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.989 15:08:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.989 15:08:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.989 15:08:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.989 15:08:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.989 15:08:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.989 15:08:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.989 15:08:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.989 15:08:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.989 15:08:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.989 15:08:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.989 15:08:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.989 15:08:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.989 15:08:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.989 15:08:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.989 15:08:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.989 15:08:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.989 15:08:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.989 15:08:49 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.989 15:08:49 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:48.989 15:08:49 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:48.989 15:08:49 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:48.989 15:08:49 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:48.989 15:08:49 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:48.989 15:08:49 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:48.989 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.989 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.144 ms 00:13:48.989 00:13:48.989 --- 10.0.0.2 ping statistics --- 00:13:48.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.989 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:13:48.989 15:08:49 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:48.989 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.989 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:13:48.989 00:13:48.989 --- 10.0.0.1 ping statistics --- 00:13:48.989 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.989 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:13:48.989 15:08:49 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.989 15:08:49 -- nvmf/common.sh@410 -- # return 0 00:13:48.989 15:08:49 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:48.989 15:08:49 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.989 15:08:49 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:48.989 15:08:49 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:48.989 15:08:49 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.989 15:08:49 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:48.989 15:08:49 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:48.989 15:08:49 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:48.989 15:08:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:48.989 15:08:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:48.989 15:08:49 -- common/autotest_common.sh@10 -- # set +x 00:13:48.989 15:08:49 -- nvmf/common.sh@469 -- # nvmfpid=662173 00:13:48.989 15:08:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:48.989 15:08:49 -- nvmf/common.sh@470 -- # waitforlisten 662173 00:13:48.989 15:08:49 -- common/autotest_common.sh@829 -- # '[' -z 662173 ']' 00:13:48.989 15:08:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.990 15:08:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:48.990 15:08:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.990 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.990 15:08:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:48.990 15:08:49 -- common/autotest_common.sh@10 -- # set +x 00:13:48.990 [2024-11-28 15:08:49.179676] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:48.990 [2024-11-28 15:08:49.179770] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.990 EAL: No free 2048 kB hugepages reported on node 1 00:13:49.247 [2024-11-28 15:08:49.249870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:49.247 [2024-11-28 15:08:49.340171] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:49.247 [2024-11-28 15:08:49.340338] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.247 [2024-11-28 15:08:49.340360] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.247 [2024-11-28 15:08:49.340385] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.247 [2024-11-28 15:08:49.340473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:49.247 [2024-11-28 15:08:49.340529] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:49.247 [2024-11-28 15:08:49.340533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:50.182 15:08:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:50.182 15:08:50 -- common/autotest_common.sh@862 -- # return 0 00:13:50.182 15:08:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:50.182 15:08:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 15:08:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:50.182 15:08:50 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 [2024-11-28 15:08:50.204321] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 Malloc0 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 Delay0 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 [2024-11-28 15:08:50.273832] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:50.182 15:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:50.182 15:08:50 -- common/autotest_common.sh@10 -- # set +x 00:13:50.182 15:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:50.182 15:08:50 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:50.182 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.182 [2024-11-28 15:08:50.411204] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:52.709 Initializing NVMe Controllers 00:13:52.709 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:52.709 controller IO queue size 128 less than required 00:13:52.709 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:52.709 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:52.709 Initialization complete. Launching workers. 00:13:52.709 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33995 00:13:52.709 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34056, failed to submit 62 00:13:52.709 success 33995, unsuccess 61, failed 0 00:13:52.709 15:08:52 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:52.709 15:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:52.709 15:08:52 -- common/autotest_common.sh@10 -- # set +x 00:13:52.709 15:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:52.709 15:08:52 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:52.709 15:08:52 -- target/abort.sh@38 -- # nvmftestfini 00:13:52.709 15:08:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:52.709 15:08:52 -- nvmf/common.sh@116 -- # sync 00:13:52.709 15:08:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:52.709 15:08:52 -- nvmf/common.sh@119 -- # set +e 00:13:52.709 15:08:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:52.709 15:08:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:52.709 rmmod nvme_tcp 00:13:52.709 rmmod nvme_fabrics 00:13:52.709 rmmod nvme_keyring 00:13:52.709 15:08:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:52.709 15:08:52 -- nvmf/common.sh@123 -- # set -e 00:13:52.709 15:08:52 -- nvmf/common.sh@124 -- # return 0 00:13:52.709 15:08:52 -- nvmf/common.sh@477 -- # '[' -n 662173 ']' 00:13:52.709 15:08:52 -- nvmf/common.sh@478 -- # killprocess 662173 00:13:52.709 15:08:52 -- common/autotest_common.sh@936 -- # '[' -z 662173 ']' 00:13:52.709 15:08:52 -- common/autotest_common.sh@940 -- # kill -0 662173 00:13:52.709 15:08:52 -- common/autotest_common.sh@941 -- # uname 00:13:52.709 15:08:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.709 15:08:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 662173 00:13:52.709 15:08:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:52.709 15:08:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:52.709 15:08:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 662173' 00:13:52.709 killing process with pid 662173 00:13:52.709 15:08:52 -- common/autotest_common.sh@955 -- # kill 662173 00:13:52.709 15:08:52 -- common/autotest_common.sh@960 -- # wait 662173 00:13:52.709 15:08:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:52.709 15:08:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:52.709 15:08:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:52.709 15:08:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.709 15:08:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:52.709 15:08:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.709 15:08:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.709 15:08:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.250 15:08:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:55.250 00:13:55.250 real 0m8.114s 00:13:55.250 user 0m12.980s 00:13:55.250 sys 0m2.531s 00:13:55.250 15:08:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:55.250 15:08:54 -- common/autotest_common.sh@10 -- # set +x 00:13:55.250 ************************************ 00:13:55.250 END TEST nvmf_abort 00:13:55.250 ************************************ 00:13:55.250 15:08:54 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:55.250 15:08:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:55.250 15:08:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:55.250 15:08:54 -- common/autotest_common.sh@10 -- # set +x 00:13:55.250 ************************************ 00:13:55.250 START TEST nvmf_ns_hotplug_stress 00:13:55.250 ************************************ 00:13:55.250 15:08:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:55.250 * Looking for test storage... 00:13:55.250 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:55.250 15:08:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:55.250 15:08:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:55.250 15:08:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:55.250 15:08:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:55.250 15:08:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:55.250 15:08:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:55.250 15:08:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:55.250 15:08:55 -- scripts/common.sh@335 -- # IFS=.-: 00:13:55.250 15:08:55 -- scripts/common.sh@335 -- # read -ra ver1 00:13:55.250 15:08:55 -- scripts/common.sh@336 -- # IFS=.-: 00:13:55.250 15:08:55 -- scripts/common.sh@336 -- # read -ra ver2 00:13:55.250 15:08:55 -- scripts/common.sh@337 -- # local 'op=<' 00:13:55.250 15:08:55 -- scripts/common.sh@339 -- # ver1_l=2 00:13:55.250 15:08:55 -- scripts/common.sh@340 -- # ver2_l=1 00:13:55.250 15:08:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:55.250 15:08:55 -- scripts/common.sh@343 -- # case "$op" in 00:13:55.250 15:08:55 -- scripts/common.sh@344 -- # : 1 00:13:55.250 15:08:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:55.250 15:08:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:55.250 15:08:55 -- scripts/common.sh@364 -- # decimal 1 00:13:55.250 15:08:55 -- scripts/common.sh@352 -- # local d=1 00:13:55.250 15:08:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:55.250 15:08:55 -- scripts/common.sh@354 -- # echo 1 00:13:55.250 15:08:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:55.250 15:08:55 -- scripts/common.sh@365 -- # decimal 2 00:13:55.250 15:08:55 -- scripts/common.sh@352 -- # local d=2 00:13:55.250 15:08:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:55.250 15:08:55 -- scripts/common.sh@354 -- # echo 2 00:13:55.250 15:08:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:55.250 15:08:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:55.250 15:08:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:55.250 15:08:55 -- scripts/common.sh@367 -- # return 0 00:13:55.250 15:08:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:55.250 15:08:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:55.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.250 --rc genhtml_branch_coverage=1 00:13:55.250 --rc genhtml_function_coverage=1 00:13:55.250 --rc genhtml_legend=1 00:13:55.250 --rc geninfo_all_blocks=1 00:13:55.250 --rc geninfo_unexecuted_blocks=1 00:13:55.250 00:13:55.250 ' 00:13:55.250 15:08:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:55.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.250 --rc genhtml_branch_coverage=1 00:13:55.250 --rc genhtml_function_coverage=1 00:13:55.250 --rc genhtml_legend=1 00:13:55.250 --rc geninfo_all_blocks=1 00:13:55.250 --rc geninfo_unexecuted_blocks=1 00:13:55.250 00:13:55.250 ' 00:13:55.250 15:08:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:55.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.250 --rc genhtml_branch_coverage=1 00:13:55.250 --rc genhtml_function_coverage=1 00:13:55.250 --rc genhtml_legend=1 00:13:55.250 --rc geninfo_all_blocks=1 00:13:55.250 --rc geninfo_unexecuted_blocks=1 00:13:55.250 00:13:55.250 ' 00:13:55.250 15:08:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:55.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.250 --rc genhtml_branch_coverage=1 00:13:55.250 --rc genhtml_function_coverage=1 00:13:55.250 --rc genhtml_legend=1 00:13:55.250 --rc geninfo_all_blocks=1 00:13:55.250 --rc geninfo_unexecuted_blocks=1 00:13:55.250 00:13:55.250 ' 00:13:55.250 15:08:55 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:55.250 15:08:55 -- nvmf/common.sh@7 -- # uname -s 00:13:55.250 15:08:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:55.250 15:08:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:55.250 15:08:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:55.250 15:08:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:55.250 15:08:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:55.250 15:08:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:55.250 15:08:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:55.250 15:08:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:55.250 15:08:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:55.250 15:08:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:55.250 15:08:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.250 15:08:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.250 15:08:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:55.250 15:08:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:55.250 15:08:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:55.250 15:08:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:55.250 15:08:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:55.250 15:08:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:55.250 15:08:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:55.250 15:08:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.250 15:08:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.250 15:08:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.250 15:08:55 -- paths/export.sh@5 -- # export PATH 00:13:55.250 15:08:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.250 15:08:55 -- nvmf/common.sh@46 -- # : 0 00:13:55.250 15:08:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:55.250 15:08:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:55.251 15:08:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:55.251 15:08:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:55.251 15:08:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:55.251 15:08:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:55.251 15:08:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:55.251 15:08:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:55.251 15:08:55 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:55.251 15:08:55 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:55.251 15:08:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:55.251 15:08:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:55.251 15:08:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:55.251 15:08:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:55.251 15:08:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:55.251 15:08:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:55.251 15:08:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:55.251 15:08:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.251 15:08:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:55.251 15:08:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:55.251 15:08:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:55.251 15:08:55 -- common/autotest_common.sh@10 -- # set +x 00:13:57.154 15:08:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:57.154 15:08:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:57.154 15:08:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:57.154 15:08:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:57.154 15:08:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:57.154 15:08:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:57.154 15:08:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:57.154 15:08:57 -- nvmf/common.sh@294 -- # net_devs=() 00:13:57.154 15:08:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:57.154 15:08:57 -- nvmf/common.sh@295 -- # e810=() 00:13:57.154 15:08:57 -- nvmf/common.sh@295 -- # local -ga e810 00:13:57.154 15:08:57 -- nvmf/common.sh@296 -- # x722=() 00:13:57.154 15:08:57 -- nvmf/common.sh@296 -- # local -ga x722 00:13:57.154 15:08:57 -- nvmf/common.sh@297 -- # mlx=() 00:13:57.154 15:08:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:57.154 15:08:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:57.154 15:08:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:57.154 15:08:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:57.154 15:08:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:57.154 15:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.154 15:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:57.154 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:57.154 15:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:57.154 15:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:57.154 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:57.154 15:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:57.154 15:08:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.154 15:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.154 15:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.154 15:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.154 15:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:57.154 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:57.154 15:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.154 15:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:57.154 15:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:57.154 15:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:57.154 15:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:57.154 15:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:57.154 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:57.154 15:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:57.154 15:08:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:57.154 15:08:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:57.154 15:08:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:57.154 15:08:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:57.154 15:08:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:57.154 15:08:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:57.154 15:08:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:57.154 15:08:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:57.154 15:08:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:57.154 15:08:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:57.154 15:08:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:57.154 15:08:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:57.154 15:08:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:57.154 15:08:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:57.154 15:08:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:57.154 15:08:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:57.154 15:08:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:57.154 15:08:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:57.154 15:08:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:57.154 15:08:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:57.154 15:08:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:57.154 15:08:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:57.154 15:08:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:57.154 15:08:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:57.154 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:57.154 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.321 ms 00:13:57.154 00:13:57.154 --- 10.0.0.2 ping statistics --- 00:13:57.155 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.155 rtt min/avg/max/mdev = 0.321/0.321/0.321/0.000 ms 00:13:57.155 15:08:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:57.155 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:57.155 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:13:57.155 00:13:57.155 --- 10.0.0.1 ping statistics --- 00:13:57.155 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:57.155 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:13:57.155 15:08:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:57.155 15:08:57 -- nvmf/common.sh@410 -- # return 0 00:13:57.155 15:08:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:57.155 15:08:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:57.155 15:08:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:57.155 15:08:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:57.155 15:08:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:57.155 15:08:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:57.155 15:08:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:57.155 15:08:57 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:57.155 15:08:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:57.155 15:08:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:57.155 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:13:57.155 15:08:57 -- nvmf/common.sh@469 -- # nvmfpid=664556 00:13:57.155 15:08:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:57.155 15:08:57 -- nvmf/common.sh@470 -- # waitforlisten 664556 00:13:57.155 15:08:57 -- common/autotest_common.sh@829 -- # '[' -z 664556 ']' 00:13:57.155 15:08:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:57.155 15:08:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:57.155 15:08:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:57.155 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:57.155 15:08:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:57.155 15:08:57 -- common/autotest_common.sh@10 -- # set +x 00:13:57.155 [2024-11-28 15:08:57.325429] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:13:57.155 [2024-11-28 15:08:57.325497] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:57.155 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.413 [2024-11-28 15:08:57.388335] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:57.413 [2024-11-28 15:08:57.471588] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:57.413 [2024-11-28 15:08:57.471751] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.413 [2024-11-28 15:08:57.471769] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.413 [2024-11-28 15:08:57.471781] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.413 [2024-11-28 15:08:57.471881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:57.413 [2024-11-28 15:08:57.471923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:57.413 [2024-11-28 15:08:57.471926] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:58.345 15:08:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.345 15:08:58 -- common/autotest_common.sh@862 -- # return 0 00:13:58.345 15:08:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.345 15:08:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.345 15:08:58 -- common/autotest_common.sh@10 -- # set +x 00:13:58.345 15:08:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.345 15:08:58 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:58.345 15:08:58 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:58.345 [2024-11-28 15:08:58.553123] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.345 15:08:58 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:58.603 15:08:58 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:58.860 [2024-11-28 15:08:59.043909] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.860 15:08:59 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:59.118 15:08:59 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:59.376 Malloc0 00:13:59.633 15:08:59 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:59.633 Delay0 00:13:59.633 15:08:59 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.199 15:09:00 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:14:00.199 NULL1 00:14:00.199 15:09:00 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:00.457 15:09:00 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=665041 00:14:00.457 15:09:00 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:14:00.457 15:09:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:00.457 15:09:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.713 EAL: No free 2048 kB hugepages reported on node 1 00:14:02.102 Read completed with error (sct=0, sc=11) 00:14:02.102 15:09:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:02.102 15:09:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:14:02.102 15:09:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:14:02.359 true 00:14:02.359 15:09:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:02.359 15:09:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.292 15:09:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.292 15:09:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:14:03.292 15:09:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:14:03.549 true 00:14:03.549 15:09:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:03.549 15:09:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.808 15:09:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.066 15:09:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:14:04.066 15:09:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:14:04.324 true 00:14:04.324 15:09:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:04.324 15:09:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.581 15:09:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.839 15:09:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:04.839 15:09:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:05.096 true 00:14:05.096 15:09:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:05.096 15:09:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.087 15:09:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.087 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:06.345 15:09:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:06.345 15:09:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:06.603 true 00:14:06.603 15:09:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:06.603 15:09:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.861 15:09:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.119 15:09:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:07.119 15:09:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:07.377 true 00:14:07.377 15:09:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:07.377 15:09:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.635 15:09:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.200 15:09:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:08.200 15:09:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:08.200 true 00:14:08.200 15:09:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:08.200 15:09:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.575 15:09:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.575 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:09.575 15:09:09 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:09.575 15:09:09 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:09.832 true 00:14:09.832 15:09:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:09.832 15:09:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.090 15:09:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.348 15:09:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:10.348 15:09:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:10.606 true 00:14:10.606 15:09:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:10.606 15:09:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.864 15:09:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.122 15:09:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:11.122 15:09:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:11.380 true 00:14:11.380 15:09:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:11.380 15:09:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.313 15:09:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:12.313 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.571 15:09:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:12.571 15:09:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:12.828 true 00:14:12.828 15:09:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:12.828 15:09:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.087 15:09:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.345 15:09:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:13.345 15:09:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:13.603 true 00:14:13.603 15:09:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:13.603 15:09:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.537 15:09:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:14.537 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:14.806 15:09:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:14.806 15:09:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:15.077 true 00:14:15.077 15:09:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:15.077 15:09:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.335 15:09:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.593 15:09:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:15.593 15:09:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:15.850 true 00:14:15.850 15:09:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:15.850 15:09:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.781 15:09:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.781 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.038 15:09:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:17.039 15:09:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:17.297 true 00:14:17.297 15:09:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:17.297 15:09:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.554 15:09:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.812 15:09:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:17.812 15:09:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:18.070 true 00:14:18.070 15:09:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:18.070 15:09:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.003 15:09:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.003 15:09:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:19.003 15:09:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:19.260 true 00:14:19.261 15:09:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:19.261 15:09:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.517 15:09:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.774 15:09:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:19.774 15:09:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:20.054 true 00:14:20.054 15:09:20 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:20.054 15:09:20 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.986 15:09:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.986 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:21.244 15:09:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:21.244 15:09:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:21.502 true 00:14:21.502 15:09:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:21.502 15:09:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.759 15:09:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.016 15:09:22 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:22.016 15:09:22 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:22.274 true 00:14:22.274 15:09:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:22.274 15:09:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.206 15:09:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.206 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.463 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:23.463 15:09:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:23.463 15:09:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:23.720 true 00:14:23.720 15:09:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:23.720 15:09:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.978 15:09:24 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.235 15:09:24 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:24.235 15:09:24 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:24.493 true 00:14:24.493 15:09:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:24.493 15:09:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.426 15:09:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:25.426 15:09:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:25.426 15:09:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:25.684 true 00:14:25.684 15:09:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:25.684 15:09:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.942 15:09:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.199 15:09:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:26.199 15:09:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:26.457 true 00:14:26.457 15:09:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:26.457 15:09:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.715 15:09:26 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.971 15:09:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:26.971 15:09:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:27.228 true 00:14:27.228 15:09:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:27.228 15:09:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.601 15:09:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:28.601 15:09:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:28.601 15:09:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:28.859 true 00:14:28.859 15:09:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:28.859 15:09:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:29.793 15:09:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:29.793 15:09:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:29.793 15:09:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:30.050 true 00:14:30.050 15:09:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:30.050 15:09:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.308 15:09:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:30.565 15:09:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:30.565 15:09:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:30.823 true 00:14:30.823 15:09:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:30.823 15:09:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.080 Initializing NVMe Controllers 00:14:31.080 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:31.080 Controller IO queue size 128, less than required. 00:14:31.080 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:31.080 Controller IO queue size 128, less than required. 00:14:31.080 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:31.080 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:31.080 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:31.080 Initialization complete. Launching workers. 00:14:31.080 ======================================================== 00:14:31.080 Latency(us) 00:14:31.080 Device Information : IOPS MiB/s Average min max 00:14:31.080 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 930.62 0.45 67787.67 2845.34 1086220.06 00:14:31.080 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10913.95 5.33 11728.66 3031.36 371726.37 00:14:31.080 ======================================================== 00:14:31.080 Total : 11844.57 5.78 16133.17 2845.34 1086220.06 00:14:31.080 00:14:31.080 15:09:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:31.338 15:09:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:31.338 15:09:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:31.597 true 00:14:31.597 15:09:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 665041 00:14:31.597 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (665041) - No such process 00:14:31.597 15:09:31 -- target/ns_hotplug_stress.sh@53 -- # wait 665041 00:14:31.597 15:09:31 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.854 15:09:31 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:32.113 15:09:32 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:32.113 15:09:32 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:32.113 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:32.113 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.113 15:09:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:32.370 null0 00:14:32.370 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.370 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.370 15:09:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:32.627 null1 00:14:32.627 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.627 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.627 15:09:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:32.884 null2 00:14:32.884 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:32.884 15:09:32 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:32.884 15:09:32 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:33.141 null3 00:14:33.141 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.141 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.141 15:09:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:33.398 null4 00:14:33.398 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.398 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.398 15:09:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:33.655 null5 00:14:33.655 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.655 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.655 15:09:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:33.912 null6 00:14:33.912 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:33.912 15:09:33 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:33.912 15:09:33 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:34.169 null7 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.169 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@66 -- # wait 669773 669774 669776 669778 669780 669782 669784 669786 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.170 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.427 15:09:34 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.684 15:09:34 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.966 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.257 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.539 15:09:35 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.796 15:09:35 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.053 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.053 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.053 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.053 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.054 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.054 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.054 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.054 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.311 15:09:36 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:36.569 15:09:36 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:36.827 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.085 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.085 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.085 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.344 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.344 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:37.344 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.344 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.344 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.601 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:37.602 15:09:37 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:37.860 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:37.861 15:09:37 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:38.119 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.119 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.119 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:38.119 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.119 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.119 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.120 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:38.378 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:38.378 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.378 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.378 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:38.379 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:38.379 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:38.379 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:38.379 15:09:38 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:38.637 15:09:38 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:38.896 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:39.155 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.156 15:09:39 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:39.414 15:09:39 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:39.672 15:09:39 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:39.672 15:09:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:39.672 15:09:39 -- nvmf/common.sh@116 -- # sync 00:14:39.672 15:09:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:39.672 15:09:39 -- nvmf/common.sh@119 -- # set +e 00:14:39.672 15:09:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:39.672 15:09:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:39.672 rmmod nvme_tcp 00:14:39.672 rmmod nvme_fabrics 00:14:39.931 rmmod nvme_keyring 00:14:39.931 15:09:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:39.931 15:09:39 -- nvmf/common.sh@123 -- # set -e 00:14:39.931 15:09:39 -- nvmf/common.sh@124 -- # return 0 00:14:39.931 15:09:39 -- nvmf/common.sh@477 -- # '[' -n 664556 ']' 00:14:39.931 15:09:39 -- nvmf/common.sh@478 -- # killprocess 664556 00:14:39.931 15:09:39 -- common/autotest_common.sh@936 -- # '[' -z 664556 ']' 00:14:39.931 15:09:39 -- common/autotest_common.sh@940 -- # kill -0 664556 00:14:39.931 15:09:39 -- common/autotest_common.sh@941 -- # uname 00:14:39.931 15:09:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:39.931 15:09:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 664556 00:14:39.931 15:09:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:39.931 15:09:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:39.931 15:09:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 664556' 00:14:39.931 killing process with pid 664556 00:14:39.931 15:09:39 -- common/autotest_common.sh@955 -- # kill 664556 00:14:39.931 15:09:39 -- common/autotest_common.sh@960 -- # wait 664556 00:14:40.191 15:09:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:40.191 15:09:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:40.191 15:09:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:40.191 15:09:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:40.191 15:09:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:40.191 15:09:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:40.191 15:09:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:40.191 15:09:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.096 15:09:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:42.096 00:14:42.096 real 0m47.375s 00:14:42.096 user 3m35.270s 00:14:42.096 sys 0m15.998s 00:14:42.096 15:09:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:42.096 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:14:42.096 ************************************ 00:14:42.096 END TEST nvmf_ns_hotplug_stress 00:14:42.096 ************************************ 00:14:42.096 15:09:42 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:42.096 15:09:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:42.096 15:09:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:42.096 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:14:42.096 ************************************ 00:14:42.096 START TEST nvmf_connect_stress 00:14:42.096 ************************************ 00:14:42.096 15:09:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:42.356 * Looking for test storage... 00:14:42.356 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:42.356 15:09:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:42.356 15:09:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:42.356 15:09:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:42.356 15:09:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:42.356 15:09:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:42.356 15:09:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:42.356 15:09:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:42.356 15:09:42 -- scripts/common.sh@335 -- # IFS=.-: 00:14:42.356 15:09:42 -- scripts/common.sh@335 -- # read -ra ver1 00:14:42.356 15:09:42 -- scripts/common.sh@336 -- # IFS=.-: 00:14:42.356 15:09:42 -- scripts/common.sh@336 -- # read -ra ver2 00:14:42.356 15:09:42 -- scripts/common.sh@337 -- # local 'op=<' 00:14:42.356 15:09:42 -- scripts/common.sh@339 -- # ver1_l=2 00:14:42.356 15:09:42 -- scripts/common.sh@340 -- # ver2_l=1 00:14:42.356 15:09:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:42.356 15:09:42 -- scripts/common.sh@343 -- # case "$op" in 00:14:42.356 15:09:42 -- scripts/common.sh@344 -- # : 1 00:14:42.356 15:09:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:42.356 15:09:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:42.356 15:09:42 -- scripts/common.sh@364 -- # decimal 1 00:14:42.356 15:09:42 -- scripts/common.sh@352 -- # local d=1 00:14:42.356 15:09:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:42.356 15:09:42 -- scripts/common.sh@354 -- # echo 1 00:14:42.356 15:09:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:42.356 15:09:42 -- scripts/common.sh@365 -- # decimal 2 00:14:42.356 15:09:42 -- scripts/common.sh@352 -- # local d=2 00:14:42.356 15:09:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:42.356 15:09:42 -- scripts/common.sh@354 -- # echo 2 00:14:42.356 15:09:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:42.356 15:09:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:42.356 15:09:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:42.356 15:09:42 -- scripts/common.sh@367 -- # return 0 00:14:42.356 15:09:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:42.356 15:09:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:42.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.356 --rc genhtml_branch_coverage=1 00:14:42.356 --rc genhtml_function_coverage=1 00:14:42.356 --rc genhtml_legend=1 00:14:42.356 --rc geninfo_all_blocks=1 00:14:42.356 --rc geninfo_unexecuted_blocks=1 00:14:42.356 00:14:42.356 ' 00:14:42.356 15:09:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:42.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.356 --rc genhtml_branch_coverage=1 00:14:42.356 --rc genhtml_function_coverage=1 00:14:42.356 --rc genhtml_legend=1 00:14:42.356 --rc geninfo_all_blocks=1 00:14:42.356 --rc geninfo_unexecuted_blocks=1 00:14:42.356 00:14:42.356 ' 00:14:42.356 15:09:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:42.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.356 --rc genhtml_branch_coverage=1 00:14:42.356 --rc genhtml_function_coverage=1 00:14:42.356 --rc genhtml_legend=1 00:14:42.356 --rc geninfo_all_blocks=1 00:14:42.356 --rc geninfo_unexecuted_blocks=1 00:14:42.356 00:14:42.356 ' 00:14:42.356 15:09:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:42.356 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:42.356 --rc genhtml_branch_coverage=1 00:14:42.356 --rc genhtml_function_coverage=1 00:14:42.356 --rc genhtml_legend=1 00:14:42.356 --rc geninfo_all_blocks=1 00:14:42.356 --rc geninfo_unexecuted_blocks=1 00:14:42.356 00:14:42.356 ' 00:14:42.356 15:09:42 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:42.356 15:09:42 -- nvmf/common.sh@7 -- # uname -s 00:14:42.356 15:09:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:42.356 15:09:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:42.356 15:09:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:42.356 15:09:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:42.356 15:09:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:42.356 15:09:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:42.356 15:09:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:42.356 15:09:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:42.356 15:09:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:42.356 15:09:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:42.356 15:09:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:42.356 15:09:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:42.356 15:09:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:42.356 15:09:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:42.356 15:09:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:42.356 15:09:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:42.356 15:09:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:42.356 15:09:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:42.356 15:09:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:42.356 15:09:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.356 15:09:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.356 15:09:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.356 15:09:42 -- paths/export.sh@5 -- # export PATH 00:14:42.356 15:09:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:42.356 15:09:42 -- nvmf/common.sh@46 -- # : 0 00:14:42.356 15:09:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:42.356 15:09:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:42.356 15:09:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:42.357 15:09:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:42.357 15:09:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:42.357 15:09:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:42.357 15:09:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:42.357 15:09:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:42.357 15:09:42 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:42.357 15:09:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:42.357 15:09:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:42.357 15:09:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:42.357 15:09:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:42.357 15:09:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:42.357 15:09:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:42.357 15:09:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:42.357 15:09:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:42.357 15:09:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:42.357 15:09:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:42.357 15:09:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:42.357 15:09:42 -- common/autotest_common.sh@10 -- # set +x 00:14:44.260 15:09:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:44.260 15:09:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:44.260 15:09:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:44.260 15:09:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:44.260 15:09:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:44.260 15:09:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:44.260 15:09:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:44.260 15:09:44 -- nvmf/common.sh@294 -- # net_devs=() 00:14:44.260 15:09:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:44.260 15:09:44 -- nvmf/common.sh@295 -- # e810=() 00:14:44.260 15:09:44 -- nvmf/common.sh@295 -- # local -ga e810 00:14:44.260 15:09:44 -- nvmf/common.sh@296 -- # x722=() 00:14:44.260 15:09:44 -- nvmf/common.sh@296 -- # local -ga x722 00:14:44.260 15:09:44 -- nvmf/common.sh@297 -- # mlx=() 00:14:44.260 15:09:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:44.260 15:09:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:44.260 15:09:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:44.260 15:09:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:44.260 15:09:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:44.260 15:09:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:44.260 15:09:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:44.260 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:44.260 15:09:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:44.260 15:09:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:44.260 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:44.260 15:09:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:44.260 15:09:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:44.260 15:09:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.260 15:09:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:44.260 15:09:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.260 15:09:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:44.260 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:44.260 15:09:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.260 15:09:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:44.260 15:09:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:44.260 15:09:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:44.260 15:09:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:44.260 15:09:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:44.260 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:44.260 15:09:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:44.260 15:09:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:44.260 15:09:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:44.260 15:09:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:44.260 15:09:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:44.260 15:09:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:44.260 15:09:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:44.260 15:09:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:44.260 15:09:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:44.260 15:09:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:44.260 15:09:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:44.260 15:09:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:44.260 15:09:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:44.260 15:09:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:44.260 15:09:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:44.260 15:09:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:44.260 15:09:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:44.260 15:09:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:44.260 15:09:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:44.260 15:09:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:44.260 15:09:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:44.260 15:09:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:44.519 15:09:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:44.519 15:09:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:44.519 15:09:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:44.519 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:44.519 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:14:44.519 00:14:44.519 --- 10.0.0.2 ping statistics --- 00:14:44.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:44.519 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:14:44.519 15:09:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:44.519 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:44.519 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.081 ms 00:14:44.519 00:14:44.519 --- 10.0.0.1 ping statistics --- 00:14:44.519 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:44.519 rtt min/avg/max/mdev = 0.081/0.081/0.081/0.000 ms 00:14:44.519 15:09:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:44.519 15:09:44 -- nvmf/common.sh@410 -- # return 0 00:14:44.519 15:09:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:44.519 15:09:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:44.519 15:09:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:44.519 15:09:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:44.519 15:09:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:44.519 15:09:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:44.519 15:09:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:44.519 15:09:44 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:44.520 15:09:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:44.520 15:09:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:44.520 15:09:44 -- common/autotest_common.sh@10 -- # set +x 00:14:44.520 15:09:44 -- nvmf/common.sh@469 -- # nvmfpid=672571 00:14:44.520 15:09:44 -- nvmf/common.sh@470 -- # waitforlisten 672571 00:14:44.520 15:09:44 -- common/autotest_common.sh@829 -- # '[' -z 672571 ']' 00:14:44.520 15:09:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:44.520 15:09:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:44.520 15:09:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:44.520 15:09:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:44.520 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:44.520 15:09:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:44.520 15:09:44 -- common/autotest_common.sh@10 -- # set +x 00:14:44.520 [2024-11-28 15:09:44.595535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:14:44.520 [2024-11-28 15:09:44.595635] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:44.520 EAL: No free 2048 kB hugepages reported on node 1 00:14:44.520 [2024-11-28 15:09:44.664487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:44.520 [2024-11-28 15:09:44.753100] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:44.778 [2024-11-28 15:09:44.753286] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:44.778 [2024-11-28 15:09:44.753307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:44.778 [2024-11-28 15:09:44.753323] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:44.778 [2024-11-28 15:09:44.753424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:44.778 [2024-11-28 15:09:44.753476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:44.778 [2024-11-28 15:09:44.753479] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:45.354 15:09:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:45.354 15:09:45 -- common/autotest_common.sh@862 -- # return 0 00:14:45.354 15:09:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:45.354 15:09:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:45.354 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:45.354 15:09:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:45.354 15:09:45 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:45.354 15:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.354 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:45.354 [2024-11-28 15:09:45.574856] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:45.354 15:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.354 15:09:45 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:45.354 15:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.354 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:45.612 15:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.612 15:09:45 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:45.612 15:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.612 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:45.612 [2024-11-28 15:09:45.599225] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:45.612 15:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.612 15:09:45 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:45.612 15:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.612 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:45.612 NULL1 00:14:45.612 15:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.612 15:09:45 -- target/connect_stress.sh@21 -- # PERF_PID=672728 00:14:45.612 15:09:45 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:45.612 15:09:45 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:45.612 15:09:45 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 EAL: No free 2048 kB hugepages reported on node 1 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:45.612 15:09:45 -- target/connect_stress.sh@28 -- # cat 00:14:45.612 15:09:45 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:45.612 15:09:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.612 15:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.612 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:45.869 15:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.869 15:09:45 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:45.869 15:09:45 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.869 15:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.869 15:09:45 -- common/autotest_common.sh@10 -- # set +x 00:14:46.127 15:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.127 15:09:46 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:46.127 15:09:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.127 15:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.127 15:09:46 -- common/autotest_common.sh@10 -- # set +x 00:14:46.692 15:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.692 15:09:46 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:46.692 15:09:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.692 15:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.692 15:09:46 -- common/autotest_common.sh@10 -- # set +x 00:14:46.951 15:09:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.951 15:09:46 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:46.951 15:09:46 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.951 15:09:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.951 15:09:46 -- common/autotest_common.sh@10 -- # set +x 00:14:47.209 15:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.209 15:09:47 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:47.209 15:09:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.209 15:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.209 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:14:47.467 15:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.467 15:09:47 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:47.467 15:09:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.467 15:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.467 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:14:47.726 15:09:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.726 15:09:47 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:47.726 15:09:47 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.726 15:09:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.726 15:09:47 -- common/autotest_common.sh@10 -- # set +x 00:14:48.291 15:09:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.291 15:09:48 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:48.291 15:09:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.291 15:09:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.291 15:09:48 -- common/autotest_common.sh@10 -- # set +x 00:14:48.549 15:09:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.549 15:09:48 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:48.549 15:09:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.549 15:09:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.549 15:09:48 -- common/autotest_common.sh@10 -- # set +x 00:14:48.806 15:09:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.806 15:09:48 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:48.806 15:09:48 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.806 15:09:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.806 15:09:48 -- common/autotest_common.sh@10 -- # set +x 00:14:49.063 15:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.063 15:09:49 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:49.064 15:09:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.064 15:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.064 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:49.321 15:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.321 15:09:49 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:49.321 15:09:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.321 15:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.321 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:49.889 15:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.889 15:09:49 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:49.889 15:09:49 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.889 15:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.889 15:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:50.147 15:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.147 15:09:50 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:50.147 15:09:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.147 15:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.147 15:09:50 -- common/autotest_common.sh@10 -- # set +x 00:14:50.405 15:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.405 15:09:50 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:50.405 15:09:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.406 15:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.406 15:09:50 -- common/autotest_common.sh@10 -- # set +x 00:14:50.664 15:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.664 15:09:50 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:50.664 15:09:50 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.664 15:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.664 15:09:50 -- common/autotest_common.sh@10 -- # set +x 00:14:50.921 15:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.921 15:09:51 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:50.921 15:09:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.921 15:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.921 15:09:51 -- common/autotest_common.sh@10 -- # set +x 00:14:51.487 15:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.487 15:09:51 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:51.487 15:09:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.487 15:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.487 15:09:51 -- common/autotest_common.sh@10 -- # set +x 00:14:51.744 15:09:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.744 15:09:51 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:51.744 15:09:51 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.744 15:09:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.744 15:09:51 -- common/autotest_common.sh@10 -- # set +x 00:14:52.001 15:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.001 15:09:52 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:52.001 15:09:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.001 15:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.001 15:09:52 -- common/autotest_common.sh@10 -- # set +x 00:14:52.259 15:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.259 15:09:52 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:52.259 15:09:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.259 15:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.259 15:09:52 -- common/autotest_common.sh@10 -- # set +x 00:14:52.517 15:09:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.517 15:09:52 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:52.517 15:09:52 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:52.517 15:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:52.517 15:09:52 -- common/autotest_common.sh@10 -- # set +x 00:14:53.082 15:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.082 15:09:53 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:53.082 15:09:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.082 15:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.082 15:09:53 -- common/autotest_common.sh@10 -- # set +x 00:14:53.339 15:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.339 15:09:53 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:53.339 15:09:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.339 15:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.339 15:09:53 -- common/autotest_common.sh@10 -- # set +x 00:14:53.597 15:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.597 15:09:53 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:53.597 15:09:53 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.597 15:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.597 15:09:53 -- common/autotest_common.sh@10 -- # set +x 00:14:53.854 15:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.854 15:09:54 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:53.854 15:09:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:53.854 15:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.854 15:09:54 -- common/autotest_common.sh@10 -- # set +x 00:14:54.111 15:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.111 15:09:54 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:54.111 15:09:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.111 15:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.111 15:09:54 -- common/autotest_common.sh@10 -- # set +x 00:14:54.676 15:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.676 15:09:54 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:54.676 15:09:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.676 15:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.676 15:09:54 -- common/autotest_common.sh@10 -- # set +x 00:14:54.934 15:09:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:54.934 15:09:54 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:54.934 15:09:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:54.934 15:09:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:54.934 15:09:54 -- common/autotest_common.sh@10 -- # set +x 00:14:55.191 15:09:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.191 15:09:55 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:55.191 15:09:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.191 15:09:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.191 15:09:55 -- common/autotest_common.sh@10 -- # set +x 00:14:55.448 15:09:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.448 15:09:55 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:55.448 15:09:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:55.448 15:09:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:55.448 15:09:55 -- common/autotest_common.sh@10 -- # set +x 00:14:55.706 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:55.706 15:09:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:55.706 15:09:55 -- target/connect_stress.sh@34 -- # kill -0 672728 00:14:55.706 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (672728) - No such process 00:14:55.706 15:09:55 -- target/connect_stress.sh@38 -- # wait 672728 00:14:55.706 15:09:55 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:55.964 15:09:55 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:55.964 15:09:55 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:55.964 15:09:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:55.964 15:09:55 -- nvmf/common.sh@116 -- # sync 00:14:55.964 15:09:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:55.964 15:09:55 -- nvmf/common.sh@119 -- # set +e 00:14:55.964 15:09:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:55.964 15:09:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:55.964 rmmod nvme_tcp 00:14:55.964 rmmod nvme_fabrics 00:14:55.964 rmmod nvme_keyring 00:14:55.964 15:09:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:55.964 15:09:55 -- nvmf/common.sh@123 -- # set -e 00:14:55.964 15:09:55 -- nvmf/common.sh@124 -- # return 0 00:14:55.964 15:09:55 -- nvmf/common.sh@477 -- # '[' -n 672571 ']' 00:14:55.964 15:09:55 -- nvmf/common.sh@478 -- # killprocess 672571 00:14:55.964 15:09:55 -- common/autotest_common.sh@936 -- # '[' -z 672571 ']' 00:14:55.964 15:09:55 -- common/autotest_common.sh@940 -- # kill -0 672571 00:14:55.964 15:09:55 -- common/autotest_common.sh@941 -- # uname 00:14:55.964 15:09:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:55.964 15:09:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 672571 00:14:55.964 15:09:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:55.964 15:09:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:55.964 15:09:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 672571' 00:14:55.964 killing process with pid 672571 00:14:55.964 15:09:56 -- common/autotest_common.sh@955 -- # kill 672571 00:14:55.964 15:09:56 -- common/autotest_common.sh@960 -- # wait 672571 00:14:56.223 15:09:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:56.223 15:09:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:56.223 15:09:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:56.223 15:09:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:56.223 15:09:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:56.223 15:09:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:56.223 15:09:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:56.223 15:09:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.130 15:09:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:58.130 00:14:58.130 real 0m16.014s 00:14:58.130 user 0m40.832s 00:14:58.130 sys 0m5.730s 00:14:58.130 15:09:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:58.130 15:09:58 -- common/autotest_common.sh@10 -- # set +x 00:14:58.130 ************************************ 00:14:58.130 END TEST nvmf_connect_stress 00:14:58.130 ************************************ 00:14:58.130 15:09:58 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:58.130 15:09:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:58.130 15:09:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:58.130 15:09:58 -- common/autotest_common.sh@10 -- # set +x 00:14:58.130 ************************************ 00:14:58.130 START TEST nvmf_fused_ordering 00:14:58.130 ************************************ 00:14:58.130 15:09:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:58.389 * Looking for test storage... 00:14:58.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:58.389 15:09:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:58.389 15:09:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:58.389 15:09:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:58.389 15:09:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:58.389 15:09:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:58.389 15:09:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:58.389 15:09:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:58.389 15:09:58 -- scripts/common.sh@335 -- # IFS=.-: 00:14:58.389 15:09:58 -- scripts/common.sh@335 -- # read -ra ver1 00:14:58.389 15:09:58 -- scripts/common.sh@336 -- # IFS=.-: 00:14:58.389 15:09:58 -- scripts/common.sh@336 -- # read -ra ver2 00:14:58.389 15:09:58 -- scripts/common.sh@337 -- # local 'op=<' 00:14:58.389 15:09:58 -- scripts/common.sh@339 -- # ver1_l=2 00:14:58.389 15:09:58 -- scripts/common.sh@340 -- # ver2_l=1 00:14:58.389 15:09:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:58.389 15:09:58 -- scripts/common.sh@343 -- # case "$op" in 00:14:58.389 15:09:58 -- scripts/common.sh@344 -- # : 1 00:14:58.389 15:09:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:58.389 15:09:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:58.389 15:09:58 -- scripts/common.sh@364 -- # decimal 1 00:14:58.389 15:09:58 -- scripts/common.sh@352 -- # local d=1 00:14:58.389 15:09:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:58.389 15:09:58 -- scripts/common.sh@354 -- # echo 1 00:14:58.389 15:09:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:58.389 15:09:58 -- scripts/common.sh@365 -- # decimal 2 00:14:58.389 15:09:58 -- scripts/common.sh@352 -- # local d=2 00:14:58.389 15:09:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:58.389 15:09:58 -- scripts/common.sh@354 -- # echo 2 00:14:58.389 15:09:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:58.389 15:09:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:58.389 15:09:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:58.389 15:09:58 -- scripts/common.sh@367 -- # return 0 00:14:58.389 15:09:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:58.389 15:09:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:58.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.389 --rc genhtml_branch_coverage=1 00:14:58.389 --rc genhtml_function_coverage=1 00:14:58.389 --rc genhtml_legend=1 00:14:58.389 --rc geninfo_all_blocks=1 00:14:58.389 --rc geninfo_unexecuted_blocks=1 00:14:58.389 00:14:58.389 ' 00:14:58.389 15:09:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:58.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.389 --rc genhtml_branch_coverage=1 00:14:58.389 --rc genhtml_function_coverage=1 00:14:58.389 --rc genhtml_legend=1 00:14:58.389 --rc geninfo_all_blocks=1 00:14:58.389 --rc geninfo_unexecuted_blocks=1 00:14:58.389 00:14:58.389 ' 00:14:58.389 15:09:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:58.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.389 --rc genhtml_branch_coverage=1 00:14:58.389 --rc genhtml_function_coverage=1 00:14:58.389 --rc genhtml_legend=1 00:14:58.389 --rc geninfo_all_blocks=1 00:14:58.389 --rc geninfo_unexecuted_blocks=1 00:14:58.389 00:14:58.389 ' 00:14:58.389 15:09:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:58.389 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:58.389 --rc genhtml_branch_coverage=1 00:14:58.389 --rc genhtml_function_coverage=1 00:14:58.389 --rc genhtml_legend=1 00:14:58.389 --rc geninfo_all_blocks=1 00:14:58.389 --rc geninfo_unexecuted_blocks=1 00:14:58.389 00:14:58.389 ' 00:14:58.389 15:09:58 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:58.389 15:09:58 -- nvmf/common.sh@7 -- # uname -s 00:14:58.389 15:09:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:58.389 15:09:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:58.389 15:09:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:58.389 15:09:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:58.389 15:09:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:58.389 15:09:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:58.389 15:09:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:58.389 15:09:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:58.389 15:09:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:58.389 15:09:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:58.389 15:09:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:58.389 15:09:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:58.389 15:09:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:58.389 15:09:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:58.389 15:09:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:58.389 15:09:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:58.389 15:09:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:58.389 15:09:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:58.389 15:09:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:58.389 15:09:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.390 15:09:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.390 15:09:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.390 15:09:58 -- paths/export.sh@5 -- # export PATH 00:14:58.390 15:09:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:58.390 15:09:58 -- nvmf/common.sh@46 -- # : 0 00:14:58.390 15:09:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:58.390 15:09:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:58.390 15:09:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:58.390 15:09:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:58.390 15:09:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:58.390 15:09:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:58.390 15:09:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:58.390 15:09:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:58.390 15:09:58 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:58.390 15:09:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:58.390 15:09:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:58.390 15:09:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:58.390 15:09:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:58.390 15:09:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:58.390 15:09:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:58.390 15:09:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:58.390 15:09:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:58.390 15:09:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:58.390 15:09:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:58.390 15:09:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:58.390 15:09:58 -- common/autotest_common.sh@10 -- # set +x 00:15:00.294 15:10:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:00.294 15:10:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:00.294 15:10:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:00.294 15:10:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:00.294 15:10:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:00.294 15:10:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:00.294 15:10:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:00.294 15:10:00 -- nvmf/common.sh@294 -- # net_devs=() 00:15:00.294 15:10:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:00.294 15:10:00 -- nvmf/common.sh@295 -- # e810=() 00:15:00.294 15:10:00 -- nvmf/common.sh@295 -- # local -ga e810 00:15:00.294 15:10:00 -- nvmf/common.sh@296 -- # x722=() 00:15:00.294 15:10:00 -- nvmf/common.sh@296 -- # local -ga x722 00:15:00.294 15:10:00 -- nvmf/common.sh@297 -- # mlx=() 00:15:00.294 15:10:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:00.294 15:10:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:00.294 15:10:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:00.294 15:10:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:00.294 15:10:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:00.294 15:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:00.294 15:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:00.294 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:00.294 15:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:00.294 15:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:00.294 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:00.294 15:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:00.294 15:10:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:00.294 15:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:00.294 15:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:00.294 15:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:00.294 15:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:00.294 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:00.294 15:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:00.294 15:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:00.294 15:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:00.294 15:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:00.294 15:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:00.294 15:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:00.294 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:00.294 15:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:00.294 15:10:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:00.294 15:10:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:00.294 15:10:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:00.294 15:10:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:00.294 15:10:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:00.294 15:10:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:00.294 15:10:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:00.294 15:10:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:00.294 15:10:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:00.294 15:10:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:00.294 15:10:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:00.294 15:10:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:00.294 15:10:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:00.294 15:10:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:00.294 15:10:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:00.294 15:10:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:00.294 15:10:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:00.552 15:10:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:00.552 15:10:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:00.552 15:10:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:00.552 15:10:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:00.552 15:10:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:00.552 15:10:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:00.552 15:10:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:00.552 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:00.552 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:15:00.552 00:15:00.552 --- 10.0.0.2 ping statistics --- 00:15:00.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:00.552 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:15:00.552 15:10:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:00.552 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:00.552 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:15:00.552 00:15:00.552 --- 10.0.0.1 ping statistics --- 00:15:00.552 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:00.552 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:15:00.552 15:10:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:00.552 15:10:00 -- nvmf/common.sh@410 -- # return 0 00:15:00.552 15:10:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:00.552 15:10:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:00.552 15:10:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:00.552 15:10:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:00.552 15:10:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:00.552 15:10:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:00.552 15:10:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:00.552 15:10:00 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:15:00.552 15:10:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:00.552 15:10:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:00.552 15:10:00 -- common/autotest_common.sh@10 -- # set +x 00:15:00.552 15:10:00 -- nvmf/common.sh@469 -- # nvmfpid=675926 00:15:00.552 15:10:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:00.552 15:10:00 -- nvmf/common.sh@470 -- # waitforlisten 675926 00:15:00.552 15:10:00 -- common/autotest_common.sh@829 -- # '[' -z 675926 ']' 00:15:00.552 15:10:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:00.552 15:10:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:00.552 15:10:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:00.552 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:00.552 15:10:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:00.552 15:10:00 -- common/autotest_common.sh@10 -- # set +x 00:15:00.552 [2024-11-28 15:10:00.700211] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:00.552 [2024-11-28 15:10:00.700297] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:00.552 EAL: No free 2048 kB hugepages reported on node 1 00:15:00.552 [2024-11-28 15:10:00.769179] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:00.811 [2024-11-28 15:10:00.863356] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:00.811 [2024-11-28 15:10:00.863535] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:00.811 [2024-11-28 15:10:00.863555] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:00.811 [2024-11-28 15:10:00.863570] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:00.811 [2024-11-28 15:10:00.863602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:01.748 15:10:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:01.748 15:10:01 -- common/autotest_common.sh@862 -- # return 0 00:15:01.748 15:10:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:01.748 15:10:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 15:10:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:01.748 15:10:01 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:01.748 15:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 [2024-11-28 15:10:01.747861] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:01.748 15:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.748 15:10:01 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:01.748 15:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 15:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.748 15:10:01 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:01.748 15:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 [2024-11-28 15:10:01.764040] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:01.748 15:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.748 15:10:01 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:01.748 15:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 NULL1 00:15:01.748 15:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.748 15:10:01 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:15:01.748 15:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 15:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.748 15:10:01 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:15:01.748 15:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:01.748 15:10:01 -- common/autotest_common.sh@10 -- # set +x 00:15:01.748 15:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:01.748 15:10:01 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:15:01.748 [2024-11-28 15:10:01.809289] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:01.748 [2024-11-28 15:10:01.809328] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid676085 ] 00:15:01.748 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.006 Attached to nqn.2016-06.io.spdk:cnode1 00:15:02.006 Namespace ID: 1 size: 1GB 00:15:02.006 fused_ordering(0) 00:15:02.006 fused_ordering(1) 00:15:02.006 fused_ordering(2) 00:15:02.006 fused_ordering(3) 00:15:02.006 fused_ordering(4) 00:15:02.006 fused_ordering(5) 00:15:02.006 fused_ordering(6) 00:15:02.006 fused_ordering(7) 00:15:02.006 fused_ordering(8) 00:15:02.006 fused_ordering(9) 00:15:02.006 fused_ordering(10) 00:15:02.006 fused_ordering(11) 00:15:02.006 fused_ordering(12) 00:15:02.006 fused_ordering(13) 00:15:02.006 fused_ordering(14) 00:15:02.006 fused_ordering(15) 00:15:02.006 fused_ordering(16) 00:15:02.006 fused_ordering(17) 00:15:02.006 fused_ordering(18) 00:15:02.006 fused_ordering(19) 00:15:02.006 fused_ordering(20) 00:15:02.006 fused_ordering(21) 00:15:02.006 fused_ordering(22) 00:15:02.006 fused_ordering(23) 00:15:02.006 fused_ordering(24) 00:15:02.006 fused_ordering(25) 00:15:02.006 fused_ordering(26) 00:15:02.006 fused_ordering(27) 00:15:02.006 fused_ordering(28) 00:15:02.006 fused_ordering(29) 00:15:02.006 fused_ordering(30) 00:15:02.006 fused_ordering(31) 00:15:02.006 fused_ordering(32) 00:15:02.006 fused_ordering(33) 00:15:02.006 fused_ordering(34) 00:15:02.006 fused_ordering(35) 00:15:02.006 fused_ordering(36) 00:15:02.006 fused_ordering(37) 00:15:02.006 fused_ordering(38) 00:15:02.006 fused_ordering(39) 00:15:02.006 fused_ordering(40) 00:15:02.006 fused_ordering(41) 00:15:02.006 fused_ordering(42) 00:15:02.006 fused_ordering(43) 00:15:02.006 fused_ordering(44) 00:15:02.006 fused_ordering(45) 00:15:02.006 fused_ordering(46) 00:15:02.006 fused_ordering(47) 00:15:02.006 fused_ordering(48) 00:15:02.006 fused_ordering(49) 00:15:02.006 fused_ordering(50) 00:15:02.006 fused_ordering(51) 00:15:02.006 fused_ordering(52) 00:15:02.006 fused_ordering(53) 00:15:02.006 fused_ordering(54) 00:15:02.006 fused_ordering(55) 00:15:02.006 fused_ordering(56) 00:15:02.006 fused_ordering(57) 00:15:02.006 fused_ordering(58) 00:15:02.006 fused_ordering(59) 00:15:02.006 fused_ordering(60) 00:15:02.006 fused_ordering(61) 00:15:02.006 fused_ordering(62) 00:15:02.006 fused_ordering(63) 00:15:02.006 fused_ordering(64) 00:15:02.006 fused_ordering(65) 00:15:02.006 fused_ordering(66) 00:15:02.006 fused_ordering(67) 00:15:02.006 fused_ordering(68) 00:15:02.006 fused_ordering(69) 00:15:02.006 fused_ordering(70) 00:15:02.006 fused_ordering(71) 00:15:02.006 fused_ordering(72) 00:15:02.006 fused_ordering(73) 00:15:02.006 fused_ordering(74) 00:15:02.006 fused_ordering(75) 00:15:02.006 fused_ordering(76) 00:15:02.006 fused_ordering(77) 00:15:02.006 fused_ordering(78) 00:15:02.006 fused_ordering(79) 00:15:02.006 fused_ordering(80) 00:15:02.006 fused_ordering(81) 00:15:02.006 fused_ordering(82) 00:15:02.006 fused_ordering(83) 00:15:02.006 fused_ordering(84) 00:15:02.006 fused_ordering(85) 00:15:02.006 fused_ordering(86) 00:15:02.006 fused_ordering(87) 00:15:02.006 fused_ordering(88) 00:15:02.006 fused_ordering(89) 00:15:02.006 fused_ordering(90) 00:15:02.006 fused_ordering(91) 00:15:02.006 fused_ordering(92) 00:15:02.006 fused_ordering(93) 00:15:02.006 fused_ordering(94) 00:15:02.006 fused_ordering(95) 00:15:02.006 fused_ordering(96) 00:15:02.006 fused_ordering(97) 00:15:02.006 fused_ordering(98) 00:15:02.006 fused_ordering(99) 00:15:02.006 fused_ordering(100) 00:15:02.006 fused_ordering(101) 00:15:02.006 fused_ordering(102) 00:15:02.006 fused_ordering(103) 00:15:02.006 fused_ordering(104) 00:15:02.006 fused_ordering(105) 00:15:02.006 fused_ordering(106) 00:15:02.006 fused_ordering(107) 00:15:02.006 fused_ordering(108) 00:15:02.006 fused_ordering(109) 00:15:02.006 fused_ordering(110) 00:15:02.006 fused_ordering(111) 00:15:02.006 fused_ordering(112) 00:15:02.006 fused_ordering(113) 00:15:02.006 fused_ordering(114) 00:15:02.006 fused_ordering(115) 00:15:02.006 fused_ordering(116) 00:15:02.006 fused_ordering(117) 00:15:02.006 fused_ordering(118) 00:15:02.006 fused_ordering(119) 00:15:02.006 fused_ordering(120) 00:15:02.006 fused_ordering(121) 00:15:02.006 fused_ordering(122) 00:15:02.006 fused_ordering(123) 00:15:02.006 fused_ordering(124) 00:15:02.006 fused_ordering(125) 00:15:02.006 fused_ordering(126) 00:15:02.006 fused_ordering(127) 00:15:02.006 fused_ordering(128) 00:15:02.006 fused_ordering(129) 00:15:02.006 fused_ordering(130) 00:15:02.006 fused_ordering(131) 00:15:02.006 fused_ordering(132) 00:15:02.006 fused_ordering(133) 00:15:02.006 fused_ordering(134) 00:15:02.006 fused_ordering(135) 00:15:02.006 fused_ordering(136) 00:15:02.006 fused_ordering(137) 00:15:02.006 fused_ordering(138) 00:15:02.006 fused_ordering(139) 00:15:02.006 fused_ordering(140) 00:15:02.006 fused_ordering(141) 00:15:02.006 fused_ordering(142) 00:15:02.006 fused_ordering(143) 00:15:02.006 fused_ordering(144) 00:15:02.006 fused_ordering(145) 00:15:02.006 fused_ordering(146) 00:15:02.006 fused_ordering(147) 00:15:02.006 fused_ordering(148) 00:15:02.006 fused_ordering(149) 00:15:02.006 fused_ordering(150) 00:15:02.006 fused_ordering(151) 00:15:02.006 fused_ordering(152) 00:15:02.006 fused_ordering(153) 00:15:02.006 fused_ordering(154) 00:15:02.006 fused_ordering(155) 00:15:02.006 fused_ordering(156) 00:15:02.006 fused_ordering(157) 00:15:02.006 fused_ordering(158) 00:15:02.006 fused_ordering(159) 00:15:02.006 fused_ordering(160) 00:15:02.006 fused_ordering(161) 00:15:02.006 fused_ordering(162) 00:15:02.006 fused_ordering(163) 00:15:02.006 fused_ordering(164) 00:15:02.006 fused_ordering(165) 00:15:02.006 fused_ordering(166) 00:15:02.006 fused_ordering(167) 00:15:02.006 fused_ordering(168) 00:15:02.006 fused_ordering(169) 00:15:02.006 fused_ordering(170) 00:15:02.006 fused_ordering(171) 00:15:02.006 fused_ordering(172) 00:15:02.006 fused_ordering(173) 00:15:02.006 fused_ordering(174) 00:15:02.006 fused_ordering(175) 00:15:02.007 fused_ordering(176) 00:15:02.007 fused_ordering(177) 00:15:02.007 fused_ordering(178) 00:15:02.007 fused_ordering(179) 00:15:02.007 fused_ordering(180) 00:15:02.007 fused_ordering(181) 00:15:02.007 fused_ordering(182) 00:15:02.007 fused_ordering(183) 00:15:02.007 fused_ordering(184) 00:15:02.007 fused_ordering(185) 00:15:02.007 fused_ordering(186) 00:15:02.007 fused_ordering(187) 00:15:02.007 fused_ordering(188) 00:15:02.007 fused_ordering(189) 00:15:02.007 fused_ordering(190) 00:15:02.007 fused_ordering(191) 00:15:02.007 fused_ordering(192) 00:15:02.007 fused_ordering(193) 00:15:02.007 fused_ordering(194) 00:15:02.007 fused_ordering(195) 00:15:02.007 fused_ordering(196) 00:15:02.007 fused_ordering(197) 00:15:02.007 fused_ordering(198) 00:15:02.007 fused_ordering(199) 00:15:02.007 fused_ordering(200) 00:15:02.007 fused_ordering(201) 00:15:02.007 fused_ordering(202) 00:15:02.007 fused_ordering(203) 00:15:02.007 fused_ordering(204) 00:15:02.007 fused_ordering(205) 00:15:02.573 fused_ordering(206) 00:15:02.573 fused_ordering(207) 00:15:02.573 fused_ordering(208) 00:15:02.573 fused_ordering(209) 00:15:02.573 fused_ordering(210) 00:15:02.573 fused_ordering(211) 00:15:02.573 fused_ordering(212) 00:15:02.573 fused_ordering(213) 00:15:02.573 fused_ordering(214) 00:15:02.573 fused_ordering(215) 00:15:02.573 fused_ordering(216) 00:15:02.573 fused_ordering(217) 00:15:02.573 fused_ordering(218) 00:15:02.573 fused_ordering(219) 00:15:02.573 fused_ordering(220) 00:15:02.573 fused_ordering(221) 00:15:02.573 fused_ordering(222) 00:15:02.573 fused_ordering(223) 00:15:02.573 fused_ordering(224) 00:15:02.573 fused_ordering(225) 00:15:02.573 fused_ordering(226) 00:15:02.573 fused_ordering(227) 00:15:02.573 fused_ordering(228) 00:15:02.573 fused_ordering(229) 00:15:02.573 fused_ordering(230) 00:15:02.573 fused_ordering(231) 00:15:02.573 fused_ordering(232) 00:15:02.573 fused_ordering(233) 00:15:02.573 fused_ordering(234) 00:15:02.573 fused_ordering(235) 00:15:02.573 fused_ordering(236) 00:15:02.573 fused_ordering(237) 00:15:02.573 fused_ordering(238) 00:15:02.573 fused_ordering(239) 00:15:02.573 fused_ordering(240) 00:15:02.573 fused_ordering(241) 00:15:02.573 fused_ordering(242) 00:15:02.573 fused_ordering(243) 00:15:02.573 fused_ordering(244) 00:15:02.573 fused_ordering(245) 00:15:02.573 fused_ordering(246) 00:15:02.574 fused_ordering(247) 00:15:02.574 fused_ordering(248) 00:15:02.574 fused_ordering(249) 00:15:02.574 fused_ordering(250) 00:15:02.574 fused_ordering(251) 00:15:02.574 fused_ordering(252) 00:15:02.574 fused_ordering(253) 00:15:02.574 fused_ordering(254) 00:15:02.574 fused_ordering(255) 00:15:02.574 fused_ordering(256) 00:15:02.574 fused_ordering(257) 00:15:02.574 fused_ordering(258) 00:15:02.574 fused_ordering(259) 00:15:02.574 fused_ordering(260) 00:15:02.574 fused_ordering(261) 00:15:02.574 fused_ordering(262) 00:15:02.574 fused_ordering(263) 00:15:02.574 fused_ordering(264) 00:15:02.574 fused_ordering(265) 00:15:02.574 fused_ordering(266) 00:15:02.574 fused_ordering(267) 00:15:02.574 fused_ordering(268) 00:15:02.574 fused_ordering(269) 00:15:02.574 fused_ordering(270) 00:15:02.574 fused_ordering(271) 00:15:02.574 fused_ordering(272) 00:15:02.574 fused_ordering(273) 00:15:02.574 fused_ordering(274) 00:15:02.574 fused_ordering(275) 00:15:02.574 fused_ordering(276) 00:15:02.574 fused_ordering(277) 00:15:02.574 fused_ordering(278) 00:15:02.574 fused_ordering(279) 00:15:02.574 fused_ordering(280) 00:15:02.574 fused_ordering(281) 00:15:02.574 fused_ordering(282) 00:15:02.574 fused_ordering(283) 00:15:02.574 fused_ordering(284) 00:15:02.574 fused_ordering(285) 00:15:02.574 fused_ordering(286) 00:15:02.574 fused_ordering(287) 00:15:02.574 fused_ordering(288) 00:15:02.574 fused_ordering(289) 00:15:02.574 fused_ordering(290) 00:15:02.574 fused_ordering(291) 00:15:02.574 fused_ordering(292) 00:15:02.574 fused_ordering(293) 00:15:02.574 fused_ordering(294) 00:15:02.574 fused_ordering(295) 00:15:02.574 fused_ordering(296) 00:15:02.574 fused_ordering(297) 00:15:02.574 fused_ordering(298) 00:15:02.574 fused_ordering(299) 00:15:02.574 fused_ordering(300) 00:15:02.574 fused_ordering(301) 00:15:02.574 fused_ordering(302) 00:15:02.574 fused_ordering(303) 00:15:02.574 fused_ordering(304) 00:15:02.574 fused_ordering(305) 00:15:02.574 fused_ordering(306) 00:15:02.574 fused_ordering(307) 00:15:02.574 fused_ordering(308) 00:15:02.574 fused_ordering(309) 00:15:02.574 fused_ordering(310) 00:15:02.574 fused_ordering(311) 00:15:02.574 fused_ordering(312) 00:15:02.574 fused_ordering(313) 00:15:02.574 fused_ordering(314) 00:15:02.574 fused_ordering(315) 00:15:02.574 fused_ordering(316) 00:15:02.574 fused_ordering(317) 00:15:02.574 fused_ordering(318) 00:15:02.574 fused_ordering(319) 00:15:02.574 fused_ordering(320) 00:15:02.574 fused_ordering(321) 00:15:02.574 fused_ordering(322) 00:15:02.574 fused_ordering(323) 00:15:02.574 fused_ordering(324) 00:15:02.574 fused_ordering(325) 00:15:02.574 fused_ordering(326) 00:15:02.574 fused_ordering(327) 00:15:02.574 fused_ordering(328) 00:15:02.574 fused_ordering(329) 00:15:02.574 fused_ordering(330) 00:15:02.574 fused_ordering(331) 00:15:02.574 fused_ordering(332) 00:15:02.574 fused_ordering(333) 00:15:02.574 fused_ordering(334) 00:15:02.574 fused_ordering(335) 00:15:02.574 fused_ordering(336) 00:15:02.574 fused_ordering(337) 00:15:02.574 fused_ordering(338) 00:15:02.574 fused_ordering(339) 00:15:02.574 fused_ordering(340) 00:15:02.574 fused_ordering(341) 00:15:02.574 fused_ordering(342) 00:15:02.574 fused_ordering(343) 00:15:02.574 fused_ordering(344) 00:15:02.574 fused_ordering(345) 00:15:02.574 fused_ordering(346) 00:15:02.574 fused_ordering(347) 00:15:02.574 fused_ordering(348) 00:15:02.574 fused_ordering(349) 00:15:02.574 fused_ordering(350) 00:15:02.574 fused_ordering(351) 00:15:02.574 fused_ordering(352) 00:15:02.574 fused_ordering(353) 00:15:02.574 fused_ordering(354) 00:15:02.574 fused_ordering(355) 00:15:02.574 fused_ordering(356) 00:15:02.574 fused_ordering(357) 00:15:02.574 fused_ordering(358) 00:15:02.574 fused_ordering(359) 00:15:02.574 fused_ordering(360) 00:15:02.574 fused_ordering(361) 00:15:02.574 fused_ordering(362) 00:15:02.574 fused_ordering(363) 00:15:02.574 fused_ordering(364) 00:15:02.574 fused_ordering(365) 00:15:02.574 fused_ordering(366) 00:15:02.574 fused_ordering(367) 00:15:02.574 fused_ordering(368) 00:15:02.574 fused_ordering(369) 00:15:02.574 fused_ordering(370) 00:15:02.574 fused_ordering(371) 00:15:02.574 fused_ordering(372) 00:15:02.574 fused_ordering(373) 00:15:02.574 fused_ordering(374) 00:15:02.574 fused_ordering(375) 00:15:02.574 fused_ordering(376) 00:15:02.574 fused_ordering(377) 00:15:02.574 fused_ordering(378) 00:15:02.574 fused_ordering(379) 00:15:02.574 fused_ordering(380) 00:15:02.574 fused_ordering(381) 00:15:02.574 fused_ordering(382) 00:15:02.574 fused_ordering(383) 00:15:02.574 fused_ordering(384) 00:15:02.574 fused_ordering(385) 00:15:02.574 fused_ordering(386) 00:15:02.574 fused_ordering(387) 00:15:02.574 fused_ordering(388) 00:15:02.574 fused_ordering(389) 00:15:02.574 fused_ordering(390) 00:15:02.574 fused_ordering(391) 00:15:02.574 fused_ordering(392) 00:15:02.574 fused_ordering(393) 00:15:02.574 fused_ordering(394) 00:15:02.574 fused_ordering(395) 00:15:02.574 fused_ordering(396) 00:15:02.574 fused_ordering(397) 00:15:02.574 fused_ordering(398) 00:15:02.574 fused_ordering(399) 00:15:02.574 fused_ordering(400) 00:15:02.574 fused_ordering(401) 00:15:02.574 fused_ordering(402) 00:15:02.574 fused_ordering(403) 00:15:02.574 fused_ordering(404) 00:15:02.574 fused_ordering(405) 00:15:02.574 fused_ordering(406) 00:15:02.574 fused_ordering(407) 00:15:02.574 fused_ordering(408) 00:15:02.574 fused_ordering(409) 00:15:02.574 fused_ordering(410) 00:15:02.833 fused_ordering(411) 00:15:02.833 fused_ordering(412) 00:15:02.833 fused_ordering(413) 00:15:02.833 fused_ordering(414) 00:15:02.833 fused_ordering(415) 00:15:02.833 fused_ordering(416) 00:15:02.833 fused_ordering(417) 00:15:02.833 fused_ordering(418) 00:15:02.833 fused_ordering(419) 00:15:02.833 fused_ordering(420) 00:15:02.833 fused_ordering(421) 00:15:02.833 fused_ordering(422) 00:15:02.833 fused_ordering(423) 00:15:02.833 fused_ordering(424) 00:15:02.833 fused_ordering(425) 00:15:02.833 fused_ordering(426) 00:15:02.833 fused_ordering(427) 00:15:02.833 fused_ordering(428) 00:15:02.833 fused_ordering(429) 00:15:02.833 fused_ordering(430) 00:15:02.833 fused_ordering(431) 00:15:02.833 fused_ordering(432) 00:15:02.833 fused_ordering(433) 00:15:02.833 fused_ordering(434) 00:15:02.833 fused_ordering(435) 00:15:02.833 fused_ordering(436) 00:15:02.833 fused_ordering(437) 00:15:02.833 fused_ordering(438) 00:15:02.833 fused_ordering(439) 00:15:02.833 fused_ordering(440) 00:15:02.833 fused_ordering(441) 00:15:02.833 fused_ordering(442) 00:15:02.833 fused_ordering(443) 00:15:02.833 fused_ordering(444) 00:15:02.833 fused_ordering(445) 00:15:02.833 fused_ordering(446) 00:15:02.833 fused_ordering(447) 00:15:02.833 fused_ordering(448) 00:15:02.833 fused_ordering(449) 00:15:02.833 fused_ordering(450) 00:15:02.833 fused_ordering(451) 00:15:02.833 fused_ordering(452) 00:15:02.833 fused_ordering(453) 00:15:02.833 fused_ordering(454) 00:15:02.833 fused_ordering(455) 00:15:02.833 fused_ordering(456) 00:15:02.833 fused_ordering(457) 00:15:02.833 fused_ordering(458) 00:15:02.833 fused_ordering(459) 00:15:02.833 fused_ordering(460) 00:15:02.833 fused_ordering(461) 00:15:02.833 fused_ordering(462) 00:15:02.833 fused_ordering(463) 00:15:02.833 fused_ordering(464) 00:15:02.833 fused_ordering(465) 00:15:02.833 fused_ordering(466) 00:15:02.833 fused_ordering(467) 00:15:02.833 fused_ordering(468) 00:15:02.833 fused_ordering(469) 00:15:02.833 fused_ordering(470) 00:15:02.833 fused_ordering(471) 00:15:02.833 fused_ordering(472) 00:15:02.833 fused_ordering(473) 00:15:02.833 fused_ordering(474) 00:15:02.833 fused_ordering(475) 00:15:02.833 fused_ordering(476) 00:15:02.833 fused_ordering(477) 00:15:02.833 fused_ordering(478) 00:15:02.833 fused_ordering(479) 00:15:02.833 fused_ordering(480) 00:15:02.833 fused_ordering(481) 00:15:02.833 fused_ordering(482) 00:15:02.833 fused_ordering(483) 00:15:02.833 fused_ordering(484) 00:15:02.833 fused_ordering(485) 00:15:02.833 fused_ordering(486) 00:15:02.833 fused_ordering(487) 00:15:02.833 fused_ordering(488) 00:15:02.833 fused_ordering(489) 00:15:02.833 fused_ordering(490) 00:15:02.833 fused_ordering(491) 00:15:02.833 fused_ordering(492) 00:15:02.833 fused_ordering(493) 00:15:02.833 fused_ordering(494) 00:15:02.833 fused_ordering(495) 00:15:02.833 fused_ordering(496) 00:15:02.833 fused_ordering(497) 00:15:02.833 fused_ordering(498) 00:15:02.833 fused_ordering(499) 00:15:02.833 fused_ordering(500) 00:15:02.833 fused_ordering(501) 00:15:02.833 fused_ordering(502) 00:15:02.833 fused_ordering(503) 00:15:02.833 fused_ordering(504) 00:15:02.833 fused_ordering(505) 00:15:02.833 fused_ordering(506) 00:15:02.833 fused_ordering(507) 00:15:02.833 fused_ordering(508) 00:15:02.833 fused_ordering(509) 00:15:02.833 fused_ordering(510) 00:15:02.833 fused_ordering(511) 00:15:02.833 fused_ordering(512) 00:15:02.833 fused_ordering(513) 00:15:02.833 fused_ordering(514) 00:15:02.833 fused_ordering(515) 00:15:02.833 fused_ordering(516) 00:15:02.833 fused_ordering(517) 00:15:02.833 fused_ordering(518) 00:15:02.833 fused_ordering(519) 00:15:02.833 fused_ordering(520) 00:15:02.833 fused_ordering(521) 00:15:02.833 fused_ordering(522) 00:15:02.833 fused_ordering(523) 00:15:02.833 fused_ordering(524) 00:15:02.833 fused_ordering(525) 00:15:02.833 fused_ordering(526) 00:15:02.833 fused_ordering(527) 00:15:02.833 fused_ordering(528) 00:15:02.833 fused_ordering(529) 00:15:02.833 fused_ordering(530) 00:15:02.833 fused_ordering(531) 00:15:02.833 fused_ordering(532) 00:15:02.833 fused_ordering(533) 00:15:02.833 fused_ordering(534) 00:15:02.833 fused_ordering(535) 00:15:02.833 fused_ordering(536) 00:15:02.833 fused_ordering(537) 00:15:02.833 fused_ordering(538) 00:15:02.833 fused_ordering(539) 00:15:02.833 fused_ordering(540) 00:15:02.833 fused_ordering(541) 00:15:02.833 fused_ordering(542) 00:15:02.833 fused_ordering(543) 00:15:02.833 fused_ordering(544) 00:15:02.833 fused_ordering(545) 00:15:02.833 fused_ordering(546) 00:15:02.833 fused_ordering(547) 00:15:02.833 fused_ordering(548) 00:15:02.833 fused_ordering(549) 00:15:02.833 fused_ordering(550) 00:15:02.833 fused_ordering(551) 00:15:02.833 fused_ordering(552) 00:15:02.833 fused_ordering(553) 00:15:02.833 fused_ordering(554) 00:15:02.833 fused_ordering(555) 00:15:02.833 fused_ordering(556) 00:15:02.833 fused_ordering(557) 00:15:02.833 fused_ordering(558) 00:15:02.833 fused_ordering(559) 00:15:02.833 fused_ordering(560) 00:15:02.833 fused_ordering(561) 00:15:02.833 fused_ordering(562) 00:15:02.833 fused_ordering(563) 00:15:02.833 fused_ordering(564) 00:15:02.833 fused_ordering(565) 00:15:02.833 fused_ordering(566) 00:15:02.833 fused_ordering(567) 00:15:02.833 fused_ordering(568) 00:15:02.833 fused_ordering(569) 00:15:02.833 fused_ordering(570) 00:15:02.833 fused_ordering(571) 00:15:02.833 fused_ordering(572) 00:15:02.833 fused_ordering(573) 00:15:02.833 fused_ordering(574) 00:15:02.833 fused_ordering(575) 00:15:02.833 fused_ordering(576) 00:15:02.833 fused_ordering(577) 00:15:02.833 fused_ordering(578) 00:15:02.833 fused_ordering(579) 00:15:02.833 fused_ordering(580) 00:15:02.833 fused_ordering(581) 00:15:02.833 fused_ordering(582) 00:15:02.833 fused_ordering(583) 00:15:02.833 fused_ordering(584) 00:15:02.833 fused_ordering(585) 00:15:02.833 fused_ordering(586) 00:15:02.833 fused_ordering(587) 00:15:02.833 fused_ordering(588) 00:15:02.833 fused_ordering(589) 00:15:02.833 fused_ordering(590) 00:15:02.833 fused_ordering(591) 00:15:02.833 fused_ordering(592) 00:15:02.833 fused_ordering(593) 00:15:02.833 fused_ordering(594) 00:15:02.833 fused_ordering(595) 00:15:02.833 fused_ordering(596) 00:15:02.833 fused_ordering(597) 00:15:02.833 fused_ordering(598) 00:15:02.833 fused_ordering(599) 00:15:02.833 fused_ordering(600) 00:15:02.833 fused_ordering(601) 00:15:02.833 fused_ordering(602) 00:15:02.833 fused_ordering(603) 00:15:02.833 fused_ordering(604) 00:15:02.833 fused_ordering(605) 00:15:02.833 fused_ordering(606) 00:15:02.833 fused_ordering(607) 00:15:02.833 fused_ordering(608) 00:15:02.833 fused_ordering(609) 00:15:02.833 fused_ordering(610) 00:15:02.833 fused_ordering(611) 00:15:02.833 fused_ordering(612) 00:15:02.833 fused_ordering(613) 00:15:02.833 fused_ordering(614) 00:15:02.833 fused_ordering(615) 00:15:03.400 fused_ordering(616) 00:15:03.400 fused_ordering(617) 00:15:03.400 fused_ordering(618) 00:15:03.400 fused_ordering(619) 00:15:03.400 fused_ordering(620) 00:15:03.401 fused_ordering(621) 00:15:03.401 fused_ordering(622) 00:15:03.401 fused_ordering(623) 00:15:03.401 fused_ordering(624) 00:15:03.401 fused_ordering(625) 00:15:03.401 fused_ordering(626) 00:15:03.401 fused_ordering(627) 00:15:03.401 fused_ordering(628) 00:15:03.401 fused_ordering(629) 00:15:03.401 fused_ordering(630) 00:15:03.401 fused_ordering(631) 00:15:03.401 fused_ordering(632) 00:15:03.401 fused_ordering(633) 00:15:03.401 fused_ordering(634) 00:15:03.401 fused_ordering(635) 00:15:03.401 fused_ordering(636) 00:15:03.401 fused_ordering(637) 00:15:03.401 fused_ordering(638) 00:15:03.401 fused_ordering(639) 00:15:03.401 fused_ordering(640) 00:15:03.401 fused_ordering(641) 00:15:03.401 fused_ordering(642) 00:15:03.401 fused_ordering(643) 00:15:03.401 fused_ordering(644) 00:15:03.401 fused_ordering(645) 00:15:03.401 fused_ordering(646) 00:15:03.401 fused_ordering(647) 00:15:03.401 fused_ordering(648) 00:15:03.401 fused_ordering(649) 00:15:03.401 fused_ordering(650) 00:15:03.401 fused_ordering(651) 00:15:03.401 fused_ordering(652) 00:15:03.401 fused_ordering(653) 00:15:03.401 fused_ordering(654) 00:15:03.401 fused_ordering(655) 00:15:03.401 fused_ordering(656) 00:15:03.401 fused_ordering(657) 00:15:03.401 fused_ordering(658) 00:15:03.401 fused_ordering(659) 00:15:03.401 fused_ordering(660) 00:15:03.401 fused_ordering(661) 00:15:03.401 fused_ordering(662) 00:15:03.401 fused_ordering(663) 00:15:03.401 fused_ordering(664) 00:15:03.401 fused_ordering(665) 00:15:03.401 fused_ordering(666) 00:15:03.401 fused_ordering(667) 00:15:03.401 fused_ordering(668) 00:15:03.401 fused_ordering(669) 00:15:03.401 fused_ordering(670) 00:15:03.401 fused_ordering(671) 00:15:03.401 fused_ordering(672) 00:15:03.401 fused_ordering(673) 00:15:03.401 fused_ordering(674) 00:15:03.401 fused_ordering(675) 00:15:03.401 fused_ordering(676) 00:15:03.401 fused_ordering(677) 00:15:03.401 fused_ordering(678) 00:15:03.401 fused_ordering(679) 00:15:03.401 fused_ordering(680) 00:15:03.401 fused_ordering(681) 00:15:03.401 fused_ordering(682) 00:15:03.401 fused_ordering(683) 00:15:03.401 fused_ordering(684) 00:15:03.401 fused_ordering(685) 00:15:03.401 fused_ordering(686) 00:15:03.401 fused_ordering(687) 00:15:03.401 fused_ordering(688) 00:15:03.401 fused_ordering(689) 00:15:03.401 fused_ordering(690) 00:15:03.401 fused_ordering(691) 00:15:03.401 fused_ordering(692) 00:15:03.401 fused_ordering(693) 00:15:03.401 fused_ordering(694) 00:15:03.401 fused_ordering(695) 00:15:03.401 fused_ordering(696) 00:15:03.401 fused_ordering(697) 00:15:03.401 fused_ordering(698) 00:15:03.401 fused_ordering(699) 00:15:03.401 fused_ordering(700) 00:15:03.401 fused_ordering(701) 00:15:03.401 fused_ordering(702) 00:15:03.401 fused_ordering(703) 00:15:03.401 fused_ordering(704) 00:15:03.401 fused_ordering(705) 00:15:03.401 fused_ordering(706) 00:15:03.401 fused_ordering(707) 00:15:03.401 fused_ordering(708) 00:15:03.401 fused_ordering(709) 00:15:03.401 fused_ordering(710) 00:15:03.401 fused_ordering(711) 00:15:03.401 fused_ordering(712) 00:15:03.401 fused_ordering(713) 00:15:03.401 fused_ordering(714) 00:15:03.401 fused_ordering(715) 00:15:03.401 fused_ordering(716) 00:15:03.401 fused_ordering(717) 00:15:03.401 fused_ordering(718) 00:15:03.401 fused_ordering(719) 00:15:03.401 fused_ordering(720) 00:15:03.401 fused_ordering(721) 00:15:03.401 fused_ordering(722) 00:15:03.401 fused_ordering(723) 00:15:03.401 fused_ordering(724) 00:15:03.401 fused_ordering(725) 00:15:03.401 fused_ordering(726) 00:15:03.401 fused_ordering(727) 00:15:03.401 fused_ordering(728) 00:15:03.401 fused_ordering(729) 00:15:03.401 fused_ordering(730) 00:15:03.401 fused_ordering(731) 00:15:03.401 fused_ordering(732) 00:15:03.401 fused_ordering(733) 00:15:03.401 fused_ordering(734) 00:15:03.401 fused_ordering(735) 00:15:03.401 fused_ordering(736) 00:15:03.401 fused_ordering(737) 00:15:03.401 fused_ordering(738) 00:15:03.401 fused_ordering(739) 00:15:03.401 fused_ordering(740) 00:15:03.401 fused_ordering(741) 00:15:03.401 fused_ordering(742) 00:15:03.401 fused_ordering(743) 00:15:03.401 fused_ordering(744) 00:15:03.401 fused_ordering(745) 00:15:03.401 fused_ordering(746) 00:15:03.401 fused_ordering(747) 00:15:03.401 fused_ordering(748) 00:15:03.401 fused_ordering(749) 00:15:03.401 fused_ordering(750) 00:15:03.401 fused_ordering(751) 00:15:03.401 fused_ordering(752) 00:15:03.401 fused_ordering(753) 00:15:03.401 fused_ordering(754) 00:15:03.401 fused_ordering(755) 00:15:03.401 fused_ordering(756) 00:15:03.401 fused_ordering(757) 00:15:03.401 fused_ordering(758) 00:15:03.401 fused_ordering(759) 00:15:03.401 fused_ordering(760) 00:15:03.401 fused_ordering(761) 00:15:03.401 fused_ordering(762) 00:15:03.401 fused_ordering(763) 00:15:03.401 fused_ordering(764) 00:15:03.401 fused_ordering(765) 00:15:03.401 fused_ordering(766) 00:15:03.401 fused_ordering(767) 00:15:03.401 fused_ordering(768) 00:15:03.401 fused_ordering(769) 00:15:03.401 fused_ordering(770) 00:15:03.401 fused_ordering(771) 00:15:03.401 fused_ordering(772) 00:15:03.401 fused_ordering(773) 00:15:03.401 fused_ordering(774) 00:15:03.401 fused_ordering(775) 00:15:03.401 fused_ordering(776) 00:15:03.401 fused_ordering(777) 00:15:03.401 fused_ordering(778) 00:15:03.401 fused_ordering(779) 00:15:03.401 fused_ordering(780) 00:15:03.401 fused_ordering(781) 00:15:03.401 fused_ordering(782) 00:15:03.401 fused_ordering(783) 00:15:03.401 fused_ordering(784) 00:15:03.401 fused_ordering(785) 00:15:03.401 fused_ordering(786) 00:15:03.401 fused_ordering(787) 00:15:03.401 fused_ordering(788) 00:15:03.401 fused_ordering(789) 00:15:03.401 fused_ordering(790) 00:15:03.401 fused_ordering(791) 00:15:03.401 fused_ordering(792) 00:15:03.401 fused_ordering(793) 00:15:03.401 fused_ordering(794) 00:15:03.401 fused_ordering(795) 00:15:03.401 fused_ordering(796) 00:15:03.401 fused_ordering(797) 00:15:03.401 fused_ordering(798) 00:15:03.401 fused_ordering(799) 00:15:03.401 fused_ordering(800) 00:15:03.401 fused_ordering(801) 00:15:03.401 fused_ordering(802) 00:15:03.401 fused_ordering(803) 00:15:03.401 fused_ordering(804) 00:15:03.401 fused_ordering(805) 00:15:03.401 fused_ordering(806) 00:15:03.401 fused_ordering(807) 00:15:03.401 fused_ordering(808) 00:15:03.401 fused_ordering(809) 00:15:03.401 fused_ordering(810) 00:15:03.401 fused_ordering(811) 00:15:03.401 fused_ordering(812) 00:15:03.401 fused_ordering(813) 00:15:03.401 fused_ordering(814) 00:15:03.401 fused_ordering(815) 00:15:03.401 fused_ordering(816) 00:15:03.401 fused_ordering(817) 00:15:03.401 fused_ordering(818) 00:15:03.401 fused_ordering(819) 00:15:03.401 fused_ordering(820) 00:15:03.968 fused_ordering(821) 00:15:03.968 fused_ordering(822) 00:15:03.968 fused_ordering(823) 00:15:03.968 fused_ordering(824) 00:15:03.968 fused_ordering(825) 00:15:03.968 fused_ordering(826) 00:15:03.968 fused_ordering(827) 00:15:03.968 fused_ordering(828) 00:15:03.968 fused_ordering(829) 00:15:03.968 fused_ordering(830) 00:15:03.968 fused_ordering(831) 00:15:03.968 fused_ordering(832) 00:15:03.968 fused_ordering(833) 00:15:03.968 fused_ordering(834) 00:15:03.968 fused_ordering(835) 00:15:03.968 fused_ordering(836) 00:15:03.968 fused_ordering(837) 00:15:03.968 fused_ordering(838) 00:15:03.968 fused_ordering(839) 00:15:03.968 fused_ordering(840) 00:15:03.968 fused_ordering(841) 00:15:03.968 fused_ordering(842) 00:15:03.968 fused_ordering(843) 00:15:03.968 fused_ordering(844) 00:15:03.968 fused_ordering(845) 00:15:03.968 fused_ordering(846) 00:15:03.968 fused_ordering(847) 00:15:03.968 fused_ordering(848) 00:15:03.968 fused_ordering(849) 00:15:03.968 fused_ordering(850) 00:15:03.968 fused_ordering(851) 00:15:03.968 fused_ordering(852) 00:15:03.968 fused_ordering(853) 00:15:03.968 fused_ordering(854) 00:15:03.968 fused_ordering(855) 00:15:03.968 fused_ordering(856) 00:15:03.968 fused_ordering(857) 00:15:03.968 fused_ordering(858) 00:15:03.968 fused_ordering(859) 00:15:03.968 fused_ordering(860) 00:15:03.968 fused_ordering(861) 00:15:03.968 fused_ordering(862) 00:15:03.968 fused_ordering(863) 00:15:03.968 fused_ordering(864) 00:15:03.968 fused_ordering(865) 00:15:03.968 fused_ordering(866) 00:15:03.968 fused_ordering(867) 00:15:03.968 fused_ordering(868) 00:15:03.968 fused_ordering(869) 00:15:03.968 fused_ordering(870) 00:15:03.968 fused_ordering(871) 00:15:03.968 fused_ordering(872) 00:15:03.968 fused_ordering(873) 00:15:03.968 fused_ordering(874) 00:15:03.968 fused_ordering(875) 00:15:03.968 fused_ordering(876) 00:15:03.968 fused_ordering(877) 00:15:03.968 fused_ordering(878) 00:15:03.968 fused_ordering(879) 00:15:03.968 fused_ordering(880) 00:15:03.968 fused_ordering(881) 00:15:03.968 fused_ordering(882) 00:15:03.968 fused_ordering(883) 00:15:03.968 fused_ordering(884) 00:15:03.968 fused_ordering(885) 00:15:03.968 fused_ordering(886) 00:15:03.968 fused_ordering(887) 00:15:03.968 fused_ordering(888) 00:15:03.968 fused_ordering(889) 00:15:03.968 fused_ordering(890) 00:15:03.968 fused_ordering(891) 00:15:03.968 fused_ordering(892) 00:15:03.968 fused_ordering(893) 00:15:03.968 fused_ordering(894) 00:15:03.968 fused_ordering(895) 00:15:03.968 fused_ordering(896) 00:15:03.968 fused_ordering(897) 00:15:03.968 fused_ordering(898) 00:15:03.968 fused_ordering(899) 00:15:03.968 fused_ordering(900) 00:15:03.968 fused_ordering(901) 00:15:03.968 fused_ordering(902) 00:15:03.968 fused_ordering(903) 00:15:03.968 fused_ordering(904) 00:15:03.968 fused_ordering(905) 00:15:03.968 fused_ordering(906) 00:15:03.968 fused_ordering(907) 00:15:03.968 fused_ordering(908) 00:15:03.968 fused_ordering(909) 00:15:03.968 fused_ordering(910) 00:15:03.968 fused_ordering(911) 00:15:03.968 fused_ordering(912) 00:15:03.968 fused_ordering(913) 00:15:03.968 fused_ordering(914) 00:15:03.968 fused_ordering(915) 00:15:03.968 fused_ordering(916) 00:15:03.968 fused_ordering(917) 00:15:03.968 fused_ordering(918) 00:15:03.968 fused_ordering(919) 00:15:03.968 fused_ordering(920) 00:15:03.968 fused_ordering(921) 00:15:03.968 fused_ordering(922) 00:15:03.968 fused_ordering(923) 00:15:03.968 fused_ordering(924) 00:15:03.968 fused_ordering(925) 00:15:03.968 fused_ordering(926) 00:15:03.968 fused_ordering(927) 00:15:03.968 fused_ordering(928) 00:15:03.968 fused_ordering(929) 00:15:03.968 fused_ordering(930) 00:15:03.968 fused_ordering(931) 00:15:03.968 fused_ordering(932) 00:15:03.968 fused_ordering(933) 00:15:03.968 fused_ordering(934) 00:15:03.968 fused_ordering(935) 00:15:03.968 fused_ordering(936) 00:15:03.968 fused_ordering(937) 00:15:03.968 fused_ordering(938) 00:15:03.968 fused_ordering(939) 00:15:03.968 fused_ordering(940) 00:15:03.968 fused_ordering(941) 00:15:03.968 fused_ordering(942) 00:15:03.968 fused_ordering(943) 00:15:03.968 fused_ordering(944) 00:15:03.968 fused_ordering(945) 00:15:03.968 fused_ordering(946) 00:15:03.968 fused_ordering(947) 00:15:03.968 fused_ordering(948) 00:15:03.968 fused_ordering(949) 00:15:03.968 fused_ordering(950) 00:15:03.968 fused_ordering(951) 00:15:03.968 fused_ordering(952) 00:15:03.968 fused_ordering(953) 00:15:03.968 fused_ordering(954) 00:15:03.968 fused_ordering(955) 00:15:03.968 fused_ordering(956) 00:15:03.968 fused_ordering(957) 00:15:03.968 fused_ordering(958) 00:15:03.968 fused_ordering(959) 00:15:03.968 fused_ordering(960) 00:15:03.968 fused_ordering(961) 00:15:03.968 fused_ordering(962) 00:15:03.968 fused_ordering(963) 00:15:03.968 fused_ordering(964) 00:15:03.968 fused_ordering(965) 00:15:03.968 fused_ordering(966) 00:15:03.968 fused_ordering(967) 00:15:03.968 fused_ordering(968) 00:15:03.968 fused_ordering(969) 00:15:03.968 fused_ordering(970) 00:15:03.968 fused_ordering(971) 00:15:03.968 fused_ordering(972) 00:15:03.968 fused_ordering(973) 00:15:03.968 fused_ordering(974) 00:15:03.968 fused_ordering(975) 00:15:03.968 fused_ordering(976) 00:15:03.968 fused_ordering(977) 00:15:03.968 fused_ordering(978) 00:15:03.968 fused_ordering(979) 00:15:03.968 fused_ordering(980) 00:15:03.968 fused_ordering(981) 00:15:03.968 fused_ordering(982) 00:15:03.968 fused_ordering(983) 00:15:03.968 fused_ordering(984) 00:15:03.968 fused_ordering(985) 00:15:03.968 fused_ordering(986) 00:15:03.968 fused_ordering(987) 00:15:03.969 fused_ordering(988) 00:15:03.969 fused_ordering(989) 00:15:03.969 fused_ordering(990) 00:15:03.969 fused_ordering(991) 00:15:03.969 fused_ordering(992) 00:15:03.969 fused_ordering(993) 00:15:03.969 fused_ordering(994) 00:15:03.969 fused_ordering(995) 00:15:03.969 fused_ordering(996) 00:15:03.969 fused_ordering(997) 00:15:03.969 fused_ordering(998) 00:15:03.969 fused_ordering(999) 00:15:03.969 fused_ordering(1000) 00:15:03.969 fused_ordering(1001) 00:15:03.969 fused_ordering(1002) 00:15:03.969 fused_ordering(1003) 00:15:03.969 fused_ordering(1004) 00:15:03.969 fused_ordering(1005) 00:15:03.969 fused_ordering(1006) 00:15:03.969 fused_ordering(1007) 00:15:03.969 fused_ordering(1008) 00:15:03.969 fused_ordering(1009) 00:15:03.969 fused_ordering(1010) 00:15:03.969 fused_ordering(1011) 00:15:03.969 fused_ordering(1012) 00:15:03.969 fused_ordering(1013) 00:15:03.969 fused_ordering(1014) 00:15:03.969 fused_ordering(1015) 00:15:03.969 fused_ordering(1016) 00:15:03.969 fused_ordering(1017) 00:15:03.969 fused_ordering(1018) 00:15:03.969 fused_ordering(1019) 00:15:03.969 fused_ordering(1020) 00:15:03.969 fused_ordering(1021) 00:15:03.969 fused_ordering(1022) 00:15:03.969 fused_ordering(1023) 00:15:03.969 15:10:04 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:03.969 15:10:04 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:03.969 15:10:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:03.969 15:10:04 -- nvmf/common.sh@116 -- # sync 00:15:03.969 15:10:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:03.969 15:10:04 -- nvmf/common.sh@119 -- # set +e 00:15:03.969 15:10:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:03.969 15:10:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:03.969 rmmod nvme_tcp 00:15:04.226 rmmod nvme_fabrics 00:15:04.226 rmmod nvme_keyring 00:15:04.226 15:10:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:04.226 15:10:04 -- nvmf/common.sh@123 -- # set -e 00:15:04.226 15:10:04 -- nvmf/common.sh@124 -- # return 0 00:15:04.227 15:10:04 -- nvmf/common.sh@477 -- # '[' -n 675926 ']' 00:15:04.227 15:10:04 -- nvmf/common.sh@478 -- # killprocess 675926 00:15:04.227 15:10:04 -- common/autotest_common.sh@936 -- # '[' -z 675926 ']' 00:15:04.227 15:10:04 -- common/autotest_common.sh@940 -- # kill -0 675926 00:15:04.227 15:10:04 -- common/autotest_common.sh@941 -- # uname 00:15:04.227 15:10:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:04.227 15:10:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 675926 00:15:04.227 15:10:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:04.227 15:10:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:04.227 15:10:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 675926' 00:15:04.227 killing process with pid 675926 00:15:04.227 15:10:04 -- common/autotest_common.sh@955 -- # kill 675926 00:15:04.227 15:10:04 -- common/autotest_common.sh@960 -- # wait 675926 00:15:04.485 15:10:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:04.485 15:10:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:04.485 15:10:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:04.485 15:10:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:04.485 15:10:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:04.485 15:10:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.485 15:10:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.485 15:10:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.413 15:10:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:06.413 00:15:06.413 real 0m8.213s 00:15:06.413 user 0m6.096s 00:15:06.413 sys 0m3.104s 00:15:06.413 15:10:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:06.413 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:15:06.413 ************************************ 00:15:06.413 END TEST nvmf_fused_ordering 00:15:06.413 ************************************ 00:15:06.413 15:10:06 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:06.413 15:10:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:06.413 15:10:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:06.413 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:15:06.413 ************************************ 00:15:06.413 START TEST nvmf_delete_subsystem 00:15:06.413 ************************************ 00:15:06.413 15:10:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:06.413 * Looking for test storage... 00:15:06.413 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:06.413 15:10:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:06.413 15:10:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:06.413 15:10:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:06.672 15:10:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:06.672 15:10:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:06.672 15:10:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:06.672 15:10:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:06.672 15:10:06 -- scripts/common.sh@335 -- # IFS=.-: 00:15:06.672 15:10:06 -- scripts/common.sh@335 -- # read -ra ver1 00:15:06.672 15:10:06 -- scripts/common.sh@336 -- # IFS=.-: 00:15:06.672 15:10:06 -- scripts/common.sh@336 -- # read -ra ver2 00:15:06.672 15:10:06 -- scripts/common.sh@337 -- # local 'op=<' 00:15:06.672 15:10:06 -- scripts/common.sh@339 -- # ver1_l=2 00:15:06.672 15:10:06 -- scripts/common.sh@340 -- # ver2_l=1 00:15:06.672 15:10:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:06.672 15:10:06 -- scripts/common.sh@343 -- # case "$op" in 00:15:06.672 15:10:06 -- scripts/common.sh@344 -- # : 1 00:15:06.672 15:10:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:06.672 15:10:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:06.672 15:10:06 -- scripts/common.sh@364 -- # decimal 1 00:15:06.672 15:10:06 -- scripts/common.sh@352 -- # local d=1 00:15:06.672 15:10:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:06.672 15:10:06 -- scripts/common.sh@354 -- # echo 1 00:15:06.672 15:10:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:06.672 15:10:06 -- scripts/common.sh@365 -- # decimal 2 00:15:06.672 15:10:06 -- scripts/common.sh@352 -- # local d=2 00:15:06.672 15:10:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:06.672 15:10:06 -- scripts/common.sh@354 -- # echo 2 00:15:06.672 15:10:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:06.672 15:10:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:06.672 15:10:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:06.672 15:10:06 -- scripts/common.sh@367 -- # return 0 00:15:06.672 15:10:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:06.672 15:10:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:06.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.672 --rc genhtml_branch_coverage=1 00:15:06.672 --rc genhtml_function_coverage=1 00:15:06.672 --rc genhtml_legend=1 00:15:06.672 --rc geninfo_all_blocks=1 00:15:06.672 --rc geninfo_unexecuted_blocks=1 00:15:06.672 00:15:06.672 ' 00:15:06.672 15:10:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:06.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.672 --rc genhtml_branch_coverage=1 00:15:06.672 --rc genhtml_function_coverage=1 00:15:06.672 --rc genhtml_legend=1 00:15:06.672 --rc geninfo_all_blocks=1 00:15:06.672 --rc geninfo_unexecuted_blocks=1 00:15:06.672 00:15:06.672 ' 00:15:06.672 15:10:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:06.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.672 --rc genhtml_branch_coverage=1 00:15:06.672 --rc genhtml_function_coverage=1 00:15:06.672 --rc genhtml_legend=1 00:15:06.672 --rc geninfo_all_blocks=1 00:15:06.672 --rc geninfo_unexecuted_blocks=1 00:15:06.672 00:15:06.672 ' 00:15:06.672 15:10:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:06.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.672 --rc genhtml_branch_coverage=1 00:15:06.672 --rc genhtml_function_coverage=1 00:15:06.672 --rc genhtml_legend=1 00:15:06.672 --rc geninfo_all_blocks=1 00:15:06.672 --rc geninfo_unexecuted_blocks=1 00:15:06.672 00:15:06.672 ' 00:15:06.672 15:10:06 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:06.672 15:10:06 -- nvmf/common.sh@7 -- # uname -s 00:15:06.672 15:10:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:06.672 15:10:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:06.672 15:10:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:06.672 15:10:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:06.672 15:10:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:06.672 15:10:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:06.672 15:10:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:06.672 15:10:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:06.672 15:10:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:06.672 15:10:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:06.672 15:10:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:06.672 15:10:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:06.672 15:10:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:06.672 15:10:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:06.673 15:10:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:06.673 15:10:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:06.673 15:10:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:06.673 15:10:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:06.673 15:10:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:06.673 15:10:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.673 15:10:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.673 15:10:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.673 15:10:06 -- paths/export.sh@5 -- # export PATH 00:15:06.673 15:10:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.673 15:10:06 -- nvmf/common.sh@46 -- # : 0 00:15:06.673 15:10:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:06.673 15:10:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:06.673 15:10:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:06.673 15:10:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:06.673 15:10:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:06.673 15:10:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:06.673 15:10:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:06.673 15:10:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:06.673 15:10:06 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:06.673 15:10:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:06.673 15:10:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:06.673 15:10:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:06.673 15:10:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:06.673 15:10:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:06.673 15:10:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.673 15:10:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.673 15:10:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.673 15:10:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:06.673 15:10:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:06.673 15:10:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:06.673 15:10:06 -- common/autotest_common.sh@10 -- # set +x 00:15:08.575 15:10:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:08.575 15:10:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:08.575 15:10:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:08.575 15:10:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:08.575 15:10:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:08.575 15:10:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:08.575 15:10:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:08.575 15:10:08 -- nvmf/common.sh@294 -- # net_devs=() 00:15:08.575 15:10:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:08.575 15:10:08 -- nvmf/common.sh@295 -- # e810=() 00:15:08.575 15:10:08 -- nvmf/common.sh@295 -- # local -ga e810 00:15:08.575 15:10:08 -- nvmf/common.sh@296 -- # x722=() 00:15:08.575 15:10:08 -- nvmf/common.sh@296 -- # local -ga x722 00:15:08.575 15:10:08 -- nvmf/common.sh@297 -- # mlx=() 00:15:08.575 15:10:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:08.575 15:10:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:08.575 15:10:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:08.575 15:10:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:08.575 15:10:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:08.575 15:10:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:08.575 15:10:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:08.575 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:08.575 15:10:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:08.575 15:10:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:08.575 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:08.575 15:10:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:08.575 15:10:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:08.575 15:10:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:08.575 15:10:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:08.575 15:10:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:08.575 15:10:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:08.575 15:10:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:08.575 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:08.575 15:10:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:08.575 15:10:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:08.576 15:10:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:08.576 15:10:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:08.576 15:10:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:08.576 15:10:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:08.576 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:08.576 15:10:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:08.576 15:10:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:08.576 15:10:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:08.576 15:10:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:08.576 15:10:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:08.576 15:10:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:08.576 15:10:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:08.576 15:10:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:08.576 15:10:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:08.576 15:10:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:08.576 15:10:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:08.576 15:10:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:08.576 15:10:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:08.576 15:10:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:08.576 15:10:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:08.576 15:10:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:08.576 15:10:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:08.576 15:10:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:08.576 15:10:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:08.576 15:10:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:08.576 15:10:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:08.576 15:10:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:08.576 15:10:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:08.576 15:10:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:08.576 15:10:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:08.576 15:10:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:08.576 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:08.576 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.275 ms 00:15:08.576 00:15:08.576 --- 10.0.0.2 ping statistics --- 00:15:08.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:08.576 rtt min/avg/max/mdev = 0.275/0.275/0.275/0.000 ms 00:15:08.576 15:10:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:08.576 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:08.576 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.043 ms 00:15:08.576 00:15:08.576 --- 10.0.0.1 ping statistics --- 00:15:08.576 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:08.576 rtt min/avg/max/mdev = 0.043/0.043/0.043/0.000 ms 00:15:08.576 15:10:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:08.576 15:10:08 -- nvmf/common.sh@410 -- # return 0 00:15:08.576 15:10:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:08.576 15:10:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:08.576 15:10:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:08.576 15:10:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:08.576 15:10:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:08.576 15:10:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:08.576 15:10:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:08.576 15:10:08 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:08.576 15:10:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:08.576 15:10:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:08.576 15:10:08 -- common/autotest_common.sh@10 -- # set +x 00:15:08.576 15:10:08 -- nvmf/common.sh@469 -- # nvmfpid=678304 00:15:08.576 15:10:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:08.576 15:10:08 -- nvmf/common.sh@470 -- # waitforlisten 678304 00:15:08.576 15:10:08 -- common/autotest_common.sh@829 -- # '[' -z 678304 ']' 00:15:08.576 15:10:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:08.576 15:10:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:08.576 15:10:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:08.576 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:08.576 15:10:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:08.576 15:10:08 -- common/autotest_common.sh@10 -- # set +x 00:15:08.834 [2024-11-28 15:10:08.850642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:08.834 [2024-11-28 15:10:08.850709] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:08.834 EAL: No free 2048 kB hugepages reported on node 1 00:15:08.834 [2024-11-28 15:10:08.919574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:08.834 [2024-11-28 15:10:09.006117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:08.834 [2024-11-28 15:10:09.006285] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:08.834 [2024-11-28 15:10:09.006302] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:08.834 [2024-11-28 15:10:09.006314] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:08.834 [2024-11-28 15:10:09.006383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:08.834 [2024-11-28 15:10:09.006388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:09.768 15:10:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:09.768 15:10:09 -- common/autotest_common.sh@862 -- # return 0 00:15:09.769 15:10:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:09.769 15:10:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 15:10:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:09.769 15:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 [2024-11-28 15:10:09.848545] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:09.769 15:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:09.769 15:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 15:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:09.769 15:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 [2024-11-28 15:10:09.864769] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:09.769 15:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:09.769 15:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 NULL1 00:15:09.769 15:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:09.769 15:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 Delay0 00:15:09.769 15:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:09.769 15:10:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.769 15:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:09.769 15:10:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@28 -- # perf_pid=678461 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:09.769 15:10:09 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:09.769 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.769 [2024-11-28 15:10:09.939461] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:11.668 15:10:11 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:11.668 15:10:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:11.668 15:10:11 -- common/autotest_common.sh@10 -- # set +x 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 starting I/O failed: -6 00:15:12.233 [2024-11-28 15:10:12.191556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e62240 is same with the state(5) to be set 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Write completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.233 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Write completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 Read completed with error (sct=0, sc=8) 00:15:12.234 starting I/O failed: -6 00:15:12.234 starting I/O failed: -6 00:15:12.234 starting I/O failed: -6 00:15:12.234 starting I/O failed: -6 00:15:12.234 starting I/O failed: -6 00:15:13.168 [2024-11-28 15:10:13.160633] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e639c0 is same with the state(5) to be set 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 [2024-11-28 15:10:13.192046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f6dfc00bf20 is same with the state(5) to be set 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Write completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.168 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 [2024-11-28 15:10:13.192305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f6dfc00c600 is same with the state(5) to be set 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 [2024-11-28 15:10:13.193749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e619e0 is same with the state(5) to be set 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Write completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 Read completed with error (sct=0, sc=8) 00:15:13.169 [2024-11-28 15:10:13.194225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e61f90 is same with the state(5) to be set 00:15:13.169 [2024-11-28 15:10:13.194611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e639c0 (9): Bad file descriptor 00:15:13.169 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:13.169 15:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.169 15:10:13 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:13.169 15:10:13 -- target/delete_subsystem.sh@35 -- # kill -0 678461 00:15:13.169 15:10:13 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:13.169 Initializing NVMe Controllers 00:15:13.169 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:13.169 Controller IO queue size 128, less than required. 00:15:13.169 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:13.169 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:13.169 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:13.169 Initialization complete. Launching workers. 00:15:13.169 ======================================================== 00:15:13.169 Latency(us) 00:15:13.169 Device Information : IOPS MiB/s Average min max 00:15:13.169 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 172.71 0.08 890526.06 662.45 1012207.71 00:15:13.169 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 182.14 0.09 912264.13 611.85 1013290.63 00:15:13.169 ======================================================== 00:15:13.169 Total : 354.86 0.17 901683.92 611.85 1013290.63 00:15:13.169 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@35 -- # kill -0 678461 00:15:13.735 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (678461) - No such process 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@45 -- # NOT wait 678461 00:15:13.735 15:10:13 -- common/autotest_common.sh@650 -- # local es=0 00:15:13.735 15:10:13 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 678461 00:15:13.735 15:10:13 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:13.735 15:10:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:13.735 15:10:13 -- common/autotest_common.sh@642 -- # type -t wait 00:15:13.735 15:10:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:13.735 15:10:13 -- common/autotest_common.sh@653 -- # wait 678461 00:15:13.735 15:10:13 -- common/autotest_common.sh@653 -- # es=1 00:15:13.735 15:10:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:13.735 15:10:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:13.735 15:10:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:13.735 15:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.735 15:10:13 -- common/autotest_common.sh@10 -- # set +x 00:15:13.735 15:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:13.735 15:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.735 15:10:13 -- common/autotest_common.sh@10 -- # set +x 00:15:13.735 [2024-11-28 15:10:13.718440] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:13.735 15:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:13.735 15:10:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:13.735 15:10:13 -- common/autotest_common.sh@10 -- # set +x 00:15:13.735 15:10:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@54 -- # perf_pid=679002 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:13.735 15:10:13 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:13.735 EAL: No free 2048 kB hugepages reported on node 1 00:15:13.735 [2024-11-28 15:10:13.781852] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:14.300 15:10:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.300 15:10:14 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:14.300 15:10:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:14.559 15:10:14 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:14.559 15:10:14 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:14.559 15:10:14 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.126 15:10:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.126 15:10:15 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:15.126 15:10:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:15.690 15:10:15 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:15.690 15:10:15 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:15.690 15:10:15 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:16.255 15:10:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:16.255 15:10:16 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:16.255 15:10:16 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:16.819 15:10:16 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:16.819 15:10:16 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:16.819 15:10:16 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:16.820 Initializing NVMe Controllers 00:15:16.820 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:16.820 Controller IO queue size 128, less than required. 00:15:16.820 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:16.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:16.820 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:16.820 Initialization complete. Launching workers. 00:15:16.820 ======================================================== 00:15:16.820 Latency(us) 00:15:16.820 Device Information : IOPS MiB/s Average min max 00:15:16.820 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003289.98 1000175.93 1041351.18 00:15:16.820 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004846.68 1000213.62 1042391.93 00:15:16.820 ======================================================== 00:15:16.820 Total : 256.00 0.12 1004068.33 1000175.93 1042391.93 00:15:16.820 00:15:17.078 15:10:17 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:17.078 15:10:17 -- target/delete_subsystem.sh@57 -- # kill -0 679002 00:15:17.078 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (679002) - No such process 00:15:17.078 15:10:17 -- target/delete_subsystem.sh@67 -- # wait 679002 00:15:17.078 15:10:17 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:17.078 15:10:17 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:17.078 15:10:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:17.078 15:10:17 -- nvmf/common.sh@116 -- # sync 00:15:17.078 15:10:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:17.078 15:10:17 -- nvmf/common.sh@119 -- # set +e 00:15:17.078 15:10:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:17.078 15:10:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:17.078 rmmod nvme_tcp 00:15:17.078 rmmod nvme_fabrics 00:15:17.078 rmmod nvme_keyring 00:15:17.336 15:10:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:17.336 15:10:17 -- nvmf/common.sh@123 -- # set -e 00:15:17.336 15:10:17 -- nvmf/common.sh@124 -- # return 0 00:15:17.336 15:10:17 -- nvmf/common.sh@477 -- # '[' -n 678304 ']' 00:15:17.336 15:10:17 -- nvmf/common.sh@478 -- # killprocess 678304 00:15:17.336 15:10:17 -- common/autotest_common.sh@936 -- # '[' -z 678304 ']' 00:15:17.336 15:10:17 -- common/autotest_common.sh@940 -- # kill -0 678304 00:15:17.336 15:10:17 -- common/autotest_common.sh@941 -- # uname 00:15:17.336 15:10:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:17.336 15:10:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 678304 00:15:17.336 15:10:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:17.336 15:10:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:17.336 15:10:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 678304' 00:15:17.336 killing process with pid 678304 00:15:17.336 15:10:17 -- common/autotest_common.sh@955 -- # kill 678304 00:15:17.336 15:10:17 -- common/autotest_common.sh@960 -- # wait 678304 00:15:17.596 15:10:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:17.596 15:10:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:17.596 15:10:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:17.596 15:10:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:17.596 15:10:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:17.596 15:10:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:17.596 15:10:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:17.596 15:10:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.499 15:10:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:19.499 00:15:19.499 real 0m13.055s 00:15:19.499 user 0m29.813s 00:15:19.499 sys 0m2.864s 00:15:19.499 15:10:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:19.499 15:10:19 -- common/autotest_common.sh@10 -- # set +x 00:15:19.499 ************************************ 00:15:19.499 END TEST nvmf_delete_subsystem 00:15:19.499 ************************************ 00:15:19.499 15:10:19 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:19.499 15:10:19 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:19.499 15:10:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:19.499 15:10:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:19.499 15:10:19 -- common/autotest_common.sh@10 -- # set +x 00:15:19.499 ************************************ 00:15:19.499 START TEST nvmf_nvme_cli 00:15:19.499 ************************************ 00:15:19.499 15:10:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:19.499 * Looking for test storage... 00:15:19.499 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:19.499 15:10:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:19.499 15:10:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:19.499 15:10:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:19.758 15:10:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:19.758 15:10:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:19.758 15:10:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:19.758 15:10:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:19.758 15:10:19 -- scripts/common.sh@335 -- # IFS=.-: 00:15:19.758 15:10:19 -- scripts/common.sh@335 -- # read -ra ver1 00:15:19.758 15:10:19 -- scripts/common.sh@336 -- # IFS=.-: 00:15:19.758 15:10:19 -- scripts/common.sh@336 -- # read -ra ver2 00:15:19.758 15:10:19 -- scripts/common.sh@337 -- # local 'op=<' 00:15:19.758 15:10:19 -- scripts/common.sh@339 -- # ver1_l=2 00:15:19.758 15:10:19 -- scripts/common.sh@340 -- # ver2_l=1 00:15:19.758 15:10:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:19.758 15:10:19 -- scripts/common.sh@343 -- # case "$op" in 00:15:19.758 15:10:19 -- scripts/common.sh@344 -- # : 1 00:15:19.758 15:10:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:19.758 15:10:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:19.758 15:10:19 -- scripts/common.sh@364 -- # decimal 1 00:15:19.758 15:10:19 -- scripts/common.sh@352 -- # local d=1 00:15:19.758 15:10:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:19.758 15:10:19 -- scripts/common.sh@354 -- # echo 1 00:15:19.758 15:10:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:19.758 15:10:19 -- scripts/common.sh@365 -- # decimal 2 00:15:19.758 15:10:19 -- scripts/common.sh@352 -- # local d=2 00:15:19.758 15:10:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:19.758 15:10:19 -- scripts/common.sh@354 -- # echo 2 00:15:19.758 15:10:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:19.758 15:10:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:19.758 15:10:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:19.758 15:10:19 -- scripts/common.sh@367 -- # return 0 00:15:19.758 15:10:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:19.758 15:10:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:19.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.758 --rc genhtml_branch_coverage=1 00:15:19.758 --rc genhtml_function_coverage=1 00:15:19.758 --rc genhtml_legend=1 00:15:19.758 --rc geninfo_all_blocks=1 00:15:19.758 --rc geninfo_unexecuted_blocks=1 00:15:19.758 00:15:19.758 ' 00:15:19.758 15:10:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:19.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.758 --rc genhtml_branch_coverage=1 00:15:19.758 --rc genhtml_function_coverage=1 00:15:19.758 --rc genhtml_legend=1 00:15:19.758 --rc geninfo_all_blocks=1 00:15:19.758 --rc geninfo_unexecuted_blocks=1 00:15:19.758 00:15:19.758 ' 00:15:19.758 15:10:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:19.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.758 --rc genhtml_branch_coverage=1 00:15:19.758 --rc genhtml_function_coverage=1 00:15:19.758 --rc genhtml_legend=1 00:15:19.758 --rc geninfo_all_blocks=1 00:15:19.758 --rc geninfo_unexecuted_blocks=1 00:15:19.758 00:15:19.758 ' 00:15:19.758 15:10:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:19.758 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:19.758 --rc genhtml_branch_coverage=1 00:15:19.758 --rc genhtml_function_coverage=1 00:15:19.758 --rc genhtml_legend=1 00:15:19.758 --rc geninfo_all_blocks=1 00:15:19.758 --rc geninfo_unexecuted_blocks=1 00:15:19.758 00:15:19.758 ' 00:15:19.758 15:10:19 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:19.758 15:10:19 -- nvmf/common.sh@7 -- # uname -s 00:15:19.758 15:10:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:19.758 15:10:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:19.758 15:10:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:19.758 15:10:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:19.758 15:10:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:19.758 15:10:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:19.758 15:10:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:19.758 15:10:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:19.758 15:10:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:19.758 15:10:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:19.758 15:10:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.758 15:10:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:19.758 15:10:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:19.758 15:10:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:19.758 15:10:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:19.758 15:10:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:19.758 15:10:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:19.758 15:10:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:19.758 15:10:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:19.758 15:10:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.758 15:10:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.758 15:10:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.758 15:10:19 -- paths/export.sh@5 -- # export PATH 00:15:19.758 15:10:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:19.758 15:10:19 -- nvmf/common.sh@46 -- # : 0 00:15:19.758 15:10:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:19.758 15:10:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:19.758 15:10:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:19.758 15:10:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:19.758 15:10:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:19.758 15:10:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:19.758 15:10:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:19.758 15:10:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:19.758 15:10:19 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:19.758 15:10:19 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:19.758 15:10:19 -- target/nvme_cli.sh@14 -- # devs=() 00:15:19.758 15:10:19 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:19.758 15:10:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:19.758 15:10:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:19.758 15:10:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:19.758 15:10:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:19.758 15:10:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:19.758 15:10:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:19.758 15:10:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:19.758 15:10:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:19.758 15:10:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:19.758 15:10:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:19.758 15:10:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:19.758 15:10:19 -- common/autotest_common.sh@10 -- # set +x 00:15:21.659 15:10:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:21.659 15:10:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:21.659 15:10:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:21.659 15:10:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:21.659 15:10:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:21.659 15:10:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:21.659 15:10:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:21.659 15:10:21 -- nvmf/common.sh@294 -- # net_devs=() 00:15:21.659 15:10:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:21.659 15:10:21 -- nvmf/common.sh@295 -- # e810=() 00:15:21.659 15:10:21 -- nvmf/common.sh@295 -- # local -ga e810 00:15:21.659 15:10:21 -- nvmf/common.sh@296 -- # x722=() 00:15:21.659 15:10:21 -- nvmf/common.sh@296 -- # local -ga x722 00:15:21.659 15:10:21 -- nvmf/common.sh@297 -- # mlx=() 00:15:21.659 15:10:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:21.659 15:10:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:21.659 15:10:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:21.659 15:10:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:21.659 15:10:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:21.659 15:10:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.659 15:10:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:21.659 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:21.659 15:10:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:21.659 15:10:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:21.659 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:21.659 15:10:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:21.659 15:10:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:21.659 15:10:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.660 15:10:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.660 15:10:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.660 15:10:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.660 15:10:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:21.660 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:21.660 15:10:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.660 15:10:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:21.660 15:10:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:21.660 15:10:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:21.660 15:10:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:21.660 15:10:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:21.660 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:21.660 15:10:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:21.660 15:10:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:21.660 15:10:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:21.660 15:10:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:21.660 15:10:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:21.660 15:10:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:21.660 15:10:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:21.660 15:10:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:21.660 15:10:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:21.660 15:10:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:21.660 15:10:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:21.660 15:10:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:21.660 15:10:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:21.660 15:10:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:21.660 15:10:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:21.660 15:10:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:21.660 15:10:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:21.660 15:10:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:21.660 15:10:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:21.660 15:10:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:21.660 15:10:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:21.660 15:10:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:21.660 15:10:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:21.919 15:10:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:21.919 15:10:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:21.919 15:10:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:21.919 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:21.919 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:15:21.919 00:15:21.919 --- 10.0.0.2 ping statistics --- 00:15:21.919 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:21.919 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:15:21.919 15:10:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:21.919 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:21.919 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:15:21.919 00:15:21.919 --- 10.0.0.1 ping statistics --- 00:15:21.919 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:21.919 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:15:21.919 15:10:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:21.919 15:10:21 -- nvmf/common.sh@410 -- # return 0 00:15:21.919 15:10:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:21.919 15:10:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:21.919 15:10:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:21.919 15:10:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:21.919 15:10:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:21.919 15:10:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:21.919 15:10:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:21.919 15:10:22 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:21.919 15:10:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:21.919 15:10:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:21.919 15:10:22 -- common/autotest_common.sh@10 -- # set +x 00:15:21.919 15:10:22 -- nvmf/common.sh@469 -- # nvmfpid=681368 00:15:21.919 15:10:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:21.919 15:10:22 -- nvmf/common.sh@470 -- # waitforlisten 681368 00:15:21.919 15:10:22 -- common/autotest_common.sh@829 -- # '[' -z 681368 ']' 00:15:21.919 15:10:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:21.919 15:10:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:21.919 15:10:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:21.919 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:21.919 15:10:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:21.919 15:10:22 -- common/autotest_common.sh@10 -- # set +x 00:15:21.919 [2024-11-28 15:10:22.058038] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:21.919 [2024-11-28 15:10:22.058120] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:21.919 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.919 [2024-11-28 15:10:22.127411] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:22.178 [2024-11-28 15:10:22.216815] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:22.178 [2024-11-28 15:10:22.216980] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:22.178 [2024-11-28 15:10:22.216997] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:22.178 [2024-11-28 15:10:22.217009] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:22.178 [2024-11-28 15:10:22.217085] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:22.178 [2024-11-28 15:10:22.217127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:22.178 [2024-11-28 15:10:22.217187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:22.178 [2024-11-28 15:10:22.217190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:23.112 15:10:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:23.112 15:10:23 -- common/autotest_common.sh@862 -- # return 0 00:15:23.112 15:10:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:23.112 15:10:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 15:10:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:23.112 15:10:23 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 [2024-11-28 15:10:23.112883] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 Malloc0 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 Malloc1 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 [2024-11-28 15:10:23.195007] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:23.112 15:10:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:23.112 15:10:23 -- common/autotest_common.sh@10 -- # set +x 00:15:23.112 15:10:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:23.112 15:10:23 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:23.370 00:15:23.370 Discovery Log Number of Records 2, Generation counter 2 00:15:23.370 =====Discovery Log Entry 0====== 00:15:23.370 trtype: tcp 00:15:23.370 adrfam: ipv4 00:15:23.370 subtype: current discovery subsystem 00:15:23.370 treq: not required 00:15:23.370 portid: 0 00:15:23.370 trsvcid: 4420 00:15:23.370 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:23.370 traddr: 10.0.0.2 00:15:23.370 eflags: explicit discovery connections, duplicate discovery information 00:15:23.370 sectype: none 00:15:23.370 =====Discovery Log Entry 1====== 00:15:23.370 trtype: tcp 00:15:23.370 adrfam: ipv4 00:15:23.370 subtype: nvme subsystem 00:15:23.370 treq: not required 00:15:23.370 portid: 0 00:15:23.370 trsvcid: 4420 00:15:23.370 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:23.370 traddr: 10.0.0.2 00:15:23.370 eflags: none 00:15:23.370 sectype: none 00:15:23.370 15:10:23 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:23.370 15:10:23 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:23.370 15:10:23 -- nvmf/common.sh@510 -- # local dev _ 00:15:23.370 15:10:23 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:23.370 15:10:23 -- nvmf/common.sh@509 -- # nvme list 00:15:23.370 15:10:23 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:23.370 15:10:23 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:23.370 15:10:23 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:23.370 15:10:23 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:23.370 15:10:23 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:23.370 15:10:23 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:23.936 15:10:24 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:23.936 15:10:24 -- common/autotest_common.sh@1187 -- # local i=0 00:15:23.936 15:10:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:23.936 15:10:24 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:23.936 15:10:24 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:23.936 15:10:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:25.834 15:10:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:25.834 15:10:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:25.834 15:10:26 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:26.092 15:10:26 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:26.092 15:10:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:26.092 15:10:26 -- common/autotest_common.sh@1197 -- # return 0 00:15:26.092 15:10:26 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:26.092 15:10:26 -- nvmf/common.sh@510 -- # local dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@509 -- # nvme list 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:26.092 /dev/nvme0n2 ]] 00:15:26.092 15:10:26 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:26.092 15:10:26 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:26.092 15:10:26 -- nvmf/common.sh@510 -- # local dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@509 -- # nvme list 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:26.092 15:10:26 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:26.092 15:10:26 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:26.092 15:10:26 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:26.092 15:10:26 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:26.092 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:26.092 15:10:26 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:26.092 15:10:26 -- common/autotest_common.sh@1208 -- # local i=0 00:15:26.092 15:10:26 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:26.092 15:10:26 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:26.092 15:10:26 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:26.092 15:10:26 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:26.092 15:10:26 -- common/autotest_common.sh@1220 -- # return 0 00:15:26.092 15:10:26 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:26.092 15:10:26 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:26.092 15:10:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:26.092 15:10:26 -- common/autotest_common.sh@10 -- # set +x 00:15:26.092 15:10:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:26.092 15:10:26 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:26.092 15:10:26 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:26.092 15:10:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:26.092 15:10:26 -- nvmf/common.sh@116 -- # sync 00:15:26.092 15:10:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:26.092 15:10:26 -- nvmf/common.sh@119 -- # set +e 00:15:26.092 15:10:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:26.092 15:10:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:26.092 rmmod nvme_tcp 00:15:26.092 rmmod nvme_fabrics 00:15:26.092 rmmod nvme_keyring 00:15:26.092 15:10:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:26.092 15:10:26 -- nvmf/common.sh@123 -- # set -e 00:15:26.092 15:10:26 -- nvmf/common.sh@124 -- # return 0 00:15:26.092 15:10:26 -- nvmf/common.sh@477 -- # '[' -n 681368 ']' 00:15:26.092 15:10:26 -- nvmf/common.sh@478 -- # killprocess 681368 00:15:26.092 15:10:26 -- common/autotest_common.sh@936 -- # '[' -z 681368 ']' 00:15:26.092 15:10:26 -- common/autotest_common.sh@940 -- # kill -0 681368 00:15:26.092 15:10:26 -- common/autotest_common.sh@941 -- # uname 00:15:26.092 15:10:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:26.092 15:10:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 681368 00:15:26.092 15:10:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:26.092 15:10:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:26.092 15:10:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 681368' 00:15:26.092 killing process with pid 681368 00:15:26.092 15:10:26 -- common/autotest_common.sh@955 -- # kill 681368 00:15:26.092 15:10:26 -- common/autotest_common.sh@960 -- # wait 681368 00:15:26.659 15:10:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:26.659 15:10:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:26.660 15:10:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:26.660 15:10:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:26.660 15:10:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:26.660 15:10:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:26.660 15:10:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:26.660 15:10:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:28.561 15:10:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:28.561 00:15:28.561 real 0m8.980s 00:15:28.561 user 0m18.170s 00:15:28.561 sys 0m2.234s 00:15:28.561 15:10:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:28.561 15:10:28 -- common/autotest_common.sh@10 -- # set +x 00:15:28.561 ************************************ 00:15:28.561 END TEST nvmf_nvme_cli 00:15:28.562 ************************************ 00:15:28.562 15:10:28 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:28.562 15:10:28 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:28.562 15:10:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:28.562 15:10:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:28.562 15:10:28 -- common/autotest_common.sh@10 -- # set +x 00:15:28.562 ************************************ 00:15:28.562 START TEST nvmf_vfio_user 00:15:28.562 ************************************ 00:15:28.562 15:10:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:28.562 * Looking for test storage... 00:15:28.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:28.562 15:10:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:28.562 15:10:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:28.562 15:10:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:28.820 15:10:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:28.820 15:10:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:28.820 15:10:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:28.820 15:10:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:28.820 15:10:28 -- scripts/common.sh@335 -- # IFS=.-: 00:15:28.820 15:10:28 -- scripts/common.sh@335 -- # read -ra ver1 00:15:28.820 15:10:28 -- scripts/common.sh@336 -- # IFS=.-: 00:15:28.820 15:10:28 -- scripts/common.sh@336 -- # read -ra ver2 00:15:28.820 15:10:28 -- scripts/common.sh@337 -- # local 'op=<' 00:15:28.820 15:10:28 -- scripts/common.sh@339 -- # ver1_l=2 00:15:28.820 15:10:28 -- scripts/common.sh@340 -- # ver2_l=1 00:15:28.820 15:10:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:28.820 15:10:28 -- scripts/common.sh@343 -- # case "$op" in 00:15:28.820 15:10:28 -- scripts/common.sh@344 -- # : 1 00:15:28.820 15:10:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:28.820 15:10:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:28.820 15:10:28 -- scripts/common.sh@364 -- # decimal 1 00:15:28.820 15:10:28 -- scripts/common.sh@352 -- # local d=1 00:15:28.820 15:10:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:28.820 15:10:28 -- scripts/common.sh@354 -- # echo 1 00:15:28.820 15:10:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:28.820 15:10:28 -- scripts/common.sh@365 -- # decimal 2 00:15:28.820 15:10:28 -- scripts/common.sh@352 -- # local d=2 00:15:28.820 15:10:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:28.820 15:10:28 -- scripts/common.sh@354 -- # echo 2 00:15:28.820 15:10:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:28.820 15:10:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:28.820 15:10:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:28.820 15:10:28 -- scripts/common.sh@367 -- # return 0 00:15:28.820 15:10:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:28.820 15:10:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:28.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.820 --rc genhtml_branch_coverage=1 00:15:28.820 --rc genhtml_function_coverage=1 00:15:28.820 --rc genhtml_legend=1 00:15:28.820 --rc geninfo_all_blocks=1 00:15:28.820 --rc geninfo_unexecuted_blocks=1 00:15:28.820 00:15:28.820 ' 00:15:28.820 15:10:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:28.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.820 --rc genhtml_branch_coverage=1 00:15:28.820 --rc genhtml_function_coverage=1 00:15:28.820 --rc genhtml_legend=1 00:15:28.820 --rc geninfo_all_blocks=1 00:15:28.820 --rc geninfo_unexecuted_blocks=1 00:15:28.820 00:15:28.820 ' 00:15:28.820 15:10:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:28.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.820 --rc genhtml_branch_coverage=1 00:15:28.820 --rc genhtml_function_coverage=1 00:15:28.820 --rc genhtml_legend=1 00:15:28.820 --rc geninfo_all_blocks=1 00:15:28.820 --rc geninfo_unexecuted_blocks=1 00:15:28.820 00:15:28.820 ' 00:15:28.820 15:10:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:28.820 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:28.820 --rc genhtml_branch_coverage=1 00:15:28.820 --rc genhtml_function_coverage=1 00:15:28.820 --rc genhtml_legend=1 00:15:28.820 --rc geninfo_all_blocks=1 00:15:28.820 --rc geninfo_unexecuted_blocks=1 00:15:28.820 00:15:28.820 ' 00:15:28.820 15:10:28 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:28.820 15:10:28 -- nvmf/common.sh@7 -- # uname -s 00:15:28.820 15:10:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:28.820 15:10:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:28.820 15:10:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:28.820 15:10:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:28.820 15:10:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:28.820 15:10:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:28.820 15:10:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:28.820 15:10:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:28.820 15:10:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:28.820 15:10:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:28.820 15:10:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.820 15:10:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:28.820 15:10:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:28.820 15:10:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:28.820 15:10:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:28.820 15:10:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:28.820 15:10:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:28.820 15:10:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:28.820 15:10:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:28.820 15:10:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.820 15:10:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.820 15:10:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.820 15:10:28 -- paths/export.sh@5 -- # export PATH 00:15:28.820 15:10:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:28.820 15:10:28 -- nvmf/common.sh@46 -- # : 0 00:15:28.820 15:10:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:28.820 15:10:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:28.820 15:10:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:28.820 15:10:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:28.820 15:10:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:28.820 15:10:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:28.820 15:10:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:28.820 15:10:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:28.820 15:10:28 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=682328 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 682328' 00:15:28.821 Process pid: 682328 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:28.821 15:10:28 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 682328 00:15:28.821 15:10:28 -- common/autotest_common.sh@829 -- # '[' -z 682328 ']' 00:15:28.821 15:10:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:28.821 15:10:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:28.821 15:10:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:28.821 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:28.821 15:10:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:28.821 15:10:28 -- common/autotest_common.sh@10 -- # set +x 00:15:28.821 [2024-11-28 15:10:28.867907] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:28.821 [2024-11-28 15:10:28.867993] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:28.821 EAL: No free 2048 kB hugepages reported on node 1 00:15:28.821 [2024-11-28 15:10:28.941865] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:28.821 [2024-11-28 15:10:29.042753] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:28.821 [2024-11-28 15:10:29.042929] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:28.821 [2024-11-28 15:10:29.042958] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:28.821 [2024-11-28 15:10:29.042982] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:28.821 [2024-11-28 15:10:29.043046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:28.821 [2024-11-28 15:10:29.043116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:28.821 [2024-11-28 15:10:29.043175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:28.821 [2024-11-28 15:10:29.043184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:29.078 15:10:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:29.078 15:10:29 -- common/autotest_common.sh@862 -- # return 0 00:15:29.078 15:10:29 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:30.010 15:10:30 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:30.267 15:10:30 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:30.267 15:10:30 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:30.267 15:10:30 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:30.267 15:10:30 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:30.267 15:10:30 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:30.525 Malloc1 00:15:30.783 15:10:30 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:30.783 15:10:31 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:31.041 15:10:31 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:31.299 15:10:31 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:31.299 15:10:31 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:31.299 15:10:31 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:31.557 Malloc2 00:15:31.815 15:10:31 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:31.815 15:10:32 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:32.073 15:10:32 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:32.330 15:10:32 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:32.330 15:10:32 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:32.330 15:10:32 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:32.330 15:10:32 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:32.330 15:10:32 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:32.330 15:10:32 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:32.330 [2024-11-28 15:10:32.562995] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:32.330 [2024-11-28 15:10:32.563039] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid682770 ] 00:15:32.590 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.590 [2024-11-28 15:10:32.597323] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:32.590 [2024-11-28 15:10:32.605562] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:32.590 [2024-11-28 15:10:32.605592] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f8fb89b9000 00:15:32.590 [2024-11-28 15:10:32.606556] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.607546] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.608551] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.609563] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.610560] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.611566] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.612577] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.613585] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:32.590 [2024-11-28 15:10:32.614589] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:32.590 [2024-11-28 15:10:32.614609] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f8fb76b3000 00:15:32.590 [2024-11-28 15:10:32.615738] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:32.590 [2024-11-28 15:10:32.631683] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:32.590 [2024-11-28 15:10:32.631726] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:32.590 [2024-11-28 15:10:32.636733] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:32.590 [2024-11-28 15:10:32.636794] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:32.590 [2024-11-28 15:10:32.636894] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:32.590 [2024-11-28 15:10:32.636931] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:32.590 [2024-11-28 15:10:32.636942] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:32.590 [2024-11-28 15:10:32.637723] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:32.590 [2024-11-28 15:10:32.637744] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:32.590 [2024-11-28 15:10:32.637755] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:32.590 [2024-11-28 15:10:32.638731] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:32.590 [2024-11-28 15:10:32.638749] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:32.590 [2024-11-28 15:10:32.638762] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:32.590 [2024-11-28 15:10:32.639734] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:32.590 [2024-11-28 15:10:32.639752] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:32.590 [2024-11-28 15:10:32.640743] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:32.590 [2024-11-28 15:10:32.640763] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:32.590 [2024-11-28 15:10:32.640772] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:32.590 [2024-11-28 15:10:32.640782] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:32.590 [2024-11-28 15:10:32.640892] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:32.590 [2024-11-28 15:10:32.640900] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:32.590 [2024-11-28 15:10:32.640908] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:32.590 [2024-11-28 15:10:32.641752] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:32.590 [2024-11-28 15:10:32.642755] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:32.590 [2024-11-28 15:10:32.643759] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:32.590 [2024-11-28 15:10:32.644798] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:32.590 [2024-11-28 15:10:32.645765] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:32.590 [2024-11-28 15:10:32.645783] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:32.590 [2024-11-28 15:10:32.645791] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:32.590 [2024-11-28 15:10:32.645815] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:32.590 [2024-11-28 15:10:32.645828] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:32.590 [2024-11-28 15:10:32.645854] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.590 [2024-11-28 15:10:32.645864] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.590 [2024-11-28 15:10:32.645887] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.590 [2024-11-28 15:10:32.645948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:32.590 [2024-11-28 15:10:32.645966] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:32.590 [2024-11-28 15:10:32.645975] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:32.591 [2024-11-28 15:10:32.645982] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:32.591 [2024-11-28 15:10:32.645989] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:32.591 [2024-11-28 15:10:32.645996] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:32.591 [2024-11-28 15:10:32.646003] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:32.591 [2024-11-28 15:10:32.646010] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646027] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646042] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.591 [2024-11-28 15:10:32.646118] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.591 [2024-11-28 15:10:32.646130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.591 [2024-11-28 15:10:32.646141] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:32.591 [2024-11-28 15:10:32.646154] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646172] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646187] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646210] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:32.591 [2024-11-28 15:10:32.646218] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646229] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646243] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646256] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646333] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646360] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:32.591 [2024-11-28 15:10:32.646367] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:32.591 [2024-11-28 15:10:32.646377] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646434] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:32.591 [2024-11-28 15:10:32.646455] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646470] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646481] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.591 [2024-11-28 15:10:32.646488] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.591 [2024-11-28 15:10:32.646497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646541] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646555] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646570] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:32.591 [2024-11-28 15:10:32.646578] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.591 [2024-11-28 15:10:32.646587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646612] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646622] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646636] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646646] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646654] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646663] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:32.591 [2024-11-28 15:10:32.646670] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:32.591 [2024-11-28 15:10:32.646678] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:32.591 [2024-11-28 15:10:32.646704] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646739] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646765] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646794] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.646825] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:32.591 [2024-11-28 15:10:32.646833] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:32.591 [2024-11-28 15:10:32.646839] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:32.591 [2024-11-28 15:10:32.646845] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:32.591 [2024-11-28 15:10:32.646853] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:32.591 [2024-11-28 15:10:32.646864] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:32.591 [2024-11-28 15:10:32.646969] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:32.591 [2024-11-28 15:10:32.646981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.646992] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:32.591 [2024-11-28 15:10:32.647000] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:32.591 [2024-11-28 15:10:32.647008] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.647019] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:32.591 [2024-11-28 15:10:32.647027] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:32.591 [2024-11-28 15:10:32.647035] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:32.591 [2024-11-28 15:10:32.647046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.647066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.647107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:32.591 [2024-11-28 15:10:32.647120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:32.591 ===================================================== 00:15:32.591 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:32.591 ===================================================== 00:15:32.591 Controller Capabilities/Features 00:15:32.591 ================================ 00:15:32.591 Vendor ID: 4e58 00:15:32.591 Subsystem Vendor ID: 4e58 00:15:32.591 Serial Number: SPDK1 00:15:32.591 Model Number: SPDK bdev Controller 00:15:32.591 Firmware Version: 24.01.1 00:15:32.591 Recommended Arb Burst: 6 00:15:32.591 IEEE OUI Identifier: 8d 6b 50 00:15:32.591 Multi-path I/O 00:15:32.591 May have multiple subsystem ports: Yes 00:15:32.591 May have multiple controllers: Yes 00:15:32.591 Associated with SR-IOV VF: No 00:15:32.592 Max Data Transfer Size: 131072 00:15:32.592 Max Number of Namespaces: 32 00:15:32.592 Max Number of I/O Queues: 127 00:15:32.592 NVMe Specification Version (VS): 1.3 00:15:32.592 NVMe Specification Version (Identify): 1.3 00:15:32.592 Maximum Queue Entries: 256 00:15:32.592 Contiguous Queues Required: Yes 00:15:32.592 Arbitration Mechanisms Supported 00:15:32.592 Weighted Round Robin: Not Supported 00:15:32.592 Vendor Specific: Not Supported 00:15:32.592 Reset Timeout: 15000 ms 00:15:32.592 Doorbell Stride: 4 bytes 00:15:32.592 NVM Subsystem Reset: Not Supported 00:15:32.592 Command Sets Supported 00:15:32.592 NVM Command Set: Supported 00:15:32.592 Boot Partition: Not Supported 00:15:32.592 Memory Page Size Minimum: 4096 bytes 00:15:32.592 Memory Page Size Maximum: 4096 bytes 00:15:32.592 Persistent Memory Region: Not Supported 00:15:32.592 Optional Asynchronous Events Supported 00:15:32.592 Namespace Attribute Notices: Supported 00:15:32.592 Firmware Activation Notices: Not Supported 00:15:32.592 ANA Change Notices: Not Supported 00:15:32.592 PLE Aggregate Log Change Notices: Not Supported 00:15:32.592 LBA Status Info Alert Notices: Not Supported 00:15:32.592 EGE Aggregate Log Change Notices: Not Supported 00:15:32.592 Normal NVM Subsystem Shutdown event: Not Supported 00:15:32.592 Zone Descriptor Change Notices: Not Supported 00:15:32.592 Discovery Log Change Notices: Not Supported 00:15:32.592 Controller Attributes 00:15:32.592 128-bit Host Identifier: Supported 00:15:32.592 Non-Operational Permissive Mode: Not Supported 00:15:32.592 NVM Sets: Not Supported 00:15:32.592 Read Recovery Levels: Not Supported 00:15:32.592 Endurance Groups: Not Supported 00:15:32.592 Predictable Latency Mode: Not Supported 00:15:32.592 Traffic Based Keep ALive: Not Supported 00:15:32.592 Namespace Granularity: Not Supported 00:15:32.592 SQ Associations: Not Supported 00:15:32.592 UUID List: Not Supported 00:15:32.592 Multi-Domain Subsystem: Not Supported 00:15:32.592 Fixed Capacity Management: Not Supported 00:15:32.592 Variable Capacity Management: Not Supported 00:15:32.592 Delete Endurance Group: Not Supported 00:15:32.592 Delete NVM Set: Not Supported 00:15:32.592 Extended LBA Formats Supported: Not Supported 00:15:32.592 Flexible Data Placement Supported: Not Supported 00:15:32.592 00:15:32.592 Controller Memory Buffer Support 00:15:32.592 ================================ 00:15:32.592 Supported: No 00:15:32.592 00:15:32.592 Persistent Memory Region Support 00:15:32.592 ================================ 00:15:32.592 Supported: No 00:15:32.592 00:15:32.592 Admin Command Set Attributes 00:15:32.592 ============================ 00:15:32.592 Security Send/Receive: Not Supported 00:15:32.592 Format NVM: Not Supported 00:15:32.592 Firmware Activate/Download: Not Supported 00:15:32.592 Namespace Management: Not Supported 00:15:32.592 Device Self-Test: Not Supported 00:15:32.592 Directives: Not Supported 00:15:32.592 NVMe-MI: Not Supported 00:15:32.592 Virtualization Management: Not Supported 00:15:32.592 Doorbell Buffer Config: Not Supported 00:15:32.592 Get LBA Status Capability: Not Supported 00:15:32.592 Command & Feature Lockdown Capability: Not Supported 00:15:32.592 Abort Command Limit: 4 00:15:32.592 Async Event Request Limit: 4 00:15:32.592 Number of Firmware Slots: N/A 00:15:32.592 Firmware Slot 1 Read-Only: N/A 00:15:32.592 Firmware Activation Without Reset: N/A 00:15:32.592 Multiple Update Detection Support: N/A 00:15:32.592 Firmware Update Granularity: No Information Provided 00:15:32.592 Per-Namespace SMART Log: No 00:15:32.592 Asymmetric Namespace Access Log Page: Not Supported 00:15:32.592 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:32.592 Command Effects Log Page: Supported 00:15:32.592 Get Log Page Extended Data: Supported 00:15:32.592 Telemetry Log Pages: Not Supported 00:15:32.592 Persistent Event Log Pages: Not Supported 00:15:32.592 Supported Log Pages Log Page: May Support 00:15:32.592 Commands Supported & Effects Log Page: Not Supported 00:15:32.592 Feature Identifiers & Effects Log Page:May Support 00:15:32.592 NVMe-MI Commands & Effects Log Page: May Support 00:15:32.592 Data Area 4 for Telemetry Log: Not Supported 00:15:32.592 Error Log Page Entries Supported: 128 00:15:32.592 Keep Alive: Supported 00:15:32.592 Keep Alive Granularity: 10000 ms 00:15:32.592 00:15:32.592 NVM Command Set Attributes 00:15:32.592 ========================== 00:15:32.592 Submission Queue Entry Size 00:15:32.592 Max: 64 00:15:32.592 Min: 64 00:15:32.592 Completion Queue Entry Size 00:15:32.592 Max: 16 00:15:32.592 Min: 16 00:15:32.592 Number of Namespaces: 32 00:15:32.592 Compare Command: Supported 00:15:32.592 Write Uncorrectable Command: Not Supported 00:15:32.592 Dataset Management Command: Supported 00:15:32.592 Write Zeroes Command: Supported 00:15:32.592 Set Features Save Field: Not Supported 00:15:32.592 Reservations: Not Supported 00:15:32.592 Timestamp: Not Supported 00:15:32.592 Copy: Supported 00:15:32.592 Volatile Write Cache: Present 00:15:32.592 Atomic Write Unit (Normal): 1 00:15:32.592 Atomic Write Unit (PFail): 1 00:15:32.592 Atomic Compare & Write Unit: 1 00:15:32.592 Fused Compare & Write: Supported 00:15:32.592 Scatter-Gather List 00:15:32.592 SGL Command Set: Supported (Dword aligned) 00:15:32.592 SGL Keyed: Not Supported 00:15:32.592 SGL Bit Bucket Descriptor: Not Supported 00:15:32.592 SGL Metadata Pointer: Not Supported 00:15:32.592 Oversized SGL: Not Supported 00:15:32.592 SGL Metadata Address: Not Supported 00:15:32.592 SGL Offset: Not Supported 00:15:32.592 Transport SGL Data Block: Not Supported 00:15:32.592 Replay Protected Memory Block: Not Supported 00:15:32.592 00:15:32.592 Firmware Slot Information 00:15:32.592 ========================= 00:15:32.592 Active slot: 1 00:15:32.592 Slot 1 Firmware Revision: 24.01.1 00:15:32.592 00:15:32.592 00:15:32.592 Commands Supported and Effects 00:15:32.592 ============================== 00:15:32.592 Admin Commands 00:15:32.592 -------------- 00:15:32.592 Get Log Page (02h): Supported 00:15:32.592 Identify (06h): Supported 00:15:32.592 Abort (08h): Supported 00:15:32.592 Set Features (09h): Supported 00:15:32.592 Get Features (0Ah): Supported 00:15:32.592 Asynchronous Event Request (0Ch): Supported 00:15:32.592 Keep Alive (18h): Supported 00:15:32.592 I/O Commands 00:15:32.592 ------------ 00:15:32.592 Flush (00h): Supported LBA-Change 00:15:32.592 Write (01h): Supported LBA-Change 00:15:32.592 Read (02h): Supported 00:15:32.592 Compare (05h): Supported 00:15:32.592 Write Zeroes (08h): Supported LBA-Change 00:15:32.592 Dataset Management (09h): Supported LBA-Change 00:15:32.592 Copy (19h): Supported LBA-Change 00:15:32.592 Unknown (79h): Supported LBA-Change 00:15:32.592 Unknown (7Ah): Supported 00:15:32.592 00:15:32.592 Error Log 00:15:32.592 ========= 00:15:32.592 00:15:32.592 Arbitration 00:15:32.592 =========== 00:15:32.592 Arbitration Burst: 1 00:15:32.592 00:15:32.592 Power Management 00:15:32.592 ================ 00:15:32.592 Number of Power States: 1 00:15:32.592 Current Power State: Power State #0 00:15:32.592 Power State #0: 00:15:32.592 Max Power: 0.00 W 00:15:32.592 Non-Operational State: Operational 00:15:32.592 Entry Latency: Not Reported 00:15:32.592 Exit Latency: Not Reported 00:15:32.592 Relative Read Throughput: 0 00:15:32.592 Relative Read Latency: 0 00:15:32.592 Relative Write Throughput: 0 00:15:32.592 Relative Write Latency: 0 00:15:32.592 Idle Power: Not Reported 00:15:32.592 Active Power: Not Reported 00:15:32.592 Non-Operational Permissive Mode: Not Supported 00:15:32.592 00:15:32.592 Health Information 00:15:32.592 ================== 00:15:32.592 Critical Warnings: 00:15:32.592 Available Spare Space: OK 00:15:32.592 Temperature: OK 00:15:32.592 Device Reliability: OK 00:15:32.592 Read Only: No 00:15:32.592 Volatile Memory Backup: OK 00:15:32.592 Current Temperature: 0 Kelvin[2024-11-28 15:10:32.647246] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:32.592 [2024-11-28 15:10:32.647262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:32.592 [2024-11-28 15:10:32.647301] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:32.592 [2024-11-28 15:10:32.647319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.592 [2024-11-28 15:10:32.647330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.592 [2024-11-28 15:10:32.647340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.592 [2024-11-28 15:10:32.647349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:32.592 [2024-11-28 15:10:32.649244] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:32.593 [2024-11-28 15:10:32.649272] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:32.593 [2024-11-28 15:10:32.649853] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:32.593 [2024-11-28 15:10:32.649866] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:32.593 [2024-11-28 15:10:32.650802] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:32.593 [2024-11-28 15:10:32.650827] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:32.593 [2024-11-28 15:10:32.650883] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:32.593 [2024-11-28 15:10:32.655107] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:32.593 (-273 Celsius) 00:15:32.593 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:32.593 Available Spare: 0% 00:15:32.593 Available Spare Threshold: 0% 00:15:32.593 Life Percentage Used: 0% 00:15:32.593 Data Units Read: 0 00:15:32.593 Data Units Written: 0 00:15:32.593 Host Read Commands: 0 00:15:32.593 Host Write Commands: 0 00:15:32.593 Controller Busy Time: 0 minutes 00:15:32.593 Power Cycles: 0 00:15:32.593 Power On Hours: 0 hours 00:15:32.593 Unsafe Shutdowns: 0 00:15:32.593 Unrecoverable Media Errors: 0 00:15:32.593 Lifetime Error Log Entries: 0 00:15:32.593 Warning Temperature Time: 0 minutes 00:15:32.593 Critical Temperature Time: 0 minutes 00:15:32.593 00:15:32.593 Number of Queues 00:15:32.593 ================ 00:15:32.593 Number of I/O Submission Queues: 127 00:15:32.593 Number of I/O Completion Queues: 127 00:15:32.593 00:15:32.593 Active Namespaces 00:15:32.593 ================= 00:15:32.593 Namespace ID:1 00:15:32.593 Error Recovery Timeout: Unlimited 00:15:32.593 Command Set Identifier: NVM (00h) 00:15:32.593 Deallocate: Supported 00:15:32.593 Deallocated/Unwritten Error: Not Supported 00:15:32.593 Deallocated Read Value: Unknown 00:15:32.593 Deallocate in Write Zeroes: Not Supported 00:15:32.593 Deallocated Guard Field: 0xFFFF 00:15:32.593 Flush: Supported 00:15:32.593 Reservation: Supported 00:15:32.593 Namespace Sharing Capabilities: Multiple Controllers 00:15:32.593 Size (in LBAs): 131072 (0GiB) 00:15:32.593 Capacity (in LBAs): 131072 (0GiB) 00:15:32.593 Utilization (in LBAs): 131072 (0GiB) 00:15:32.593 NGUID: 9D152877EC2F45A2933DAE326F21CDF2 00:15:32.593 UUID: 9d152877-ec2f-45a2-933d-ae326f21cdf2 00:15:32.593 Thin Provisioning: Not Supported 00:15:32.593 Per-NS Atomic Units: Yes 00:15:32.593 Atomic Boundary Size (Normal): 0 00:15:32.593 Atomic Boundary Size (PFail): 0 00:15:32.593 Atomic Boundary Offset: 0 00:15:32.593 Maximum Single Source Range Length: 65535 00:15:32.593 Maximum Copy Length: 65535 00:15:32.593 Maximum Source Range Count: 1 00:15:32.593 NGUID/EUI64 Never Reused: No 00:15:32.593 Namespace Write Protected: No 00:15:32.593 Number of LBA Formats: 1 00:15:32.593 Current LBA Format: LBA Format #00 00:15:32.593 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:32.593 00:15:32.593 15:10:32 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:32.593 EAL: No free 2048 kB hugepages reported on node 1 00:15:37.856 Initializing NVMe Controllers 00:15:37.856 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:37.856 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:37.856 Initialization complete. Launching workers. 00:15:37.856 ======================================================== 00:15:37.856 Latency(us) 00:15:37.856 Device Information : IOPS MiB/s Average min max 00:15:37.856 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 38039.60 148.59 3365.69 1151.31 7473.87 00:15:37.856 ======================================================== 00:15:37.856 Total : 38039.60 148.59 3365.69 1151.31 7473.87 00:15:37.856 00:15:37.856 15:10:37 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:37.856 EAL: No free 2048 kB hugepages reported on node 1 00:15:43.117 Initializing NVMe Controllers 00:15:43.117 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:43.117 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:43.117 Initialization complete. Launching workers. 00:15:43.117 ======================================================== 00:15:43.117 Latency(us) 00:15:43.117 Device Information : IOPS MiB/s Average min max 00:15:43.117 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16025.60 62.60 7996.98 6976.96 15974.72 00:15:43.117 ======================================================== 00:15:43.117 Total : 16025.60 62.60 7996.98 6976.96 15974.72 00:15:43.117 00:15:43.117 15:10:43 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:43.117 EAL: No free 2048 kB hugepages reported on node 1 00:15:48.463 Initializing NVMe Controllers 00:15:48.463 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.463 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:48.463 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:48.463 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:48.463 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:48.463 Initialization complete. Launching workers. 00:15:48.463 Starting thread on core 2 00:15:48.463 Starting thread on core 3 00:15:48.463 Starting thread on core 1 00:15:48.463 15:10:48 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:48.463 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.748 Initializing NVMe Controllers 00:15:51.748 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.748 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.748 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:51.748 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:51.748 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:51.748 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:51.748 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:51.748 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:51.748 Initialization complete. Launching workers. 00:15:51.748 Starting thread on core 1 with urgent priority queue 00:15:51.748 Starting thread on core 2 with urgent priority queue 00:15:51.748 Starting thread on core 3 with urgent priority queue 00:15:51.748 Starting thread on core 0 with urgent priority queue 00:15:51.748 SPDK bdev Controller (SPDK1 ) core 0: 5724.33 IO/s 17.47 secs/100000 ios 00:15:51.748 SPDK bdev Controller (SPDK1 ) core 1: 5833.00 IO/s 17.14 secs/100000 ios 00:15:51.748 SPDK bdev Controller (SPDK1 ) core 2: 5856.00 IO/s 17.08 secs/100000 ios 00:15:51.748 SPDK bdev Controller (SPDK1 ) core 3: 5986.67 IO/s 16.70 secs/100000 ios 00:15:51.748 ======================================================== 00:15:51.748 00:15:51.748 15:10:51 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:51.748 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.006 Initializing NVMe Controllers 00:15:52.006 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:52.006 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:52.006 Namespace ID: 1 size: 0GB 00:15:52.006 Initialization complete. 00:15:52.006 INFO: using host memory buffer for IO 00:15:52.006 Hello world! 00:15:52.006 15:10:52 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:52.006 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.379 Initializing NVMe Controllers 00:15:53.379 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.379 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:53.379 Initialization complete. Launching workers. 00:15:53.379 submit (in ns) avg, min, max = 8544.0, 3465.6, 4016543.3 00:15:53.379 complete (in ns) avg, min, max = 24133.2, 2037.8, 7989065.6 00:15:53.379 00:15:53.379 Submit histogram 00:15:53.379 ================ 00:15:53.379 Range in us Cumulative Count 00:15:53.379 3.461 - 3.484: 0.1456% ( 20) 00:15:53.379 3.484 - 3.508: 0.7500% ( 83) 00:15:53.379 3.508 - 3.532: 2.4904% ( 239) 00:15:53.379 3.532 - 3.556: 5.6215% ( 430) 00:15:53.379 3.556 - 3.579: 12.6556% ( 966) 00:15:53.379 3.579 - 3.603: 21.0005% ( 1146) 00:15:53.379 3.603 - 3.627: 30.7143% ( 1334) 00:15:53.379 3.627 - 3.650: 39.7655% ( 1243) 00:15:53.379 3.650 - 3.674: 47.7973% ( 1103) 00:15:53.379 3.674 - 3.698: 54.2416% ( 885) 00:15:53.379 3.698 - 3.721: 60.1180% ( 807) 00:15:53.379 3.721 - 3.745: 64.3122% ( 576) 00:15:53.379 3.745 - 3.769: 67.8584% ( 487) 00:15:53.379 3.769 - 3.793: 71.3100% ( 474) 00:15:53.379 3.793 - 3.816: 74.5795% ( 449) 00:15:53.379 3.816 - 3.840: 78.2131% ( 499) 00:15:53.379 3.840 - 3.864: 82.0797% ( 531) 00:15:53.379 3.864 - 3.887: 85.1962% ( 428) 00:15:53.380 3.887 - 3.911: 87.7813% ( 355) 00:15:53.380 3.911 - 3.935: 89.7546% ( 271) 00:15:53.380 3.935 - 3.959: 91.3129% ( 214) 00:15:53.380 3.959 - 3.982: 92.8493% ( 211) 00:15:53.380 3.982 - 4.006: 94.0872% ( 170) 00:15:53.380 4.006 - 4.030: 94.8300% ( 102) 00:15:53.380 4.030 - 4.053: 95.4635% ( 87) 00:15:53.380 4.053 - 4.077: 95.9586% ( 68) 00:15:53.380 4.077 - 4.101: 96.3591% ( 55) 00:15:53.380 4.101 - 4.124: 96.7087% ( 48) 00:15:53.380 4.124 - 4.148: 96.8980% ( 26) 00:15:53.380 4.148 - 4.172: 97.0291% ( 18) 00:15:53.380 4.172 - 4.196: 97.1237% ( 13) 00:15:53.380 4.196 - 4.219: 97.2329% ( 15) 00:15:53.380 4.219 - 4.243: 97.3058% ( 10) 00:15:53.380 4.243 - 4.267: 97.3713% ( 9) 00:15:53.380 4.267 - 4.290: 97.4368% ( 9) 00:15:53.380 4.290 - 4.314: 97.4805% ( 6) 00:15:53.380 4.314 - 4.338: 97.5679% ( 12) 00:15:53.380 4.338 - 4.361: 97.5825% ( 2) 00:15:53.380 4.361 - 4.385: 97.5970% ( 2) 00:15:53.380 4.385 - 4.409: 97.6262% ( 4) 00:15:53.380 4.409 - 4.433: 97.6334% ( 1) 00:15:53.380 4.433 - 4.456: 97.6553% ( 3) 00:15:53.380 4.456 - 4.480: 97.6771% ( 3) 00:15:53.380 4.480 - 4.504: 97.6844% ( 1) 00:15:53.380 4.504 - 4.527: 97.6917% ( 1) 00:15:53.380 4.527 - 4.551: 97.7135% ( 3) 00:15:53.380 4.575 - 4.599: 97.7281% ( 2) 00:15:53.380 4.599 - 4.622: 97.7354% ( 1) 00:15:53.380 4.622 - 4.646: 97.7499% ( 2) 00:15:53.380 4.646 - 4.670: 97.7645% ( 2) 00:15:53.380 4.693 - 4.717: 97.7936% ( 4) 00:15:53.380 4.717 - 4.741: 97.8228% ( 4) 00:15:53.380 4.741 - 4.764: 97.8592% ( 5) 00:15:53.380 4.764 - 4.788: 97.9538% ( 13) 00:15:53.380 4.788 - 4.812: 98.0194% ( 9) 00:15:53.380 4.812 - 4.836: 98.0412% ( 3) 00:15:53.380 4.836 - 4.859: 98.0631% ( 3) 00:15:53.380 4.859 - 4.883: 98.1068% ( 6) 00:15:53.380 4.883 - 4.907: 98.1359% ( 4) 00:15:53.380 4.907 - 4.930: 98.1577% ( 3) 00:15:53.380 4.930 - 4.954: 98.1650% ( 1) 00:15:53.380 4.954 - 4.978: 98.1941% ( 4) 00:15:53.380 4.978 - 5.001: 98.2378% ( 6) 00:15:53.380 5.001 - 5.025: 98.2524% ( 2) 00:15:53.380 5.025 - 5.049: 98.2888% ( 5) 00:15:53.380 5.049 - 5.073: 98.3034% ( 2) 00:15:53.380 5.073 - 5.096: 98.3106% ( 1) 00:15:53.380 5.096 - 5.120: 98.3179% ( 1) 00:15:53.380 5.120 - 5.144: 98.3398% ( 3) 00:15:53.380 5.144 - 5.167: 98.3616% ( 3) 00:15:53.380 5.191 - 5.215: 98.3689% ( 1) 00:15:53.380 5.239 - 5.262: 98.3762% ( 1) 00:15:53.380 5.262 - 5.286: 98.3835% ( 1) 00:15:53.380 5.286 - 5.310: 98.3980% ( 2) 00:15:53.380 5.381 - 5.404: 98.4053% ( 1) 00:15:53.380 5.404 - 5.428: 98.4126% ( 1) 00:15:53.380 5.476 - 5.499: 98.4199% ( 1) 00:15:53.380 5.523 - 5.547: 98.4271% ( 1) 00:15:53.380 5.618 - 5.641: 98.4344% ( 1) 00:15:53.380 5.736 - 5.760: 98.4417% ( 1) 00:15:53.380 6.068 - 6.116: 98.4490% ( 1) 00:15:53.380 6.116 - 6.163: 98.4563% ( 1) 00:15:53.380 6.400 - 6.447: 98.4781% ( 3) 00:15:53.380 6.447 - 6.495: 98.4854% ( 1) 00:15:53.380 6.590 - 6.637: 98.4927% ( 1) 00:15:53.380 6.779 - 6.827: 98.5072% ( 2) 00:15:53.380 6.874 - 6.921: 98.5145% ( 1) 00:15:53.380 6.969 - 7.016: 98.5218% ( 1) 00:15:53.380 7.301 - 7.348: 98.5291% ( 1) 00:15:53.380 7.396 - 7.443: 98.5437% ( 2) 00:15:53.380 7.443 - 7.490: 98.5509% ( 1) 00:15:53.380 7.585 - 7.633: 98.5655% ( 2) 00:15:53.380 7.633 - 7.680: 98.5801% ( 2) 00:15:53.380 7.680 - 7.727: 98.5946% ( 2) 00:15:53.380 7.727 - 7.775: 98.6019% ( 1) 00:15:53.380 7.822 - 7.870: 98.6165% ( 2) 00:15:53.380 7.870 - 7.917: 98.6383% ( 3) 00:15:53.380 7.917 - 7.964: 98.6456% ( 1) 00:15:53.380 8.012 - 8.059: 98.6529% ( 1) 00:15:53.380 8.059 - 8.107: 98.6747% ( 3) 00:15:53.380 8.107 - 8.154: 98.6820% ( 1) 00:15:53.380 8.154 - 8.201: 98.6893% ( 1) 00:15:53.380 8.201 - 8.249: 98.6966% ( 1) 00:15:53.380 8.249 - 8.296: 98.7111% ( 2) 00:15:53.380 8.296 - 8.344: 98.7184% ( 1) 00:15:53.380 8.344 - 8.391: 98.7257% ( 1) 00:15:53.380 8.391 - 8.439: 98.7403% ( 2) 00:15:53.380 8.486 - 8.533: 98.7548% ( 2) 00:15:53.380 8.770 - 8.818: 98.7694% ( 2) 00:15:53.380 8.818 - 8.865: 98.7767% ( 1) 00:15:53.380 8.960 - 9.007: 98.7912% ( 2) 00:15:53.380 9.007 - 9.055: 98.7985% ( 1) 00:15:53.380 9.339 - 9.387: 98.8058% ( 1) 00:15:53.380 9.387 - 9.434: 98.8204% ( 2) 00:15:53.380 9.434 - 9.481: 98.8276% ( 1) 00:15:53.380 9.861 - 9.908: 98.8349% ( 1) 00:15:53.380 10.098 - 10.145: 98.8422% ( 1) 00:15:53.380 10.240 - 10.287: 98.8568% ( 2) 00:15:53.380 10.335 - 10.382: 98.8641% ( 1) 00:15:53.380 10.619 - 10.667: 98.8786% ( 2) 00:15:53.380 10.999 - 11.046: 98.8859% ( 1) 00:15:53.380 11.046 - 11.093: 98.8932% ( 1) 00:15:53.380 11.141 - 11.188: 98.9005% ( 1) 00:15:53.380 11.994 - 12.041: 98.9077% ( 1) 00:15:53.380 12.231 - 12.326: 98.9223% ( 2) 00:15:53.380 12.326 - 12.421: 98.9296% ( 1) 00:15:53.380 12.705 - 12.800: 98.9369% ( 1) 00:15:53.380 12.800 - 12.895: 98.9441% ( 1) 00:15:53.380 13.084 - 13.179: 98.9514% ( 1) 00:15:53.380 13.369 - 13.464: 98.9660% ( 2) 00:15:53.380 13.464 - 13.559: 98.9733% ( 1) 00:15:53.380 13.559 - 13.653: 98.9806% ( 1) 00:15:53.380 13.748 - 13.843: 98.9878% ( 1) 00:15:53.380 13.938 - 14.033: 98.9951% ( 1) 00:15:53.380 14.222 - 14.317: 99.0097% ( 2) 00:15:53.380 14.317 - 14.412: 99.0170% ( 1) 00:15:53.380 14.601 - 14.696: 99.0242% ( 1) 00:15:53.380 14.696 - 14.791: 99.0315% ( 1) 00:15:53.380 15.076 - 15.170: 99.0388% ( 1) 00:15:53.380 15.360 - 15.455: 99.0461% ( 1) 00:15:53.380 17.067 - 17.161: 99.0534% ( 1) 00:15:53.380 17.161 - 17.256: 99.0825% ( 4) 00:15:53.380 17.256 - 17.351: 99.0898% ( 1) 00:15:53.380 17.351 - 17.446: 99.1189% ( 4) 00:15:53.380 17.446 - 17.541: 99.1408% ( 3) 00:15:53.380 17.541 - 17.636: 99.1699% ( 4) 00:15:53.380 17.636 - 17.730: 99.2136% ( 6) 00:15:53.380 17.730 - 17.825: 99.2354% ( 3) 00:15:53.380 17.825 - 17.920: 99.2864% ( 7) 00:15:53.380 17.920 - 18.015: 99.3519% ( 9) 00:15:53.380 18.015 - 18.110: 99.3956% ( 6) 00:15:53.380 18.110 - 18.204: 99.4320% ( 5) 00:15:53.380 18.204 - 18.299: 99.5558% ( 17) 00:15:53.380 18.299 - 18.394: 99.5777% ( 3) 00:15:53.380 18.394 - 18.489: 99.6141% ( 5) 00:15:53.380 18.489 - 18.584: 99.6359% ( 3) 00:15:53.380 18.584 - 18.679: 99.6578% ( 3) 00:15:53.380 18.679 - 18.773: 99.6723% ( 2) 00:15:53.380 18.773 - 18.868: 99.6796% ( 1) 00:15:53.380 18.868 - 18.963: 99.7306% ( 7) 00:15:53.380 19.058 - 19.153: 99.7524% ( 3) 00:15:53.380 19.153 - 19.247: 99.7815% ( 4) 00:15:53.380 19.247 - 19.342: 99.7961% ( 2) 00:15:53.380 19.437 - 19.532: 99.8180% ( 3) 00:15:53.380 19.532 - 19.627: 99.8252% ( 1) 00:15:53.380 19.721 - 19.816: 99.8398% ( 2) 00:15:53.380 19.816 - 19.911: 99.8544% ( 2) 00:15:53.380 20.006 - 20.101: 99.8616% ( 1) 00:15:53.380 20.954 - 21.049: 99.8689% ( 1) 00:15:53.380 27.307 - 27.496: 99.8762% ( 1) 00:15:53.380 28.634 - 28.824: 99.8835% ( 1) 00:15:53.380 3980.705 - 4004.978: 99.9782% ( 13) 00:15:53.380 4004.978 - 4029.250: 100.0000% ( 3) 00:15:53.380 00:15:53.380 Complete histogram 00:15:53.380 ================== 00:15:53.380 Range in us Cumulative Count 00:15:53.380 2.027 - 2.039: 0.0073% ( 1) 00:15:53.380 2.039 - 2.050: 6.5681% ( 901) 00:15:53.380 2.050 - 2.062: 17.7456% ( 1535) 00:15:53.380 2.062 - 2.074: 19.6825% ( 266) 00:15:53.380 2.074 - 2.086: 42.7438% ( 3167) 00:15:53.380 2.086 - 2.098: 61.9821% ( 2642) 00:15:53.380 2.098 - 2.110: 65.2152% ( 444) 00:15:53.380 2.110 - 2.121: 69.9265% ( 647) 00:15:53.380 2.121 - 2.133: 71.9508% ( 278) 00:15:53.380 2.133 - 2.145: 73.6693% ( 236) 00:15:53.380 2.145 - 2.157: 84.1113% ( 1434) 00:15:53.380 2.157 - 2.169: 89.4633% ( 735) 00:15:53.380 2.169 - 2.181: 90.8614% ( 192) 00:15:53.380 2.181 - 2.193: 92.5726% ( 235) 00:15:53.380 2.193 - 2.204: 93.2280% ( 90) 00:15:53.380 2.204 - 2.216: 93.8906% ( 91) 00:15:53.380 2.216 - 2.228: 95.2814% ( 191) 00:15:53.380 2.228 - 2.240: 95.7984% ( 71) 00:15:53.380 2.240 - 2.252: 95.9295% ( 18) 00:15:53.380 2.252 - 2.264: 96.0824% ( 21) 00:15:53.380 2.264 - 2.276: 96.1480% ( 9) 00:15:53.380 2.276 - 2.287: 96.2718% ( 17) 00:15:53.381 2.287 - 2.299: 96.3664% ( 13) 00:15:53.381 2.299 - 2.311: 96.4028% ( 5) 00:15:53.381 2.311 - 2.323: 96.5339% ( 18) 00:15:53.381 2.323 - 2.335: 96.6722% ( 19) 00:15:53.381 2.335 - 2.347: 96.8907% ( 30) 00:15:53.381 2.347 - 2.359: 97.1747% ( 39) 00:15:53.381 2.359 - 2.370: 97.4878% ( 43) 00:15:53.381 2.370 - 2.382: 97.8592% ( 51) 00:15:53.381 2.382 - 2.394: 98.1068% ( 34) 00:15:53.381 2.394 - 2.406: 98.2451% ( 19) 00:15:53.381 2.406 - 2.418: 98.3106% ( 9) 00:15:53.381 2.418 - 2.430: 98.3980% ( 12) 00:15:53.381 2.430 - 2.441: 98.4199% ( 3) 00:15:53.381 2.441 - 2.453: 98.4563% ( 5) 00:15:53.381 2.453 - 2.465: 98.4636% ( 1) 00:15:53.381 2.465 - 2.477: 98.4708% ( 1) 00:15:53.381 2.477 - 2.489: 98.4854% ( 2) 00:15:53.381 2.489 - 2.501: 98.5072% ( 3) 00:15:53.381 2.513 - 2.524: 98.5145% ( 1) 00:15:53.381 2.524 - 2.536: 98.5218% ( 1) 00:15:53.381 2.548 - 2.560: 98.5291% ( 1) 00:15:53.381 2.584 - 2.596: 98.5364% ( 1) 00:15:53.381 3.176 - 3.200: 98.5509% ( 2) 00:15:53.381 3.224 - 3.247: 98.5582% ( 1) 00:15:53.381 3.247 - 3.271: 98.5728% ( 2) 00:15:53.381 3.295 - 3.319: 98.5873% ( 2) 00:15:53.381 3.342 - 3.366: 98.6092% ( 3) 00:15:53.381 3.366 - 3.390: 98.6165% ( 1) 00:15:53.381 3.390 - 3.413: 98.6238% ( 1) 00:15:53.381 3.413 - 3.437: 98.6383% ( 2) 00:15:53.381 3.437 - 3.461: 98.6456% ( 1) 00:15:53.381 3.461 - 3.484: 98.6674% ( 3) 00:15:53.381 3.508 - 3.532: 98.6747% ( 1) 00:15:53.381 3.532 - 3.556: 98.6820% ( 1) 00:15:53.381 3.579 - 3.603: 98.6893% ( 1) 00:15:53.381 3.627 - 3.650: 98.6966% ( 1) 00:15:53.381 3.650 - 3.674: 98.7039% ( 1) 00:15:53.381 3.698 - 3.721: 98.7111% ( 1) 00:15:53.381 3.769 - 3.793: 98.7184% ( 1) 00:15:53.381 4.290 - 4.314: 98.7257% ( 1) 00:15:53.381 4.338 - 4.361: 98.7330% ( 1) 00:15:53.381 5.144 - 5.167: 98.7403% ( 1) 00:15:53.381 5.262 - 5.286: 98.7475% ( 1) 00:15:53.381 5.381 - 5.404: 98.7548% ( 1) 00:15:53.381 5.499 - 5.523: 98.7621% ( 1) 00:15:53.381 5.570 - 5.594: 98.7694% ( 1) 00:15:53.381 5.594 - 5.618: 98.7767% ( 1) 00:15:53.381 5.689 - 5.713: 98.7840% ( 1) 00:15:53.381 5.902 - 5.926: 98.7912% ( 1) 00:15:53.381 6.163 - 6.210: 98.7985% ( 1) 00:15:53.381 6.305 - 6.353: 98.8058% ( 1) 00:15:53.381 6.353 - 6.400: 98.8131% ( 1) 00:15:53.381 6.590 - 6.637: 98.8204% ( 1) 00:15:53.381 6.637 - 6.684: 98.8276% ( 1) 00:15:53.381 6.684 - 6.732: 98.8349% ( 1) 00:15:53.381 6.874 - 6.921: 98.8495% ( 2) 00:15:53.381 7.585 - 7.633: 98.8568% ( 1) 00:15:53.381 7.870 - 7.917: 98.8641% ( 1) 00:15:53.381 15.455 - 15.550: 98.8786% ( 2) 00:15:53.381 15.550 - 15.644: 98.9077% ( 4) 00:15:53.381 15.644 - 15.739: 98.9441% ( 5) 00:15:53.381 15.739 - 15.834: 98.9878% ( 6) 00:15:53.381 15.834 - 15.929: 99.0024% ( 2) 00:15:53.381 15.929 - 16.024: 99.0170% ( 2) 00:15:53.381 16.024 - 16.119: 99.0315% ( 2) 00:15:53.381 16.119 - 16.213: 99.0607% ( 4) 00:15:53.381 16.213 - 16.308: 99.1043% ( 6) 00:15:53.381 16.308 - 16.403: 99.1408% ( 5) 00:15:53.381 16.403 - 16.498: 99.1626% ( 3) 00:15:53.381 16.498 - 16.593: 99.2063% ( 6) 00:15:53.381 16.593 - 16.687: 99.2354% ( 4) 00:15:53.381 16.687 - 16.782: 99.2791% ( 6) 00:15:53.381 16.782 - 16.877: 99.2937% ( 2) 00:15:53.381 16.877 - 16.972: 99.3010% ( 1) 00:15:53.381 16.972 - 17.067: 99.3228% ( 3) 00:15:53.381 17.067 - 17.161: 99.3446% ( 3) 00:15:53.381 17.161 - 17.256: 99.3519% ( 1) 00:15:53.381 17.256 - 17.351: 99.3592% ( 1) 00:15:53.381 17.351 - 17.446: 99.3665% ( 1) 00:15:53.381 17.446 - 17.541: 99.3738% ( 1) 00:15:53.381 17.541 - 17.636: 99.3811% ( 1) 00:15:53.381 17.730 - 17.825: 99.3883% ( 1) 00:15:53.381 17.825 - 17.920: 99.4102% ( 3) 00:15:53.381 18.110 - 18.204: 99.4247% ( 2) 00:15:53.381 18.204 - 18.299: 99.4320% ( 1) 00:15:53.381 18.299 - 18.394: 99.4393% ( 1) 00:15:53.381 24.841 - 25.031: 99.4466% ( 1) 00:15:53.381 26.738 - 26.927: 99.4539% ( 1) 00:15:53.381 1037.653 - 1043.721: 99.4612% ( 1) 00:15:53.381 2160.261 - 2172.397: 99.4684% ( 1) 00:15:53.381 3980.705 - 4004.978: 99.8835% ( 57) 00:15:53.381 4004.978 - 4029.250: 99.9782% ( 13) 00:15:53.381 4975.881 - 5000.154: 99.9927% ( 2) 00:15:53.381 7961.410 - 8009.956: 100.0000% ( 1) 00:15:53.381 00:15:53.381 15:10:53 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:53.381 15:10:53 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:53.381 15:10:53 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:53.381 15:10:53 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:53.381 15:10:53 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:53.639 [2024-11-28 15:10:53.703213] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:53.639 [ 00:15:53.639 { 00:15:53.639 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:53.639 "subtype": "Discovery", 00:15:53.639 "listen_addresses": [], 00:15:53.639 "allow_any_host": true, 00:15:53.639 "hosts": [] 00:15:53.639 }, 00:15:53.639 { 00:15:53.639 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:53.639 "subtype": "NVMe", 00:15:53.639 "listen_addresses": [ 00:15:53.639 { 00:15:53.639 "transport": "VFIOUSER", 00:15:53.639 "trtype": "VFIOUSER", 00:15:53.639 "adrfam": "IPv4", 00:15:53.639 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:53.639 "trsvcid": "0" 00:15:53.639 } 00:15:53.639 ], 00:15:53.639 "allow_any_host": true, 00:15:53.639 "hosts": [], 00:15:53.639 "serial_number": "SPDK1", 00:15:53.639 "model_number": "SPDK bdev Controller", 00:15:53.639 "max_namespaces": 32, 00:15:53.639 "min_cntlid": 1, 00:15:53.639 "max_cntlid": 65519, 00:15:53.639 "namespaces": [ 00:15:53.639 { 00:15:53.639 "nsid": 1, 00:15:53.639 "bdev_name": "Malloc1", 00:15:53.639 "name": "Malloc1", 00:15:53.639 "nguid": "9D152877EC2F45A2933DAE326F21CDF2", 00:15:53.639 "uuid": "9d152877-ec2f-45a2-933d-ae326f21cdf2" 00:15:53.639 } 00:15:53.639 ] 00:15:53.639 }, 00:15:53.639 { 00:15:53.639 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:53.639 "subtype": "NVMe", 00:15:53.639 "listen_addresses": [ 00:15:53.639 { 00:15:53.639 "transport": "VFIOUSER", 00:15:53.639 "trtype": "VFIOUSER", 00:15:53.639 "adrfam": "IPv4", 00:15:53.639 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:53.639 "trsvcid": "0" 00:15:53.639 } 00:15:53.639 ], 00:15:53.639 "allow_any_host": true, 00:15:53.639 "hosts": [], 00:15:53.639 "serial_number": "SPDK2", 00:15:53.639 "model_number": "SPDK bdev Controller", 00:15:53.639 "max_namespaces": 32, 00:15:53.639 "min_cntlid": 1, 00:15:53.639 "max_cntlid": 65519, 00:15:53.639 "namespaces": [ 00:15:53.639 { 00:15:53.639 "nsid": 1, 00:15:53.639 "bdev_name": "Malloc2", 00:15:53.639 "name": "Malloc2", 00:15:53.639 "nguid": "3A47B2975C24456EADB4F2F20140C517", 00:15:53.639 "uuid": "3a47b297-5c24-456e-adb4-f2f20140c517" 00:15:53.639 } 00:15:53.639 ] 00:15:53.639 } 00:15:53.639 ] 00:15:53.639 15:10:53 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:53.639 15:10:53 -- target/nvmf_vfio_user.sh@34 -- # aerpid=685378 00:15:53.639 15:10:53 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:53.639 15:10:53 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:53.639 15:10:53 -- common/autotest_common.sh@1254 -- # local i=0 00:15:53.639 15:10:53 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:53.639 15:10:53 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:53.639 15:10:53 -- common/autotest_common.sh@1265 -- # return 0 00:15:53.639 15:10:53 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:53.639 15:10:53 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:53.639 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.897 Malloc3 00:15:53.897 15:10:53 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:54.155 15:10:54 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:54.155 Asynchronous Event Request test 00:15:54.155 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:54.155 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:54.155 Registering asynchronous event callbacks... 00:15:54.155 Starting namespace attribute notice tests for all controllers... 00:15:54.155 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:54.155 aer_cb - Changed Namespace 00:15:54.155 Cleaning up... 00:15:54.414 [ 00:15:54.414 { 00:15:54.414 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:54.414 "subtype": "Discovery", 00:15:54.414 "listen_addresses": [], 00:15:54.414 "allow_any_host": true, 00:15:54.414 "hosts": [] 00:15:54.414 }, 00:15:54.414 { 00:15:54.414 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:54.414 "subtype": "NVMe", 00:15:54.414 "listen_addresses": [ 00:15:54.414 { 00:15:54.414 "transport": "VFIOUSER", 00:15:54.414 "trtype": "VFIOUSER", 00:15:54.414 "adrfam": "IPv4", 00:15:54.414 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:54.414 "trsvcid": "0" 00:15:54.414 } 00:15:54.414 ], 00:15:54.414 "allow_any_host": true, 00:15:54.414 "hosts": [], 00:15:54.414 "serial_number": "SPDK1", 00:15:54.414 "model_number": "SPDK bdev Controller", 00:15:54.414 "max_namespaces": 32, 00:15:54.414 "min_cntlid": 1, 00:15:54.414 "max_cntlid": 65519, 00:15:54.414 "namespaces": [ 00:15:54.414 { 00:15:54.414 "nsid": 1, 00:15:54.414 "bdev_name": "Malloc1", 00:15:54.414 "name": "Malloc1", 00:15:54.414 "nguid": "9D152877EC2F45A2933DAE326F21CDF2", 00:15:54.414 "uuid": "9d152877-ec2f-45a2-933d-ae326f21cdf2" 00:15:54.414 }, 00:15:54.414 { 00:15:54.414 "nsid": 2, 00:15:54.414 "bdev_name": "Malloc3", 00:15:54.414 "name": "Malloc3", 00:15:54.414 "nguid": "777CED97D1F04970B29CF47546490C34", 00:15:54.414 "uuid": "777ced97-d1f0-4970-b29c-f47546490c34" 00:15:54.414 } 00:15:54.414 ] 00:15:54.414 }, 00:15:54.414 { 00:15:54.414 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:54.414 "subtype": "NVMe", 00:15:54.414 "listen_addresses": [ 00:15:54.414 { 00:15:54.414 "transport": "VFIOUSER", 00:15:54.414 "trtype": "VFIOUSER", 00:15:54.414 "adrfam": "IPv4", 00:15:54.414 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:54.414 "trsvcid": "0" 00:15:54.414 } 00:15:54.414 ], 00:15:54.414 "allow_any_host": true, 00:15:54.414 "hosts": [], 00:15:54.414 "serial_number": "SPDK2", 00:15:54.414 "model_number": "SPDK bdev Controller", 00:15:54.414 "max_namespaces": 32, 00:15:54.414 "min_cntlid": 1, 00:15:54.414 "max_cntlid": 65519, 00:15:54.414 "namespaces": [ 00:15:54.414 { 00:15:54.414 "nsid": 1, 00:15:54.414 "bdev_name": "Malloc2", 00:15:54.414 "name": "Malloc2", 00:15:54.414 "nguid": "3A47B2975C24456EADB4F2F20140C517", 00:15:54.414 "uuid": "3a47b297-5c24-456e-adb4-f2f20140c517" 00:15:54.414 } 00:15:54.414 ] 00:15:54.414 } 00:15:54.414 ] 00:15:54.414 15:10:54 -- target/nvmf_vfio_user.sh@44 -- # wait 685378 00:15:54.414 15:10:54 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:54.414 15:10:54 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:54.414 15:10:54 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:54.414 15:10:54 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:54.414 [2024-11-28 15:10:54.538455] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:15:54.414 [2024-11-28 15:10:54.538497] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid685508 ] 00:15:54.414 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.414 [2024-11-28 15:10:54.571163] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:54.414 [2024-11-28 15:10:54.576493] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.414 [2024-11-28 15:10:54.576523] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f2245c9a000 00:15:54.414 [2024-11-28 15:10:54.577490] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.578495] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.579508] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.580510] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.581514] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.582520] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.583533] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.584535] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:54.414 [2024-11-28 15:10:54.585549] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:54.414 [2024-11-28 15:10:54.585572] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f2244994000 00:15:54.414 [2024-11-28 15:10:54.586705] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.414 [2024-11-28 15:10:54.601419] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:54.414 [2024-11-28 15:10:54.601458] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:54.415 [2024-11-28 15:10:54.603564] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:54.415 [2024-11-28 15:10:54.603620] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:54.415 [2024-11-28 15:10:54.603713] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:54.415 [2024-11-28 15:10:54.603740] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:54.415 [2024-11-28 15:10:54.603751] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:54.415 [2024-11-28 15:10:54.604572] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:54.415 [2024-11-28 15:10:54.604594] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:54.415 [2024-11-28 15:10:54.604606] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:54.415 [2024-11-28 15:10:54.605575] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:54.415 [2024-11-28 15:10:54.605602] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:54.415 [2024-11-28 15:10:54.605618] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:54.415 [2024-11-28 15:10:54.606583] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:54.415 [2024-11-28 15:10:54.606602] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:54.415 [2024-11-28 15:10:54.607588] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:54.415 [2024-11-28 15:10:54.607608] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:54.415 [2024-11-28 15:10:54.607618] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:54.415 [2024-11-28 15:10:54.607628] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:54.415 [2024-11-28 15:10:54.607738] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:54.415 [2024-11-28 15:10:54.607745] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:54.415 [2024-11-28 15:10:54.607754] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:54.415 [2024-11-28 15:10:54.608600] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:54.415 [2024-11-28 15:10:54.609599] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:54.415 [2024-11-28 15:10:54.610608] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:54.415 [2024-11-28 15:10:54.611641] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:54.415 [2024-11-28 15:10:54.612616] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:54.415 [2024-11-28 15:10:54.612635] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:54.415 [2024-11-28 15:10:54.612644] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.612667] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:54.415 [2024-11-28 15:10:54.612680] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.612702] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.415 [2024-11-28 15:10:54.612712] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.415 [2024-11-28 15:10:54.612732] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.415 [2024-11-28 15:10:54.619122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:54.415 [2024-11-28 15:10:54.619148] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:54.415 [2024-11-28 15:10:54.619162] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:54.415 [2024-11-28 15:10:54.619169] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:54.415 [2024-11-28 15:10:54.619177] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:54.415 [2024-11-28 15:10:54.619186] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:54.415 [2024-11-28 15:10:54.619195] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:54.415 [2024-11-28 15:10:54.619202] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.619220] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.619238] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:54.415 [2024-11-28 15:10:54.627119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:54.415 [2024-11-28 15:10:54.627149] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.415 [2024-11-28 15:10:54.627163] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.415 [2024-11-28 15:10:54.627175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.415 [2024-11-28 15:10:54.627187] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:54.415 [2024-11-28 15:10:54.627195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.627211] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.627226] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:54.415 [2024-11-28 15:10:54.635105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:54.415 [2024-11-28 15:10:54.635140] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:54.415 [2024-11-28 15:10:54.635150] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.635162] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.635176] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.635192] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.415 [2024-11-28 15:10:54.643105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:54.415 [2024-11-28 15:10:54.643178] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.643194] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:54.415 [2024-11-28 15:10:54.643212] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:54.415 [2024-11-28 15:10:54.643222] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:54.415 [2024-11-28 15:10:54.643232] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:54.674 [2024-11-28 15:10:54.651104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:54.674 [2024-11-28 15:10:54.651134] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:54.674 [2024-11-28 15:10:54.651154] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:54.674 [2024-11-28 15:10:54.651170] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.651183] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.675 [2024-11-28 15:10:54.651191] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.675 [2024-11-28 15:10:54.651201] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.659105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.659135] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.659151] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.659164] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:54.675 [2024-11-28 15:10:54.659172] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.675 [2024-11-28 15:10:54.659182] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.671119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.671142] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.671155] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.671171] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.671182] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.671191] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.671200] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:54.675 [2024-11-28 15:10:54.671208] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:54.675 [2024-11-28 15:10:54.671216] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:54.675 [2024-11-28 15:10:54.671245] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.679111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.679137] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.687107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.687139] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.695119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.695144] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.703118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.703144] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:54.675 [2024-11-28 15:10:54.703154] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:54.675 [2024-11-28 15:10:54.703160] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:54.675 [2024-11-28 15:10:54.703166] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:54.675 [2024-11-28 15:10:54.703176] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:54.675 [2024-11-28 15:10:54.703187] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:54.675 [2024-11-28 15:10:54.703195] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:54.675 [2024-11-28 15:10:54.703204] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.703215] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:54.675 [2024-11-28 15:10:54.703223] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:54.675 [2024-11-28 15:10:54.703231] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.703243] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:54.675 [2024-11-28 15:10:54.703251] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:54.675 [2024-11-28 15:10:54.703260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:54.675 [2024-11-28 15:10:54.711105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.711134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.711150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:54.675 [2024-11-28 15:10:54.711162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:54.675 ===================================================== 00:15:54.675 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:54.675 ===================================================== 00:15:54.675 Controller Capabilities/Features 00:15:54.675 ================================ 00:15:54.675 Vendor ID: 4e58 00:15:54.675 Subsystem Vendor ID: 4e58 00:15:54.675 Serial Number: SPDK2 00:15:54.675 Model Number: SPDK bdev Controller 00:15:54.675 Firmware Version: 24.01.1 00:15:54.675 Recommended Arb Burst: 6 00:15:54.675 IEEE OUI Identifier: 8d 6b 50 00:15:54.675 Multi-path I/O 00:15:54.675 May have multiple subsystem ports: Yes 00:15:54.675 May have multiple controllers: Yes 00:15:54.675 Associated with SR-IOV VF: No 00:15:54.675 Max Data Transfer Size: 131072 00:15:54.675 Max Number of Namespaces: 32 00:15:54.675 Max Number of I/O Queues: 127 00:15:54.675 NVMe Specification Version (VS): 1.3 00:15:54.675 NVMe Specification Version (Identify): 1.3 00:15:54.675 Maximum Queue Entries: 256 00:15:54.675 Contiguous Queues Required: Yes 00:15:54.675 Arbitration Mechanisms Supported 00:15:54.675 Weighted Round Robin: Not Supported 00:15:54.675 Vendor Specific: Not Supported 00:15:54.675 Reset Timeout: 15000 ms 00:15:54.675 Doorbell Stride: 4 bytes 00:15:54.675 NVM Subsystem Reset: Not Supported 00:15:54.675 Command Sets Supported 00:15:54.675 NVM Command Set: Supported 00:15:54.675 Boot Partition: Not Supported 00:15:54.675 Memory Page Size Minimum: 4096 bytes 00:15:54.675 Memory Page Size Maximum: 4096 bytes 00:15:54.675 Persistent Memory Region: Not Supported 00:15:54.675 Optional Asynchronous Events Supported 00:15:54.675 Namespace Attribute Notices: Supported 00:15:54.675 Firmware Activation Notices: Not Supported 00:15:54.675 ANA Change Notices: Not Supported 00:15:54.675 PLE Aggregate Log Change Notices: Not Supported 00:15:54.675 LBA Status Info Alert Notices: Not Supported 00:15:54.675 EGE Aggregate Log Change Notices: Not Supported 00:15:54.675 Normal NVM Subsystem Shutdown event: Not Supported 00:15:54.675 Zone Descriptor Change Notices: Not Supported 00:15:54.675 Discovery Log Change Notices: Not Supported 00:15:54.675 Controller Attributes 00:15:54.675 128-bit Host Identifier: Supported 00:15:54.675 Non-Operational Permissive Mode: Not Supported 00:15:54.675 NVM Sets: Not Supported 00:15:54.675 Read Recovery Levels: Not Supported 00:15:54.675 Endurance Groups: Not Supported 00:15:54.675 Predictable Latency Mode: Not Supported 00:15:54.675 Traffic Based Keep ALive: Not Supported 00:15:54.675 Namespace Granularity: Not Supported 00:15:54.675 SQ Associations: Not Supported 00:15:54.675 UUID List: Not Supported 00:15:54.675 Multi-Domain Subsystem: Not Supported 00:15:54.675 Fixed Capacity Management: Not Supported 00:15:54.675 Variable Capacity Management: Not Supported 00:15:54.675 Delete Endurance Group: Not Supported 00:15:54.675 Delete NVM Set: Not Supported 00:15:54.675 Extended LBA Formats Supported: Not Supported 00:15:54.675 Flexible Data Placement Supported: Not Supported 00:15:54.675 00:15:54.675 Controller Memory Buffer Support 00:15:54.675 ================================ 00:15:54.675 Supported: No 00:15:54.675 00:15:54.675 Persistent Memory Region Support 00:15:54.675 ================================ 00:15:54.675 Supported: No 00:15:54.675 00:15:54.675 Admin Command Set Attributes 00:15:54.675 ============================ 00:15:54.675 Security Send/Receive: Not Supported 00:15:54.675 Format NVM: Not Supported 00:15:54.675 Firmware Activate/Download: Not Supported 00:15:54.675 Namespace Management: Not Supported 00:15:54.675 Device Self-Test: Not Supported 00:15:54.675 Directives: Not Supported 00:15:54.675 NVMe-MI: Not Supported 00:15:54.675 Virtualization Management: Not Supported 00:15:54.675 Doorbell Buffer Config: Not Supported 00:15:54.675 Get LBA Status Capability: Not Supported 00:15:54.675 Command & Feature Lockdown Capability: Not Supported 00:15:54.675 Abort Command Limit: 4 00:15:54.675 Async Event Request Limit: 4 00:15:54.675 Number of Firmware Slots: N/A 00:15:54.675 Firmware Slot 1 Read-Only: N/A 00:15:54.676 Firmware Activation Without Reset: N/A 00:15:54.676 Multiple Update Detection Support: N/A 00:15:54.676 Firmware Update Granularity: No Information Provided 00:15:54.676 Per-Namespace SMART Log: No 00:15:54.676 Asymmetric Namespace Access Log Page: Not Supported 00:15:54.676 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:54.676 Command Effects Log Page: Supported 00:15:54.676 Get Log Page Extended Data: Supported 00:15:54.676 Telemetry Log Pages: Not Supported 00:15:54.676 Persistent Event Log Pages: Not Supported 00:15:54.676 Supported Log Pages Log Page: May Support 00:15:54.676 Commands Supported & Effects Log Page: Not Supported 00:15:54.676 Feature Identifiers & Effects Log Page:May Support 00:15:54.676 NVMe-MI Commands & Effects Log Page: May Support 00:15:54.676 Data Area 4 for Telemetry Log: Not Supported 00:15:54.676 Error Log Page Entries Supported: 128 00:15:54.676 Keep Alive: Supported 00:15:54.676 Keep Alive Granularity: 10000 ms 00:15:54.676 00:15:54.676 NVM Command Set Attributes 00:15:54.676 ========================== 00:15:54.676 Submission Queue Entry Size 00:15:54.676 Max: 64 00:15:54.676 Min: 64 00:15:54.676 Completion Queue Entry Size 00:15:54.676 Max: 16 00:15:54.676 Min: 16 00:15:54.676 Number of Namespaces: 32 00:15:54.676 Compare Command: Supported 00:15:54.676 Write Uncorrectable Command: Not Supported 00:15:54.676 Dataset Management Command: Supported 00:15:54.676 Write Zeroes Command: Supported 00:15:54.676 Set Features Save Field: Not Supported 00:15:54.676 Reservations: Not Supported 00:15:54.676 Timestamp: Not Supported 00:15:54.676 Copy: Supported 00:15:54.676 Volatile Write Cache: Present 00:15:54.676 Atomic Write Unit (Normal): 1 00:15:54.676 Atomic Write Unit (PFail): 1 00:15:54.676 Atomic Compare & Write Unit: 1 00:15:54.676 Fused Compare & Write: Supported 00:15:54.676 Scatter-Gather List 00:15:54.676 SGL Command Set: Supported (Dword aligned) 00:15:54.676 SGL Keyed: Not Supported 00:15:54.676 SGL Bit Bucket Descriptor: Not Supported 00:15:54.676 SGL Metadata Pointer: Not Supported 00:15:54.676 Oversized SGL: Not Supported 00:15:54.676 SGL Metadata Address: Not Supported 00:15:54.676 SGL Offset: Not Supported 00:15:54.676 Transport SGL Data Block: Not Supported 00:15:54.676 Replay Protected Memory Block: Not Supported 00:15:54.676 00:15:54.676 Firmware Slot Information 00:15:54.676 ========================= 00:15:54.676 Active slot: 1 00:15:54.676 Slot 1 Firmware Revision: 24.01.1 00:15:54.676 00:15:54.676 00:15:54.676 Commands Supported and Effects 00:15:54.676 ============================== 00:15:54.676 Admin Commands 00:15:54.676 -------------- 00:15:54.676 Get Log Page (02h): Supported 00:15:54.676 Identify (06h): Supported 00:15:54.676 Abort (08h): Supported 00:15:54.676 Set Features (09h): Supported 00:15:54.676 Get Features (0Ah): Supported 00:15:54.676 Asynchronous Event Request (0Ch): Supported 00:15:54.676 Keep Alive (18h): Supported 00:15:54.676 I/O Commands 00:15:54.676 ------------ 00:15:54.676 Flush (00h): Supported LBA-Change 00:15:54.676 Write (01h): Supported LBA-Change 00:15:54.676 Read (02h): Supported 00:15:54.676 Compare (05h): Supported 00:15:54.676 Write Zeroes (08h): Supported LBA-Change 00:15:54.676 Dataset Management (09h): Supported LBA-Change 00:15:54.676 Copy (19h): Supported LBA-Change 00:15:54.676 Unknown (79h): Supported LBA-Change 00:15:54.676 Unknown (7Ah): Supported 00:15:54.676 00:15:54.676 Error Log 00:15:54.676 ========= 00:15:54.676 00:15:54.676 Arbitration 00:15:54.676 =========== 00:15:54.676 Arbitration Burst: 1 00:15:54.676 00:15:54.676 Power Management 00:15:54.676 ================ 00:15:54.676 Number of Power States: 1 00:15:54.676 Current Power State: Power State #0 00:15:54.676 Power State #0: 00:15:54.676 Max Power: 0.00 W 00:15:54.676 Non-Operational State: Operational 00:15:54.676 Entry Latency: Not Reported 00:15:54.676 Exit Latency: Not Reported 00:15:54.676 Relative Read Throughput: 0 00:15:54.676 Relative Read Latency: 0 00:15:54.676 Relative Write Throughput: 0 00:15:54.676 Relative Write Latency: 0 00:15:54.676 Idle Power: Not Reported 00:15:54.676 Active Power: Not Reported 00:15:54.676 Non-Operational Permissive Mode: Not Supported 00:15:54.676 00:15:54.676 Health Information 00:15:54.676 ================== 00:15:54.676 Critical Warnings: 00:15:54.676 Available Spare Space: OK 00:15:54.676 Temperature: OK 00:15:54.676 Device Reliability: OK 00:15:54.676 Read Only: No 00:15:54.676 Volatile Memory Backup: OK 00:15:54.676 Current Temperature: 0 Kelvin[2024-11-28 15:10:54.711279] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:54.676 [2024-11-28 15:10:54.719120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:54.676 [2024-11-28 15:10:54.719168] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:54.676 [2024-11-28 15:10:54.719187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.676 [2024-11-28 15:10:54.719198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.676 [2024-11-28 15:10:54.719207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.676 [2024-11-28 15:10:54.719217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:54.676 [2024-11-28 15:10:54.719279] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:54.676 [2024-11-28 15:10:54.719300] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:54.676 [2024-11-28 15:10:54.720326] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:54.676 [2024-11-28 15:10:54.720343] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:54.676 [2024-11-28 15:10:54.721292] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:54.676 [2024-11-28 15:10:54.721315] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:54.676 [2024-11-28 15:10:54.721367] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:54.676 [2024-11-28 15:10:54.722552] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:54.676 (-273 Celsius) 00:15:54.676 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:54.676 Available Spare: 0% 00:15:54.676 Available Spare Threshold: 0% 00:15:54.676 Life Percentage Used: 0% 00:15:54.676 Data Units Read: 0 00:15:54.676 Data Units Written: 0 00:15:54.676 Host Read Commands: 0 00:15:54.676 Host Write Commands: 0 00:15:54.676 Controller Busy Time: 0 minutes 00:15:54.676 Power Cycles: 0 00:15:54.676 Power On Hours: 0 hours 00:15:54.676 Unsafe Shutdowns: 0 00:15:54.676 Unrecoverable Media Errors: 0 00:15:54.676 Lifetime Error Log Entries: 0 00:15:54.676 Warning Temperature Time: 0 minutes 00:15:54.676 Critical Temperature Time: 0 minutes 00:15:54.676 00:15:54.676 Number of Queues 00:15:54.676 ================ 00:15:54.676 Number of I/O Submission Queues: 127 00:15:54.676 Number of I/O Completion Queues: 127 00:15:54.676 00:15:54.676 Active Namespaces 00:15:54.676 ================= 00:15:54.676 Namespace ID:1 00:15:54.676 Error Recovery Timeout: Unlimited 00:15:54.676 Command Set Identifier: NVM (00h) 00:15:54.676 Deallocate: Supported 00:15:54.676 Deallocated/Unwritten Error: Not Supported 00:15:54.676 Deallocated Read Value: Unknown 00:15:54.676 Deallocate in Write Zeroes: Not Supported 00:15:54.676 Deallocated Guard Field: 0xFFFF 00:15:54.676 Flush: Supported 00:15:54.676 Reservation: Supported 00:15:54.676 Namespace Sharing Capabilities: Multiple Controllers 00:15:54.676 Size (in LBAs): 131072 (0GiB) 00:15:54.676 Capacity (in LBAs): 131072 (0GiB) 00:15:54.676 Utilization (in LBAs): 131072 (0GiB) 00:15:54.676 NGUID: 3A47B2975C24456EADB4F2F20140C517 00:15:54.676 UUID: 3a47b297-5c24-456e-adb4-f2f20140c517 00:15:54.676 Thin Provisioning: Not Supported 00:15:54.676 Per-NS Atomic Units: Yes 00:15:54.676 Atomic Boundary Size (Normal): 0 00:15:54.676 Atomic Boundary Size (PFail): 0 00:15:54.676 Atomic Boundary Offset: 0 00:15:54.676 Maximum Single Source Range Length: 65535 00:15:54.676 Maximum Copy Length: 65535 00:15:54.676 Maximum Source Range Count: 1 00:15:54.676 NGUID/EUI64 Never Reused: No 00:15:54.676 Namespace Write Protected: No 00:15:54.676 Number of LBA Formats: 1 00:15:54.676 Current LBA Format: LBA Format #00 00:15:54.676 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:54.676 00:15:54.676 15:10:54 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:54.677 EAL: No free 2048 kB hugepages reported on node 1 00:15:59.941 Initializing NVMe Controllers 00:15:59.941 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:59.941 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:59.941 Initialization complete. Launching workers. 00:15:59.941 ======================================================== 00:15:59.941 Latency(us) 00:15:59.941 Device Information : IOPS MiB/s Average min max 00:15:59.941 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 38664.34 151.03 3309.92 1138.95 7487.87 00:15:59.941 ======================================================== 00:15:59.941 Total : 38664.34 151.03 3309.92 1138.95 7487.87 00:15:59.941 00:15:59.942 15:11:00 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:59.942 EAL: No free 2048 kB hugepages reported on node 1 00:16:05.206 Initializing NVMe Controllers 00:16:05.206 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:05.206 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:05.206 Initialization complete. Launching workers. 00:16:05.206 ======================================================== 00:16:05.206 Latency(us) 00:16:05.206 Device Information : IOPS MiB/s Average min max 00:16:05.206 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36898.47 144.13 3468.31 1135.42 8493.68 00:16:05.206 ======================================================== 00:16:05.206 Total : 36898.47 144.13 3468.31 1135.42 8493.68 00:16:05.206 00:16:05.206 15:11:05 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:05.206 EAL: No free 2048 kB hugepages reported on node 1 00:16:10.470 Initializing NVMe Controllers 00:16:10.470 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:10.470 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:10.470 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:10.470 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:10.470 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:10.470 Initialization complete. Launching workers. 00:16:10.470 Starting thread on core 2 00:16:10.470 Starting thread on core 3 00:16:10.470 Starting thread on core 1 00:16:10.470 15:11:10 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:10.728 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.014 Initializing NVMe Controllers 00:16:14.014 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.014 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.014 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:14.014 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:14.014 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:14.014 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:14.014 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:14.014 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:14.014 Initialization complete. Launching workers. 00:16:14.014 Starting thread on core 1 with urgent priority queue 00:16:14.014 Starting thread on core 2 with urgent priority queue 00:16:14.014 Starting thread on core 3 with urgent priority queue 00:16:14.014 Starting thread on core 0 with urgent priority queue 00:16:14.014 SPDK bdev Controller (SPDK2 ) core 0: 5640.00 IO/s 17.73 secs/100000 ios 00:16:14.014 SPDK bdev Controller (SPDK2 ) core 1: 5574.33 IO/s 17.94 secs/100000 ios 00:16:14.014 SPDK bdev Controller (SPDK2 ) core 2: 5900.67 IO/s 16.95 secs/100000 ios 00:16:14.014 SPDK bdev Controller (SPDK2 ) core 3: 5214.33 IO/s 19.18 secs/100000 ios 00:16:14.014 ======================================================== 00:16:14.014 00:16:14.014 15:11:14 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:14.014 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.272 Initializing NVMe Controllers 00:16:14.272 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.272 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:14.272 Namespace ID: 1 size: 0GB 00:16:14.272 Initialization complete. 00:16:14.272 INFO: using host memory buffer for IO 00:16:14.272 Hello world! 00:16:14.272 15:11:14 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:14.272 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.644 Initializing NVMe Controllers 00:16:15.644 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.644 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:15.644 Initialization complete. Launching workers. 00:16:15.644 submit (in ns) avg, min, max = 8276.2, 3467.8, 4016093.3 00:16:15.644 complete (in ns) avg, min, max = 24994.4, 2043.3, 4020457.8 00:16:15.644 00:16:15.644 Submit histogram 00:16:15.644 ================ 00:16:15.644 Range in us Cumulative Count 00:16:15.644 3.461 - 3.484: 0.2997% ( 41) 00:16:15.644 3.484 - 3.508: 1.2134% ( 125) 00:16:15.644 3.508 - 3.532: 4.3126% ( 424) 00:16:15.644 3.532 - 3.556: 9.2610% ( 677) 00:16:15.644 3.556 - 3.579: 19.2384% ( 1365) 00:16:15.644 3.579 - 3.603: 29.8443% ( 1451) 00:16:15.644 3.603 - 3.627: 38.2940% ( 1156) 00:16:15.644 3.627 - 3.650: 44.6093% ( 864) 00:16:15.644 3.650 - 3.674: 50.5299% ( 810) 00:16:15.644 3.674 - 3.698: 56.3555% ( 797) 00:16:15.644 3.698 - 3.721: 60.9531% ( 629) 00:16:15.644 3.721 - 3.745: 64.1620% ( 439) 00:16:15.644 3.745 - 3.769: 66.6326% ( 338) 00:16:15.644 3.769 - 3.793: 70.1922% ( 487) 00:16:15.644 3.793 - 3.816: 74.3878% ( 574) 00:16:15.644 3.816 - 3.840: 78.9489% ( 624) 00:16:15.644 3.840 - 3.864: 82.4428% ( 478) 00:16:15.644 3.864 - 3.887: 85.0523% ( 357) 00:16:15.644 3.887 - 3.911: 87.2963% ( 307) 00:16:15.644 3.911 - 3.935: 89.4525% ( 295) 00:16:15.644 3.935 - 3.959: 90.9875% ( 210) 00:16:15.644 3.959 - 3.982: 91.8866% ( 123) 00:16:15.644 3.982 - 4.006: 93.0414% ( 158) 00:16:15.644 4.006 - 4.030: 93.9551% ( 125) 00:16:15.644 4.030 - 4.053: 94.7957% ( 115) 00:16:15.644 4.053 - 4.077: 95.4609% ( 91) 00:16:15.644 4.077 - 4.101: 95.9214% ( 63) 00:16:15.644 4.101 - 4.124: 96.3307% ( 56) 00:16:15.644 4.124 - 4.148: 96.5719% ( 33) 00:16:15.644 4.148 - 4.172: 96.7839% ( 29) 00:16:15.644 4.172 - 4.196: 96.8935% ( 15) 00:16:15.644 4.196 - 4.219: 96.9885% ( 13) 00:16:15.644 4.219 - 4.243: 97.1420% ( 21) 00:16:15.644 4.243 - 4.267: 97.2224% ( 11) 00:16:15.644 4.267 - 4.290: 97.3174% ( 13) 00:16:15.644 4.290 - 4.314: 97.3613% ( 6) 00:16:15.644 4.314 - 4.338: 97.4198% ( 8) 00:16:15.644 4.338 - 4.361: 97.4709% ( 7) 00:16:15.644 4.361 - 4.385: 97.4856% ( 2) 00:16:15.644 4.385 - 4.409: 97.5075% ( 3) 00:16:15.644 4.409 - 4.433: 97.5148% ( 1) 00:16:15.644 4.433 - 4.456: 97.5221% ( 1) 00:16:15.644 4.504 - 4.527: 97.5294% ( 1) 00:16:15.644 4.527 - 4.551: 97.5367% ( 1) 00:16:15.644 4.575 - 4.599: 97.5513% ( 2) 00:16:15.644 4.670 - 4.693: 97.5587% ( 1) 00:16:15.644 4.717 - 4.741: 97.5660% ( 1) 00:16:15.644 4.741 - 4.764: 97.5806% ( 2) 00:16:15.644 4.764 - 4.788: 97.6391% ( 8) 00:16:15.644 4.788 - 4.812: 97.7048% ( 9) 00:16:15.644 4.812 - 4.836: 97.7487% ( 6) 00:16:15.644 4.836 - 4.859: 97.7999% ( 7) 00:16:15.644 4.859 - 4.883: 97.8437% ( 6) 00:16:15.644 4.883 - 4.907: 97.8657% ( 3) 00:16:15.644 4.907 - 4.930: 97.9461% ( 11) 00:16:15.644 4.930 - 4.954: 97.9826% ( 5) 00:16:15.644 4.954 - 4.978: 98.0192% ( 5) 00:16:15.644 4.978 - 5.001: 98.0484% ( 4) 00:16:15.644 5.001 - 5.025: 98.0776% ( 4) 00:16:15.644 5.049 - 5.073: 98.0922% ( 2) 00:16:15.644 5.073 - 5.096: 98.1142% ( 3) 00:16:15.644 5.096 - 5.120: 98.1361% ( 3) 00:16:15.644 5.120 - 5.144: 98.1726% ( 5) 00:16:15.644 5.144 - 5.167: 98.1946% ( 3) 00:16:15.644 5.167 - 5.191: 98.2384% ( 6) 00:16:15.644 5.191 - 5.215: 98.2457% ( 1) 00:16:15.644 5.215 - 5.239: 98.2531% ( 1) 00:16:15.644 5.239 - 5.262: 98.2604% ( 1) 00:16:15.644 5.262 - 5.286: 98.2896% ( 4) 00:16:15.644 5.310 - 5.333: 98.3042% ( 2) 00:16:15.644 5.333 - 5.357: 98.3188% ( 2) 00:16:15.644 5.476 - 5.499: 98.3261% ( 1) 00:16:15.644 5.523 - 5.547: 98.3335% ( 1) 00:16:15.644 5.570 - 5.594: 98.3408% ( 1) 00:16:15.644 5.618 - 5.641: 98.3481% ( 1) 00:16:15.644 5.760 - 5.784: 98.3554% ( 1) 00:16:15.644 5.807 - 5.831: 98.3627% ( 1) 00:16:15.644 5.855 - 5.879: 98.3700% ( 1) 00:16:15.644 5.879 - 5.902: 98.3773% ( 1) 00:16:15.644 5.902 - 5.926: 98.3846% ( 1) 00:16:15.644 5.926 - 5.950: 98.3919% ( 1) 00:16:15.644 5.973 - 5.997: 98.3992% ( 1) 00:16:15.644 5.997 - 6.021: 98.4065% ( 1) 00:16:15.644 6.447 - 6.495: 98.4212% ( 2) 00:16:15.644 6.542 - 6.590: 98.4285% ( 1) 00:16:15.644 6.732 - 6.779: 98.4358% ( 1) 00:16:15.644 6.779 - 6.827: 98.4431% ( 1) 00:16:15.644 6.827 - 6.874: 98.4504% ( 1) 00:16:15.644 6.921 - 6.969: 98.4577% ( 1) 00:16:15.644 6.969 - 7.016: 98.4650% ( 1) 00:16:15.644 7.016 - 7.064: 98.4723% ( 1) 00:16:15.644 7.064 - 7.111: 98.5089% ( 5) 00:16:15.644 7.206 - 7.253: 98.5162% ( 1) 00:16:15.644 7.301 - 7.348: 98.5308% ( 2) 00:16:15.644 7.348 - 7.396: 98.5381% ( 1) 00:16:15.644 7.396 - 7.443: 98.5454% ( 1) 00:16:15.644 7.538 - 7.585: 98.5527% ( 1) 00:16:15.644 7.680 - 7.727: 98.5600% ( 1) 00:16:15.644 7.775 - 7.822: 98.5747% ( 2) 00:16:15.644 7.822 - 7.870: 98.5893% ( 2) 00:16:15.644 7.870 - 7.917: 98.5966% ( 1) 00:16:15.644 7.964 - 8.012: 98.6185% ( 3) 00:16:15.644 8.012 - 8.059: 98.6258% ( 1) 00:16:15.644 8.201 - 8.249: 98.6331% ( 1) 00:16:15.644 8.249 - 8.296: 98.6405% ( 1) 00:16:15.644 8.296 - 8.344: 98.6478% ( 1) 00:16:15.644 8.439 - 8.486: 98.6624% ( 2) 00:16:15.644 8.676 - 8.723: 98.6697% ( 1) 00:16:15.644 9.150 - 9.197: 98.6770% ( 1) 00:16:15.644 9.292 - 9.339: 98.6916% ( 2) 00:16:15.644 9.339 - 9.387: 98.6989% ( 1) 00:16:15.644 9.813 - 9.861: 98.7135% ( 2) 00:16:15.644 10.145 - 10.193: 98.7209% ( 1) 00:16:15.644 10.287 - 10.335: 98.7355% ( 2) 00:16:15.644 10.335 - 10.382: 98.7428% ( 1) 00:16:15.644 10.382 - 10.430: 98.7501% ( 1) 00:16:15.644 10.430 - 10.477: 98.7574% ( 1) 00:16:15.644 10.667 - 10.714: 98.7647% ( 1) 00:16:15.644 10.904 - 10.951: 98.7720% ( 1) 00:16:15.644 10.951 - 10.999: 98.7793% ( 1) 00:16:15.644 10.999 - 11.046: 98.7866% ( 1) 00:16:15.644 11.236 - 11.283: 98.7939% ( 1) 00:16:15.644 11.330 - 11.378: 98.8013% ( 1) 00:16:15.644 11.804 - 11.852: 98.8159% ( 2) 00:16:15.644 12.231 - 12.326: 98.8232% ( 1) 00:16:15.644 12.610 - 12.705: 98.8378% ( 2) 00:16:15.644 12.705 - 12.800: 98.8524% ( 2) 00:16:15.644 12.800 - 12.895: 98.8597% ( 1) 00:16:15.644 12.990 - 13.084: 98.8744% ( 2) 00:16:15.644 13.179 - 13.274: 98.8817% ( 1) 00:16:15.644 13.464 - 13.559: 98.8890% ( 1) 00:16:15.644 13.559 - 13.653: 98.8963% ( 1) 00:16:15.644 14.033 - 14.127: 98.9109% ( 2) 00:16:15.644 14.601 - 14.696: 98.9182% ( 1) 00:16:15.644 14.791 - 14.886: 98.9328% ( 2) 00:16:15.644 14.981 - 15.076: 98.9401% ( 1) 00:16:15.644 15.360 - 15.455: 98.9474% ( 1) 00:16:15.644 17.067 - 17.161: 98.9548% ( 1) 00:16:15.644 17.256 - 17.351: 98.9694% ( 2) 00:16:15.644 17.351 - 17.446: 99.0132% ( 6) 00:16:15.644 17.446 - 17.541: 99.0498% ( 5) 00:16:15.644 17.541 - 17.636: 99.0936% ( 6) 00:16:15.644 17.636 - 17.730: 99.1302% ( 5) 00:16:15.644 17.730 - 17.825: 99.2106% ( 11) 00:16:15.644 17.825 - 17.920: 99.2691% ( 8) 00:16:15.644 17.920 - 18.015: 99.3129% ( 6) 00:16:15.644 18.015 - 18.110: 99.3933% ( 11) 00:16:15.644 18.110 - 18.204: 99.4664% ( 10) 00:16:15.644 18.204 - 18.299: 99.5468% ( 11) 00:16:15.644 18.299 - 18.394: 99.6272% ( 11) 00:16:15.644 18.394 - 18.489: 99.7003% ( 10) 00:16:15.644 18.489 - 18.584: 99.7734% ( 10) 00:16:15.644 18.584 - 18.679: 99.8026% ( 4) 00:16:15.644 18.679 - 18.773: 99.8173% ( 2) 00:16:15.644 18.963 - 19.058: 99.8246% ( 1) 00:16:15.644 19.153 - 19.247: 99.8319% ( 1) 00:16:15.644 19.437 - 19.532: 99.8392% ( 1) 00:16:15.644 19.721 - 19.816: 99.8538% ( 2) 00:16:15.644 20.101 - 20.196: 99.8611% ( 1) 00:16:15.644 20.670 - 20.764: 99.8684% ( 1) 00:16:15.644 21.997 - 22.092: 99.8757% ( 1) 00:16:15.644 24.841 - 25.031: 99.8830% ( 1) 00:16:15.644 27.307 - 27.496: 99.8904% ( 1) 00:16:15.644 3980.705 - 4004.978: 99.9781% ( 12) 00:16:15.644 4004.978 - 4029.250: 100.0000% ( 3) 00:16:15.644 00:16:15.644 Complete histogram 00:16:15.644 ================== 00:16:15.644 Range in us Cumulative Count 00:16:15.644 2.039 - 2.050: 0.7309% ( 100) 00:16:15.644 2.050 - 2.062: 13.2593% ( 1714) 00:16:15.644 2.062 - 2.074: 17.6376% ( 599) 00:16:15.644 2.074 - 2.086: 27.7465% ( 1383) 00:16:15.644 2.086 - 2.098: 58.6214% ( 4224) 00:16:15.644 2.098 - 2.110: 64.2497% ( 770) 00:16:15.644 2.110 - 2.121: 66.1136% ( 255) 00:16:15.644 2.121 - 2.133: 68.8254% ( 371) 00:16:15.644 2.133 - 2.145: 69.4467% ( 85) 00:16:15.644 2.145 - 2.157: 74.8410% ( 738) 00:16:15.644 2.157 - 2.169: 81.8288% ( 956) 00:16:15.644 2.169 - 2.181: 83.4880% ( 227) 00:16:15.644 2.181 - 2.193: 85.5566% ( 283) 00:16:15.644 2.193 - 2.204: 87.1281% ( 215) 00:16:15.644 2.204 - 2.216: 87.8518% ( 99) 00:16:15.644 2.216 - 2.228: 90.8998% ( 417) 00:16:15.644 2.228 - 2.240: 93.9844% ( 422) 00:16:15.644 2.240 - 2.252: 94.7592% ( 106) 00:16:15.644 2.252 - 2.264: 95.2854% ( 72) 00:16:15.644 2.264 - 2.276: 95.4535% ( 23) 00:16:15.644 2.276 - 2.287: 95.6655% ( 29) 00:16:15.644 2.287 - 2.299: 95.9287% ( 36) 00:16:15.644 2.299 - 2.311: 95.9725% ( 6) 00:16:15.644 2.311 - 2.323: 96.0456% ( 10) 00:16:15.644 2.323 - 2.335: 96.3818% ( 46) 00:16:15.644 2.335 - 2.347: 96.7766% ( 54) 00:16:15.644 2.347 - 2.359: 96.9812% ( 28) 00:16:15.645 2.359 - 2.370: 97.2663% ( 39) 00:16:15.645 2.370 - 2.382: 97.5221% ( 35) 00:16:15.645 2.382 - 2.394: 97.6610% ( 19) 00:16:15.645 2.394 - 2.406: 97.8364% ( 24) 00:16:15.645 2.406 - 2.418: 98.0338% ( 27) 00:16:15.645 2.418 - 2.430: 98.1507% ( 16) 00:16:15.645 2.430 - 2.441: 98.2750% ( 17) 00:16:15.645 2.441 - 2.453: 98.3627% ( 12) 00:16:15.645 2.453 - 2.465: 98.4285% ( 9) 00:16:15.645 2.465 - 2.477: 98.5381% ( 15) 00:16:15.645 2.477 - 2.489: 98.5820% ( 6) 00:16:15.645 2.489 - 2.501: 98.5893% ( 1) 00:16:15.645 2.501 - 2.513: 98.6039% ( 2) 00:16:15.645 2.513 - 2.524: 98.6185% ( 2) 00:16:15.645 2.524 - 2.536: 98.6258% ( 1) 00:16:15.645 2.548 - 2.560: 98.6405% ( 2) 00:16:15.645 2.596 - 2.607: 98.6478% ( 1) 00:16:15.645 2.607 - 2.619: 98.6551% ( 1) 00:16:15.645 3.200 - 3.224: 98.6624% ( 1) 00:16:15.645 3.247 - 3.271: 98.6697% ( 1) 00:16:15.645 3.366 - 3.390: 98.6770% ( 1) 00:16:15.645 3.390 - 3.413: 98.6843% ( 1) 00:16:15.645 3.413 - 3.437: 98.6989% ( 2) 00:16:15.645 3.508 - 3.532: 98.7062% ( 1) 00:16:15.645 3.532 - 3.556: 98.7282% ( 3) 00:16:15.645 3.556 - 3.579: 98.7574% ( 4) 00:16:15.645 3.603 - 3.627: 98.7647% ( 1) 00:16:15.645 3.627 - 3.650: 98.7793% ( 2) 00:16:15.645 3.650 - 3.674: 98.7866% ( 1) 00:16:15.645 3.674 - 3.698: 98.7939% ( 1) 00:16:15.645 3.698 - 3.721: 98.8086% ( 2) 00:16:15.645 3.745 - 3.769: 98.8232% ( 2) 00:16:15.645 3.769 - 3.793: 98.8305% ( 1) 00:16:15.645 3.864 - 3.887: 98.8378% ( 1) 00:16:15.645 3.887 - 3.911: 98.8451% ( 1) 00:16:15.645 3.982 - 4.006: 98.8524% ( 1) 00:16:15.645 4.077 - 4.101: 98.8597% ( 1) 00:16:15.645 4.172 - 4.196: 98.8670% ( 1) 00:16:15.645 5.001 - 5.025: 98.8744% ( 1) 00:16:15.645 5.025 - 5.049: 98.8817% ( 1) 00:16:15.645 5.096 - 5.120: 98.8890% ( 1) 00:16:15.645 5.310 - 5.333: 98.8963% ( 1) 00:16:15.645 5.452 - 5.476: 98.9036% ( 1) 00:16:15.645 5.476 - 5.499: 98.9109% ( 1) 00:16:15.645 5.689 - 5.713: 98.9182% ( 1) 00:16:15.645 5.713 - 5.736: 98.9255% ( 1) 00:16:15.645 5.855 - 5.879: 98.9328% ( 1) 00:16:15.645 6.116 - 6.163: 98.9548% ( 3) 00:16:15.645 6.163 - 6.210: 98.9621% ( 1) 00:16:15.645 6.400 - 6.447: 98.9694% ( 1) 00:16:15.645 6.447 - 6.495: 98.9840% ( 2) 00:16:15.645 6.590 - 6.637: 98.9986% ( 2) 00:16:15.645 6.684 - 6.732: 99.0132% ( 2) 00:16:15.645 6.921 - 6.969: 99.0205% ( 1) 00:16:15.645 6.969 - 7.016: 99.0278% ( 1) 00:16:15.645 7.253 - 7.301: 99.0352% ( 1) 00:16:15.645 7.301 - 7.348: 99.0425% ( 1) 00:16:15.645 7.870 - 7.917: 99.0498% ( 1) 00:16:15.645 8.107 - 8.154: 99.0571% ( 1) 00:16:15.645 15.550 - 15.644: 99.0717% ( 2) 00:16:15.645 15.644 - 15.739: 99.0936% ( 3) 00:16:15.645 15.739 - 15.834: 99.1083% ( 2) 00:16:15.645 16.024 - 16.119: 99.1156% ( 1) 00:16:15.645 16.119 - 16.213: 99.1302% ( 2) 00:16:15.645 16.213 - 16.308: 99.1375% ( 1) 00:16:15.645 16.308 - 16.403: 99.1667% ( 4) 00:16:15.645 16.403 - 16.498: 99.1813% ( 2) 00:16:15.645 16.498 - 16.593: 99.2179% ( 5) 00:16:15.645 16.593 - 16.687: 99.2544% ( 5) 00:16:15.645 16.687 - 16.782: 99.2910% ( 5) 00:16:15.645 16.782 - 16.877: 99.3202% ( 4) 00:16:15.645 16.877 - 16.972: 99.3422% ( 3) 00:16:15.645 17.067 - 17.161: 99.3568% ( 2) 00:16:15.645 17.351 - 17.446: 99.3933% ( 5) 00:16:15.645 17.446 - 17.541: 99.4006% ( 1) 00:16:15.645 17.636 - 17.730: 99.4079% ( 1) 00:16:15.645 17.730 - 17.825: 99.4226% ( 2) 00:16:15.645 26.169 - 26.359: 99.4299% ( 1) 00:16:15.645 3980.705 - 4004.978: 99.8757% ( 61) 00:16:15.645 4004.978 - 4029.250: 100.0000% ( 17) 00:16:15.645 00:16:15.645 15:11:15 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:15.645 15:11:15 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:15.645 15:11:15 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:15.645 15:11:15 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:15.645 15:11:15 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:15.903 [ 00:16:15.903 { 00:16:15.903 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:15.903 "subtype": "Discovery", 00:16:15.903 "listen_addresses": [], 00:16:15.903 "allow_any_host": true, 00:16:15.903 "hosts": [] 00:16:15.903 }, 00:16:15.903 { 00:16:15.903 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:15.903 "subtype": "NVMe", 00:16:15.903 "listen_addresses": [ 00:16:15.903 { 00:16:15.903 "transport": "VFIOUSER", 00:16:15.903 "trtype": "VFIOUSER", 00:16:15.903 "adrfam": "IPv4", 00:16:15.903 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:15.903 "trsvcid": "0" 00:16:15.903 } 00:16:15.903 ], 00:16:15.903 "allow_any_host": true, 00:16:15.903 "hosts": [], 00:16:15.903 "serial_number": "SPDK1", 00:16:15.903 "model_number": "SPDK bdev Controller", 00:16:15.903 "max_namespaces": 32, 00:16:15.903 "min_cntlid": 1, 00:16:15.903 "max_cntlid": 65519, 00:16:15.903 "namespaces": [ 00:16:15.903 { 00:16:15.903 "nsid": 1, 00:16:15.903 "bdev_name": "Malloc1", 00:16:15.903 "name": "Malloc1", 00:16:15.903 "nguid": "9D152877EC2F45A2933DAE326F21CDF2", 00:16:15.903 "uuid": "9d152877-ec2f-45a2-933d-ae326f21cdf2" 00:16:15.903 }, 00:16:15.903 { 00:16:15.903 "nsid": 2, 00:16:15.903 "bdev_name": "Malloc3", 00:16:15.903 "name": "Malloc3", 00:16:15.903 "nguid": "777CED97D1F04970B29CF47546490C34", 00:16:15.903 "uuid": "777ced97-d1f0-4970-b29c-f47546490c34" 00:16:15.903 } 00:16:15.903 ] 00:16:15.903 }, 00:16:15.903 { 00:16:15.903 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:15.903 "subtype": "NVMe", 00:16:15.903 "listen_addresses": [ 00:16:15.903 { 00:16:15.903 "transport": "VFIOUSER", 00:16:15.903 "trtype": "VFIOUSER", 00:16:15.903 "adrfam": "IPv4", 00:16:15.903 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:15.903 "trsvcid": "0" 00:16:15.903 } 00:16:15.903 ], 00:16:15.903 "allow_any_host": true, 00:16:15.903 "hosts": [], 00:16:15.903 "serial_number": "SPDK2", 00:16:15.903 "model_number": "SPDK bdev Controller", 00:16:15.903 "max_namespaces": 32, 00:16:15.903 "min_cntlid": 1, 00:16:15.903 "max_cntlid": 65519, 00:16:15.903 "namespaces": [ 00:16:15.903 { 00:16:15.903 "nsid": 1, 00:16:15.903 "bdev_name": "Malloc2", 00:16:15.903 "name": "Malloc2", 00:16:15.903 "nguid": "3A47B2975C24456EADB4F2F20140C517", 00:16:15.903 "uuid": "3a47b297-5c24-456e-adb4-f2f20140c517" 00:16:15.903 } 00:16:15.903 ] 00:16:15.903 } 00:16:15.903 ] 00:16:15.903 15:11:16 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:15.903 15:11:16 -- target/nvmf_vfio_user.sh@34 -- # aerpid=688109 00:16:15.903 15:11:16 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:15.903 15:11:16 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:15.903 15:11:16 -- common/autotest_common.sh@1254 -- # local i=0 00:16:15.903 15:11:16 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.903 15:11:16 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:15.903 15:11:16 -- common/autotest_common.sh@1265 -- # return 0 00:16:15.903 15:11:16 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:15.903 15:11:16 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:15.903 EAL: No free 2048 kB hugepages reported on node 1 00:16:16.161 Malloc4 00:16:16.161 15:11:16 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:16.419 15:11:16 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:16.419 Asynchronous Event Request test 00:16:16.419 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.419 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:16.419 Registering asynchronous event callbacks... 00:16:16.419 Starting namespace attribute notice tests for all controllers... 00:16:16.419 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:16.419 aer_cb - Changed Namespace 00:16:16.419 Cleaning up... 00:16:16.678 [ 00:16:16.678 { 00:16:16.678 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:16.678 "subtype": "Discovery", 00:16:16.678 "listen_addresses": [], 00:16:16.678 "allow_any_host": true, 00:16:16.678 "hosts": [] 00:16:16.678 }, 00:16:16.678 { 00:16:16.678 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:16.678 "subtype": "NVMe", 00:16:16.678 "listen_addresses": [ 00:16:16.678 { 00:16:16.678 "transport": "VFIOUSER", 00:16:16.678 "trtype": "VFIOUSER", 00:16:16.678 "adrfam": "IPv4", 00:16:16.678 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:16.678 "trsvcid": "0" 00:16:16.678 } 00:16:16.678 ], 00:16:16.678 "allow_any_host": true, 00:16:16.678 "hosts": [], 00:16:16.678 "serial_number": "SPDK1", 00:16:16.678 "model_number": "SPDK bdev Controller", 00:16:16.678 "max_namespaces": 32, 00:16:16.678 "min_cntlid": 1, 00:16:16.678 "max_cntlid": 65519, 00:16:16.678 "namespaces": [ 00:16:16.678 { 00:16:16.678 "nsid": 1, 00:16:16.678 "bdev_name": "Malloc1", 00:16:16.678 "name": "Malloc1", 00:16:16.678 "nguid": "9D152877EC2F45A2933DAE326F21CDF2", 00:16:16.678 "uuid": "9d152877-ec2f-45a2-933d-ae326f21cdf2" 00:16:16.678 }, 00:16:16.678 { 00:16:16.678 "nsid": 2, 00:16:16.678 "bdev_name": "Malloc3", 00:16:16.678 "name": "Malloc3", 00:16:16.678 "nguid": "777CED97D1F04970B29CF47546490C34", 00:16:16.678 "uuid": "777ced97-d1f0-4970-b29c-f47546490c34" 00:16:16.678 } 00:16:16.678 ] 00:16:16.678 }, 00:16:16.678 { 00:16:16.678 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:16.678 "subtype": "NVMe", 00:16:16.678 "listen_addresses": [ 00:16:16.678 { 00:16:16.678 "transport": "VFIOUSER", 00:16:16.678 "trtype": "VFIOUSER", 00:16:16.678 "adrfam": "IPv4", 00:16:16.678 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:16.678 "trsvcid": "0" 00:16:16.678 } 00:16:16.678 ], 00:16:16.678 "allow_any_host": true, 00:16:16.678 "hosts": [], 00:16:16.678 "serial_number": "SPDK2", 00:16:16.678 "model_number": "SPDK bdev Controller", 00:16:16.678 "max_namespaces": 32, 00:16:16.678 "min_cntlid": 1, 00:16:16.678 "max_cntlid": 65519, 00:16:16.678 "namespaces": [ 00:16:16.678 { 00:16:16.678 "nsid": 1, 00:16:16.678 "bdev_name": "Malloc2", 00:16:16.678 "name": "Malloc2", 00:16:16.678 "nguid": "3A47B2975C24456EADB4F2F20140C517", 00:16:16.678 "uuid": "3a47b297-5c24-456e-adb4-f2f20140c517" 00:16:16.678 }, 00:16:16.678 { 00:16:16.678 "nsid": 2, 00:16:16.678 "bdev_name": "Malloc4", 00:16:16.678 "name": "Malloc4", 00:16:16.678 "nguid": "2B5243EC5F9F41029C58F7FF936E8870", 00:16:16.678 "uuid": "2b5243ec-5f9f-4102-9c58-f7ff936e8870" 00:16:16.678 } 00:16:16.678 ] 00:16:16.678 } 00:16:16.678 ] 00:16:16.678 15:11:16 -- target/nvmf_vfio_user.sh@44 -- # wait 688109 00:16:16.678 15:11:16 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:16.678 15:11:16 -- target/nvmf_vfio_user.sh@95 -- # killprocess 682328 00:16:16.678 15:11:16 -- common/autotest_common.sh@936 -- # '[' -z 682328 ']' 00:16:16.678 15:11:16 -- common/autotest_common.sh@940 -- # kill -0 682328 00:16:16.678 15:11:16 -- common/autotest_common.sh@941 -- # uname 00:16:16.678 15:11:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:16.678 15:11:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 682328 00:16:16.678 15:11:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:16.678 15:11:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:16.678 15:11:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 682328' 00:16:16.678 killing process with pid 682328 00:16:16.678 15:11:16 -- common/autotest_common.sh@955 -- # kill 682328 00:16:16.678 [2024-11-28 15:11:16.897459] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:16.678 15:11:16 -- common/autotest_common.sh@960 -- # wait 682328 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=688257 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 688257' 00:16:17.245 Process pid: 688257 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:17.245 15:11:17 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 688257 00:16:17.245 15:11:17 -- common/autotest_common.sh@829 -- # '[' -z 688257 ']' 00:16:17.245 15:11:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:17.245 15:11:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:17.245 15:11:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:17.245 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:17.245 15:11:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:17.245 15:11:17 -- common/autotest_common.sh@10 -- # set +x 00:16:17.245 [2024-11-28 15:11:17.255559] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:17.245 [2024-11-28 15:11:17.256507] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:17.245 [2024-11-28 15:11:17.256567] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:17.245 EAL: No free 2048 kB hugepages reported on node 1 00:16:17.245 [2024-11-28 15:11:17.314615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:17.245 [2024-11-28 15:11:17.404314] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:17.245 [2024-11-28 15:11:17.404474] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:17.245 [2024-11-28 15:11:17.404490] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:17.245 [2024-11-28 15:11:17.404510] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:17.245 [2024-11-28 15:11:17.404565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:17.245 [2024-11-28 15:11:17.404624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:17.245 [2024-11-28 15:11:17.404689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:17.245 [2024-11-28 15:11:17.404692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:17.504 [2024-11-28 15:11:17.504441] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:17.504 [2024-11-28 15:11:17.504694] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:17.504 [2024-11-28 15:11:17.504968] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:17.504 [2024-11-28 15:11:17.505732] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:17.504 [2024-11-28 15:11:17.505847] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:18.069 15:11:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:18.069 15:11:18 -- common/autotest_common.sh@862 -- # return 0 00:16:18.069 15:11:18 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:19.440 15:11:19 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:19.441 15:11:19 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:19.441 15:11:19 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:19.441 15:11:19 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:19.441 15:11:19 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:19.441 15:11:19 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:19.699 Malloc1 00:16:19.699 15:11:19 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:19.957 15:11:20 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:20.215 15:11:20 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:20.473 15:11:20 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:20.473 15:11:20 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:20.473 15:11:20 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:20.731 Malloc2 00:16:20.731 15:11:20 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:20.988 15:11:21 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:21.246 15:11:21 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:21.504 15:11:21 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:21.504 15:11:21 -- target/nvmf_vfio_user.sh@95 -- # killprocess 688257 00:16:21.504 15:11:21 -- common/autotest_common.sh@936 -- # '[' -z 688257 ']' 00:16:21.504 15:11:21 -- common/autotest_common.sh@940 -- # kill -0 688257 00:16:21.504 15:11:21 -- common/autotest_common.sh@941 -- # uname 00:16:21.504 15:11:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:21.504 15:11:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 688257 00:16:21.762 15:11:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:21.762 15:11:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:21.762 15:11:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 688257' 00:16:21.762 killing process with pid 688257 00:16:21.762 15:11:21 -- common/autotest_common.sh@955 -- # kill 688257 00:16:21.762 15:11:21 -- common/autotest_common.sh@960 -- # wait 688257 00:16:22.020 15:11:22 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:22.020 15:11:22 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:22.020 00:16:22.020 real 0m53.380s 00:16:22.020 user 3m30.653s 00:16:22.020 sys 0m4.491s 00:16:22.020 15:11:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:22.020 15:11:22 -- common/autotest_common.sh@10 -- # set +x 00:16:22.020 ************************************ 00:16:22.020 END TEST nvmf_vfio_user 00:16:22.020 ************************************ 00:16:22.020 15:11:22 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:22.020 15:11:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:22.020 15:11:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:22.020 15:11:22 -- common/autotest_common.sh@10 -- # set +x 00:16:22.020 ************************************ 00:16:22.020 START TEST nvmf_vfio_user_nvme_compliance 00:16:22.020 ************************************ 00:16:22.020 15:11:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:22.020 * Looking for test storage... 00:16:22.020 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:22.020 15:11:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:22.020 15:11:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:22.020 15:11:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:22.020 15:11:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:22.020 15:11:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:22.020 15:11:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:22.020 15:11:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:22.020 15:11:22 -- scripts/common.sh@335 -- # IFS=.-: 00:16:22.020 15:11:22 -- scripts/common.sh@335 -- # read -ra ver1 00:16:22.020 15:11:22 -- scripts/common.sh@336 -- # IFS=.-: 00:16:22.020 15:11:22 -- scripts/common.sh@336 -- # read -ra ver2 00:16:22.020 15:11:22 -- scripts/common.sh@337 -- # local 'op=<' 00:16:22.020 15:11:22 -- scripts/common.sh@339 -- # ver1_l=2 00:16:22.020 15:11:22 -- scripts/common.sh@340 -- # ver2_l=1 00:16:22.020 15:11:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:22.020 15:11:22 -- scripts/common.sh@343 -- # case "$op" in 00:16:22.020 15:11:22 -- scripts/common.sh@344 -- # : 1 00:16:22.020 15:11:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:22.020 15:11:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:22.020 15:11:22 -- scripts/common.sh@364 -- # decimal 1 00:16:22.020 15:11:22 -- scripts/common.sh@352 -- # local d=1 00:16:22.020 15:11:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:22.020 15:11:22 -- scripts/common.sh@354 -- # echo 1 00:16:22.020 15:11:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:22.020 15:11:22 -- scripts/common.sh@365 -- # decimal 2 00:16:22.021 15:11:22 -- scripts/common.sh@352 -- # local d=2 00:16:22.021 15:11:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:22.021 15:11:22 -- scripts/common.sh@354 -- # echo 2 00:16:22.021 15:11:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:22.021 15:11:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:22.021 15:11:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:22.021 15:11:22 -- scripts/common.sh@367 -- # return 0 00:16:22.021 15:11:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:22.021 15:11:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:22.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:22.021 --rc genhtml_branch_coverage=1 00:16:22.021 --rc genhtml_function_coverage=1 00:16:22.021 --rc genhtml_legend=1 00:16:22.021 --rc geninfo_all_blocks=1 00:16:22.021 --rc geninfo_unexecuted_blocks=1 00:16:22.021 00:16:22.021 ' 00:16:22.021 15:11:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:22.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:22.021 --rc genhtml_branch_coverage=1 00:16:22.021 --rc genhtml_function_coverage=1 00:16:22.021 --rc genhtml_legend=1 00:16:22.021 --rc geninfo_all_blocks=1 00:16:22.021 --rc geninfo_unexecuted_blocks=1 00:16:22.021 00:16:22.021 ' 00:16:22.021 15:11:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:22.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:22.021 --rc genhtml_branch_coverage=1 00:16:22.021 --rc genhtml_function_coverage=1 00:16:22.021 --rc genhtml_legend=1 00:16:22.021 --rc geninfo_all_blocks=1 00:16:22.021 --rc geninfo_unexecuted_blocks=1 00:16:22.021 00:16:22.021 ' 00:16:22.021 15:11:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:22.021 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:22.021 --rc genhtml_branch_coverage=1 00:16:22.021 --rc genhtml_function_coverage=1 00:16:22.021 --rc genhtml_legend=1 00:16:22.021 --rc geninfo_all_blocks=1 00:16:22.021 --rc geninfo_unexecuted_blocks=1 00:16:22.021 00:16:22.021 ' 00:16:22.021 15:11:22 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:22.021 15:11:22 -- nvmf/common.sh@7 -- # uname -s 00:16:22.021 15:11:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:22.021 15:11:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:22.021 15:11:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:22.021 15:11:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:22.021 15:11:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:22.021 15:11:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:22.021 15:11:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:22.021 15:11:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:22.021 15:11:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:22.021 15:11:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:22.021 15:11:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:22.021 15:11:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:22.021 15:11:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:22.021 15:11:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:22.021 15:11:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:22.021 15:11:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:22.021 15:11:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:22.021 15:11:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:22.021 15:11:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:22.021 15:11:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.021 15:11:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.021 15:11:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.021 15:11:22 -- paths/export.sh@5 -- # export PATH 00:16:22.021 15:11:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:22.021 15:11:22 -- nvmf/common.sh@46 -- # : 0 00:16:22.021 15:11:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:22.021 15:11:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:22.021 15:11:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:22.021 15:11:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:22.021 15:11:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:22.021 15:11:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:22.021 15:11:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:22.021 15:11:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:22.021 15:11:22 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:22.021 15:11:22 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:22.021 15:11:22 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:22.021 15:11:22 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:22.021 15:11:22 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:22.021 15:11:22 -- compliance/compliance.sh@20 -- # nvmfpid=688884 00:16:22.021 15:11:22 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:22.021 15:11:22 -- compliance/compliance.sh@21 -- # echo 'Process pid: 688884' 00:16:22.021 Process pid: 688884 00:16:22.021 15:11:22 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:22.021 15:11:22 -- compliance/compliance.sh@24 -- # waitforlisten 688884 00:16:22.021 15:11:22 -- common/autotest_common.sh@829 -- # '[' -z 688884 ']' 00:16:22.021 15:11:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:22.021 15:11:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:22.021 15:11:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:22.021 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:22.021 15:11:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:22.021 15:11:22 -- common/autotest_common.sh@10 -- # set +x 00:16:22.280 [2024-11-28 15:11:22.264199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:16:22.280 [2024-11-28 15:11:22.264274] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:22.280 EAL: No free 2048 kB hugepages reported on node 1 00:16:22.280 [2024-11-28 15:11:22.320794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:22.280 [2024-11-28 15:11:22.406739] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:22.280 [2024-11-28 15:11:22.406902] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:22.280 [2024-11-28 15:11:22.406921] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:22.280 [2024-11-28 15:11:22.406935] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:22.280 [2024-11-28 15:11:22.406995] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:22.280 [2024-11-28 15:11:22.407050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:22.280 [2024-11-28 15:11:22.407054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:22.280 15:11:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:22.280 15:11:22 -- common/autotest_common.sh@862 -- # return 0 00:16:22.538 15:11:22 -- compliance/compliance.sh@26 -- # sleep 1 00:16:23.475 15:11:23 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:23.475 15:11:23 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:23.475 15:11:23 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:23.475 15:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.475 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:16:23.475 15:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.475 15:11:23 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:23.475 15:11:23 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:23.475 15:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.475 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:16:23.475 malloc0 00:16:23.475 15:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.475 15:11:23 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:23.475 15:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.475 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:16:23.475 15:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.475 15:11:23 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:23.475 15:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.475 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:16:23.475 15:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.475 15:11:23 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:23.475 15:11:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:23.475 15:11:23 -- common/autotest_common.sh@10 -- # set +x 00:16:23.475 15:11:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:23.475 15:11:23 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:23.475 EAL: No free 2048 kB hugepages reported on node 1 00:16:23.475 00:16:23.475 00:16:23.475 CUnit - A unit testing framework for C - Version 2.1-3 00:16:23.475 http://cunit.sourceforge.net/ 00:16:23.475 00:16:23.475 00:16:23.475 Suite: nvme_compliance 00:16:23.732 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-28 15:11:23.750574] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:23.732 [2024-11-28 15:11:23.750628] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:23.732 [2024-11-28 15:11:23.750656] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:23.732 passed 00:16:23.732 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:23.989 Test: admin_identify_ns ...[2024-11-28 15:11:23.988114] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:23.989 [2024-11-28 15:11:23.996139] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:23.989 passed 00:16:23.989 Test: admin_get_features_mandatory_features ...passed 00:16:24.247 Test: admin_get_features_optional_features ...passed 00:16:24.247 Test: admin_set_features_number_of_queues ...passed 00:16:24.504 Test: admin_get_log_page_mandatory_logs ...passed 00:16:24.504 Test: admin_get_log_page_with_lpo ...[2024-11-28 15:11:24.625112] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:24.504 passed 00:16:24.760 Test: fabric_property_get ...passed 00:16:24.760 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-28 15:11:24.810716] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:24.760 passed 00:16:24.760 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-28 15:11:24.979120] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.020 [2024-11-28 15:11:24.995119] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.020 passed 00:16:25.020 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-28 15:11:25.084758] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:25.020 passed 00:16:25.020 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-28 15:11:25.246119] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:25.282 [2024-11-28 15:11:25.270107] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:25.282 passed 00:16:25.282 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-28 15:11:25.363250] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:25.282 [2024-11-28 15:11:25.363308] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:25.282 passed 00:16:25.539 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-28 15:11:25.543101] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:25.539 [2024-11-28 15:11:25.551104] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:25.539 [2024-11-28 15:11:25.559120] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:25.539 [2024-11-28 15:11:25.567105] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:25.539 passed 00:16:25.539 Test: admin_create_io_sq_verify_pc ...[2024-11-28 15:11:25.696119] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:25.539 passed 00:16:26.912 Test: admin_create_io_qp_max_qps ...[2024-11-28 15:11:26.903108] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:27.171 passed 00:16:27.462 Test: admin_create_io_sq_shared_cq ...[2024-11-28 15:11:27.498129] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:27.462 passed 00:16:27.462 00:16:27.462 Run Summary: Type Total Ran Passed Failed Inactive 00:16:27.462 suites 1 1 n/a 0 0 00:16:27.462 tests 18 18 18 0 0 00:16:27.462 asserts 360 360 360 0 n/a 00:16:27.462 00:16:27.462 Elapsed time = 1.569 seconds 00:16:27.462 15:11:27 -- compliance/compliance.sh@42 -- # killprocess 688884 00:16:27.462 15:11:27 -- common/autotest_common.sh@936 -- # '[' -z 688884 ']' 00:16:27.462 15:11:27 -- common/autotest_common.sh@940 -- # kill -0 688884 00:16:27.462 15:11:27 -- common/autotest_common.sh@941 -- # uname 00:16:27.462 15:11:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:27.462 15:11:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 688884 00:16:27.462 15:11:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:27.462 15:11:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:27.462 15:11:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 688884' 00:16:27.462 killing process with pid 688884 00:16:27.462 15:11:27 -- common/autotest_common.sh@955 -- # kill 688884 00:16:27.462 15:11:27 -- common/autotest_common.sh@960 -- # wait 688884 00:16:27.750 15:11:27 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:27.750 15:11:27 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:27.750 00:16:27.750 real 0m5.808s 00:16:27.750 user 0m16.330s 00:16:27.750 sys 0m0.538s 00:16:27.750 15:11:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:27.750 15:11:27 -- common/autotest_common.sh@10 -- # set +x 00:16:27.750 ************************************ 00:16:27.750 END TEST nvmf_vfio_user_nvme_compliance 00:16:27.750 ************************************ 00:16:27.750 15:11:27 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:27.750 15:11:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:27.750 15:11:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:27.750 15:11:27 -- common/autotest_common.sh@10 -- # set +x 00:16:27.750 ************************************ 00:16:27.750 START TEST nvmf_vfio_user_fuzz 00:16:27.750 ************************************ 00:16:27.750 15:11:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:27.750 * Looking for test storage... 00:16:27.750 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:27.750 15:11:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:27.750 15:11:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:27.750 15:11:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:28.010 15:11:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:28.010 15:11:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:28.010 15:11:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:28.010 15:11:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:28.010 15:11:28 -- scripts/common.sh@335 -- # IFS=.-: 00:16:28.010 15:11:28 -- scripts/common.sh@335 -- # read -ra ver1 00:16:28.010 15:11:28 -- scripts/common.sh@336 -- # IFS=.-: 00:16:28.010 15:11:28 -- scripts/common.sh@336 -- # read -ra ver2 00:16:28.010 15:11:28 -- scripts/common.sh@337 -- # local 'op=<' 00:16:28.010 15:11:28 -- scripts/common.sh@339 -- # ver1_l=2 00:16:28.010 15:11:28 -- scripts/common.sh@340 -- # ver2_l=1 00:16:28.010 15:11:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:28.010 15:11:28 -- scripts/common.sh@343 -- # case "$op" in 00:16:28.010 15:11:28 -- scripts/common.sh@344 -- # : 1 00:16:28.010 15:11:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:28.010 15:11:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:28.010 15:11:28 -- scripts/common.sh@364 -- # decimal 1 00:16:28.010 15:11:28 -- scripts/common.sh@352 -- # local d=1 00:16:28.010 15:11:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:28.010 15:11:28 -- scripts/common.sh@354 -- # echo 1 00:16:28.010 15:11:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:28.010 15:11:28 -- scripts/common.sh@365 -- # decimal 2 00:16:28.010 15:11:28 -- scripts/common.sh@352 -- # local d=2 00:16:28.010 15:11:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:28.010 15:11:28 -- scripts/common.sh@354 -- # echo 2 00:16:28.010 15:11:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:28.010 15:11:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:28.010 15:11:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:28.010 15:11:28 -- scripts/common.sh@367 -- # return 0 00:16:28.010 15:11:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:28.010 15:11:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:28.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.010 --rc genhtml_branch_coverage=1 00:16:28.010 --rc genhtml_function_coverage=1 00:16:28.010 --rc genhtml_legend=1 00:16:28.010 --rc geninfo_all_blocks=1 00:16:28.010 --rc geninfo_unexecuted_blocks=1 00:16:28.010 00:16:28.010 ' 00:16:28.010 15:11:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:28.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.010 --rc genhtml_branch_coverage=1 00:16:28.010 --rc genhtml_function_coverage=1 00:16:28.010 --rc genhtml_legend=1 00:16:28.010 --rc geninfo_all_blocks=1 00:16:28.010 --rc geninfo_unexecuted_blocks=1 00:16:28.010 00:16:28.010 ' 00:16:28.010 15:11:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:28.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.010 --rc genhtml_branch_coverage=1 00:16:28.010 --rc genhtml_function_coverage=1 00:16:28.010 --rc genhtml_legend=1 00:16:28.010 --rc geninfo_all_blocks=1 00:16:28.010 --rc geninfo_unexecuted_blocks=1 00:16:28.010 00:16:28.010 ' 00:16:28.010 15:11:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:28.010 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:28.010 --rc genhtml_branch_coverage=1 00:16:28.010 --rc genhtml_function_coverage=1 00:16:28.010 --rc genhtml_legend=1 00:16:28.010 --rc geninfo_all_blocks=1 00:16:28.010 --rc geninfo_unexecuted_blocks=1 00:16:28.010 00:16:28.010 ' 00:16:28.010 15:11:28 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:28.010 15:11:28 -- nvmf/common.sh@7 -- # uname -s 00:16:28.010 15:11:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:28.010 15:11:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:28.010 15:11:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:28.010 15:11:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:28.010 15:11:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:28.010 15:11:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:28.010 15:11:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:28.010 15:11:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:28.010 15:11:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:28.010 15:11:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:28.010 15:11:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.010 15:11:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:28.010 15:11:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:28.010 15:11:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:28.010 15:11:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:28.010 15:11:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:28.010 15:11:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:28.010 15:11:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:28.010 15:11:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:28.010 15:11:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.010 15:11:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.010 15:11:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.010 15:11:28 -- paths/export.sh@5 -- # export PATH 00:16:28.010 15:11:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:28.010 15:11:28 -- nvmf/common.sh@46 -- # : 0 00:16:28.010 15:11:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:28.010 15:11:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:28.010 15:11:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:28.010 15:11:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:28.010 15:11:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:28.010 15:11:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:28.010 15:11:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:28.010 15:11:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:28.010 15:11:28 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:28.010 15:11:28 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:28.010 15:11:28 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=689636 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 689636' 00:16:28.011 Process pid: 689636 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:28.011 15:11:28 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 689636 00:16:28.011 15:11:28 -- common/autotest_common.sh@829 -- # '[' -z 689636 ']' 00:16:28.011 15:11:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:28.011 15:11:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:28.011 15:11:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:28.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:28.011 15:11:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:28.011 15:11:28 -- common/autotest_common.sh@10 -- # set +x 00:16:28.945 15:11:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:28.945 15:11:29 -- common/autotest_common.sh@862 -- # return 0 00:16:28.945 15:11:29 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:29.881 15:11:30 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:29.881 15:11:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:29.881 15:11:30 -- common/autotest_common.sh@10 -- # set +x 00:16:29.881 15:11:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:29.881 15:11:30 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:29.881 15:11:30 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:29.881 15:11:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:29.881 15:11:30 -- common/autotest_common.sh@10 -- # set +x 00:16:30.140 malloc0 00:16:30.140 15:11:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.140 15:11:30 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:30.140 15:11:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.140 15:11:30 -- common/autotest_common.sh@10 -- # set +x 00:16:30.140 15:11:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.140 15:11:30 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:30.140 15:11:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.140 15:11:30 -- common/autotest_common.sh@10 -- # set +x 00:16:30.140 15:11:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.140 15:11:30 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:30.141 15:11:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.141 15:11:30 -- common/autotest_common.sh@10 -- # set +x 00:16:30.141 15:11:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.141 15:11:30 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:30.141 15:11:30 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:17:02.216 Fuzzing completed. Shutting down the fuzz application 00:17:02.216 00:17:02.216 Dumping successful admin opcodes: 00:17:02.216 8, 9, 10, 24, 00:17:02.216 Dumping successful io opcodes: 00:17:02.216 0, 00:17:02.216 NS: 0x200003a1ef00 I/O qp, Total commands completed: 559835, total successful commands: 2155, random_seed: 532085504 00:17:02.216 NS: 0x200003a1ef00 admin qp, Total commands completed: 139220, total successful commands: 1129, random_seed: 3163972160 00:17:02.216 15:12:00 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:17:02.216 15:12:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.216 15:12:00 -- common/autotest_common.sh@10 -- # set +x 00:17:02.216 15:12:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.216 15:12:00 -- target/vfio_user_fuzz.sh@46 -- # killprocess 689636 00:17:02.216 15:12:00 -- common/autotest_common.sh@936 -- # '[' -z 689636 ']' 00:17:02.216 15:12:00 -- common/autotest_common.sh@940 -- # kill -0 689636 00:17:02.216 15:12:00 -- common/autotest_common.sh@941 -- # uname 00:17:02.216 15:12:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:02.216 15:12:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 689636 00:17:02.216 15:12:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:02.216 15:12:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:02.216 15:12:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 689636' 00:17:02.216 killing process with pid 689636 00:17:02.216 15:12:00 -- common/autotest_common.sh@955 -- # kill 689636 00:17:02.216 15:12:00 -- common/autotest_common.sh@960 -- # wait 689636 00:17:02.217 15:12:01 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:17:02.217 15:12:01 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:17:02.217 00:17:02.217 real 0m33.164s 00:17:02.217 user 0m34.441s 00:17:02.217 sys 0m24.680s 00:17:02.217 15:12:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:02.217 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:17:02.217 ************************************ 00:17:02.217 END TEST nvmf_vfio_user_fuzz 00:17:02.217 ************************************ 00:17:02.217 15:12:01 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:02.217 15:12:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:02.217 15:12:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:02.217 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:17:02.217 ************************************ 00:17:02.217 START TEST nvmf_host_management 00:17:02.217 ************************************ 00:17:02.217 15:12:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:17:02.217 * Looking for test storage... 00:17:02.217 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:02.217 15:12:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:02.217 15:12:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:02.217 15:12:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:02.217 15:12:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:02.217 15:12:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:02.217 15:12:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:02.217 15:12:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:02.217 15:12:01 -- scripts/common.sh@335 -- # IFS=.-: 00:17:02.217 15:12:01 -- scripts/common.sh@335 -- # read -ra ver1 00:17:02.217 15:12:01 -- scripts/common.sh@336 -- # IFS=.-: 00:17:02.217 15:12:01 -- scripts/common.sh@336 -- # read -ra ver2 00:17:02.217 15:12:01 -- scripts/common.sh@337 -- # local 'op=<' 00:17:02.217 15:12:01 -- scripts/common.sh@339 -- # ver1_l=2 00:17:02.217 15:12:01 -- scripts/common.sh@340 -- # ver2_l=1 00:17:02.217 15:12:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:02.217 15:12:01 -- scripts/common.sh@343 -- # case "$op" in 00:17:02.217 15:12:01 -- scripts/common.sh@344 -- # : 1 00:17:02.217 15:12:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:02.217 15:12:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:02.217 15:12:01 -- scripts/common.sh@364 -- # decimal 1 00:17:02.217 15:12:01 -- scripts/common.sh@352 -- # local d=1 00:17:02.217 15:12:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:02.217 15:12:01 -- scripts/common.sh@354 -- # echo 1 00:17:02.217 15:12:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:02.217 15:12:01 -- scripts/common.sh@365 -- # decimal 2 00:17:02.217 15:12:01 -- scripts/common.sh@352 -- # local d=2 00:17:02.217 15:12:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:02.217 15:12:01 -- scripts/common.sh@354 -- # echo 2 00:17:02.217 15:12:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:02.217 15:12:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:02.217 15:12:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:02.217 15:12:01 -- scripts/common.sh@367 -- # return 0 00:17:02.217 15:12:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:02.217 15:12:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:02.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.217 --rc genhtml_branch_coverage=1 00:17:02.217 --rc genhtml_function_coverage=1 00:17:02.217 --rc genhtml_legend=1 00:17:02.217 --rc geninfo_all_blocks=1 00:17:02.217 --rc geninfo_unexecuted_blocks=1 00:17:02.217 00:17:02.217 ' 00:17:02.217 15:12:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:02.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.217 --rc genhtml_branch_coverage=1 00:17:02.217 --rc genhtml_function_coverage=1 00:17:02.217 --rc genhtml_legend=1 00:17:02.217 --rc geninfo_all_blocks=1 00:17:02.217 --rc geninfo_unexecuted_blocks=1 00:17:02.217 00:17:02.217 ' 00:17:02.217 15:12:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:02.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.217 --rc genhtml_branch_coverage=1 00:17:02.217 --rc genhtml_function_coverage=1 00:17:02.217 --rc genhtml_legend=1 00:17:02.217 --rc geninfo_all_blocks=1 00:17:02.217 --rc geninfo_unexecuted_blocks=1 00:17:02.217 00:17:02.217 ' 00:17:02.217 15:12:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:02.217 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:02.217 --rc genhtml_branch_coverage=1 00:17:02.217 --rc genhtml_function_coverage=1 00:17:02.217 --rc genhtml_legend=1 00:17:02.217 --rc geninfo_all_blocks=1 00:17:02.217 --rc geninfo_unexecuted_blocks=1 00:17:02.217 00:17:02.217 ' 00:17:02.217 15:12:01 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:02.217 15:12:01 -- nvmf/common.sh@7 -- # uname -s 00:17:02.217 15:12:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:02.217 15:12:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:02.217 15:12:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:02.217 15:12:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:02.217 15:12:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:02.217 15:12:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:02.217 15:12:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:02.217 15:12:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:02.217 15:12:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:02.217 15:12:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:02.217 15:12:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.217 15:12:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:02.217 15:12:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:02.217 15:12:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:02.217 15:12:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:02.217 15:12:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:02.217 15:12:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:02.217 15:12:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:02.217 15:12:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:02.217 15:12:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.217 15:12:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.217 15:12:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.217 15:12:01 -- paths/export.sh@5 -- # export PATH 00:17:02.217 15:12:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:02.217 15:12:01 -- nvmf/common.sh@46 -- # : 0 00:17:02.217 15:12:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:02.217 15:12:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:02.217 15:12:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:02.217 15:12:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:02.217 15:12:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:02.217 15:12:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:02.218 15:12:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:02.218 15:12:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:02.218 15:12:01 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:02.218 15:12:01 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:02.218 15:12:01 -- target/host_management.sh@104 -- # nvmftestinit 00:17:02.218 15:12:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:02.218 15:12:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:02.218 15:12:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:02.218 15:12:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:02.218 15:12:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:02.218 15:12:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:02.218 15:12:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:02.218 15:12:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:02.218 15:12:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:02.218 15:12:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:02.218 15:12:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:02.218 15:12:01 -- common/autotest_common.sh@10 -- # set +x 00:17:03.155 15:12:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:03.155 15:12:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:03.155 15:12:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:03.155 15:12:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:03.155 15:12:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:03.155 15:12:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:03.155 15:12:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:03.155 15:12:03 -- nvmf/common.sh@294 -- # net_devs=() 00:17:03.155 15:12:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:03.155 15:12:03 -- nvmf/common.sh@295 -- # e810=() 00:17:03.155 15:12:03 -- nvmf/common.sh@295 -- # local -ga e810 00:17:03.155 15:12:03 -- nvmf/common.sh@296 -- # x722=() 00:17:03.155 15:12:03 -- nvmf/common.sh@296 -- # local -ga x722 00:17:03.155 15:12:03 -- nvmf/common.sh@297 -- # mlx=() 00:17:03.155 15:12:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:03.155 15:12:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:03.155 15:12:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:03.155 15:12:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:03.155 15:12:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:03.155 15:12:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:03.155 15:12:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:03.155 15:12:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:03.155 15:12:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:03.155 15:12:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:03.156 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:03.156 15:12:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:03.156 15:12:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:03.156 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:03.156 15:12:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:03.156 15:12:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:03.156 15:12:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:03.156 15:12:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:03.156 15:12:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:03.156 15:12:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:03.156 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:03.156 15:12:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:03.156 15:12:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:03.156 15:12:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:03.156 15:12:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:03.156 15:12:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:03.156 15:12:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:03.156 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:03.156 15:12:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:03.156 15:12:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:03.156 15:12:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:03.156 15:12:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:03.156 15:12:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:03.156 15:12:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:03.156 15:12:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:03.156 15:12:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:03.156 15:12:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:03.156 15:12:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:03.156 15:12:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:03.156 15:12:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:03.156 15:12:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:03.156 15:12:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:03.156 15:12:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:03.156 15:12:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:03.156 15:12:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:03.156 15:12:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:03.156 15:12:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:03.156 15:12:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:03.156 15:12:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:03.156 15:12:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:03.156 15:12:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:03.156 15:12:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:03.156 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:03.156 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:17:03.156 00:17:03.156 --- 10.0.0.2 ping statistics --- 00:17:03.156 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.156 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:17:03.156 15:12:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:03.156 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:03.156 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:17:03.156 00:17:03.156 --- 10.0.0.1 ping statistics --- 00:17:03.156 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:03.156 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:17:03.156 15:12:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:03.156 15:12:03 -- nvmf/common.sh@410 -- # return 0 00:17:03.156 15:12:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:03.156 15:12:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:03.156 15:12:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:03.156 15:12:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:03.156 15:12:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:03.156 15:12:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:03.156 15:12:03 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:03.156 15:12:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:03.156 15:12:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:03.156 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:17:03.156 ************************************ 00:17:03.156 START TEST nvmf_host_management 00:17:03.156 ************************************ 00:17:03.156 15:12:03 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:03.156 15:12:03 -- target/host_management.sh@69 -- # starttarget 00:17:03.156 15:12:03 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:03.156 15:12:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:03.156 15:12:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:03.156 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:17:03.156 15:12:03 -- nvmf/common.sh@469 -- # nvmfpid=695454 00:17:03.156 15:12:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:03.156 15:12:03 -- nvmf/common.sh@470 -- # waitforlisten 695454 00:17:03.156 15:12:03 -- common/autotest_common.sh@829 -- # '[' -z 695454 ']' 00:17:03.156 15:12:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:03.156 15:12:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:03.156 15:12:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:03.156 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:03.156 15:12:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:03.156 15:12:03 -- common/autotest_common.sh@10 -- # set +x 00:17:03.415 [2024-11-28 15:12:03.416283] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:03.415 [2024-11-28 15:12:03.416352] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:03.415 EAL: No free 2048 kB hugepages reported on node 1 00:17:03.415 [2024-11-28 15:12:03.479584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:03.415 [2024-11-28 15:12:03.570959] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:03.415 [2024-11-28 15:12:03.571127] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:03.415 [2024-11-28 15:12:03.571146] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:03.415 [2024-11-28 15:12:03.571159] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:03.415 [2024-11-28 15:12:03.571299] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:03.415 [2024-11-28 15:12:03.571364] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:03.415 [2024-11-28 15:12:03.571420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:03.415 [2024-11-28 15:12:03.571422] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:04.349 15:12:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:04.349 15:12:04 -- common/autotest_common.sh@862 -- # return 0 00:17:04.349 15:12:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:04.349 15:12:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:04.349 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.349 15:12:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:04.349 15:12:04 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:04.349 15:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.349 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.349 [2024-11-28 15:12:04.411806] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:04.349 15:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.349 15:12:04 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:04.349 15:12:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:04.349 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.349 15:12:04 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:04.349 15:12:04 -- target/host_management.sh@23 -- # cat 00:17:04.349 15:12:04 -- target/host_management.sh@30 -- # rpc_cmd 00:17:04.349 15:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:04.349 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.349 Malloc0 00:17:04.349 [2024-11-28 15:12:04.473468] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:04.349 15:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:04.349 15:12:04 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:04.349 15:12:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:04.349 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.349 15:12:04 -- target/host_management.sh@73 -- # perfpid=695639 00:17:04.349 15:12:04 -- target/host_management.sh@74 -- # waitforlisten 695639 /var/tmp/bdevperf.sock 00:17:04.349 15:12:04 -- common/autotest_common.sh@829 -- # '[' -z 695639 ']' 00:17:04.349 15:12:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:04.349 15:12:04 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:04.349 15:12:04 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:04.349 15:12:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:04.350 15:12:04 -- nvmf/common.sh@520 -- # config=() 00:17:04.350 15:12:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:04.350 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:04.350 15:12:04 -- nvmf/common.sh@520 -- # local subsystem config 00:17:04.350 15:12:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:04.350 15:12:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:04.350 15:12:04 -- common/autotest_common.sh@10 -- # set +x 00:17:04.350 15:12:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:04.350 { 00:17:04.350 "params": { 00:17:04.350 "name": "Nvme$subsystem", 00:17:04.350 "trtype": "$TEST_TRANSPORT", 00:17:04.350 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:04.350 "adrfam": "ipv4", 00:17:04.350 "trsvcid": "$NVMF_PORT", 00:17:04.350 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:04.350 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:04.350 "hdgst": ${hdgst:-false}, 00:17:04.350 "ddgst": ${ddgst:-false} 00:17:04.350 }, 00:17:04.350 "method": "bdev_nvme_attach_controller" 00:17:04.350 } 00:17:04.350 EOF 00:17:04.350 )") 00:17:04.350 15:12:04 -- nvmf/common.sh@542 -- # cat 00:17:04.350 15:12:04 -- nvmf/common.sh@544 -- # jq . 00:17:04.350 15:12:04 -- nvmf/common.sh@545 -- # IFS=, 00:17:04.350 15:12:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:04.350 "params": { 00:17:04.350 "name": "Nvme0", 00:17:04.350 "trtype": "tcp", 00:17:04.350 "traddr": "10.0.0.2", 00:17:04.350 "adrfam": "ipv4", 00:17:04.350 "trsvcid": "4420", 00:17:04.350 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:04.350 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:04.350 "hdgst": false, 00:17:04.350 "ddgst": false 00:17:04.350 }, 00:17:04.350 "method": "bdev_nvme_attach_controller" 00:17:04.350 }' 00:17:04.350 [2024-11-28 15:12:04.551619] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:04.350 [2024-11-28 15:12:04.551707] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid695639 ] 00:17:04.350 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.609 [2024-11-28 15:12:04.613477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:04.609 [2024-11-28 15:12:04.698356] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:04.867 Running I/O for 10 seconds... 00:17:05.434 15:12:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:05.434 15:12:05 -- common/autotest_common.sh@862 -- # return 0 00:17:05.434 15:12:05 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:05.434 15:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.434 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:17:05.434 15:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.434 15:12:05 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:05.434 15:12:05 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:05.434 15:12:05 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:05.434 15:12:05 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:05.434 15:12:05 -- target/host_management.sh@52 -- # local ret=1 00:17:05.434 15:12:05 -- target/host_management.sh@53 -- # local i 00:17:05.434 15:12:05 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:05.434 15:12:05 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:05.434 15:12:05 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:05.434 15:12:05 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:05.434 15:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.434 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:17:05.434 15:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.434 15:12:05 -- target/host_management.sh@55 -- # read_io_count=2091 00:17:05.434 15:12:05 -- target/host_management.sh@58 -- # '[' 2091 -ge 100 ']' 00:17:05.434 15:12:05 -- target/host_management.sh@59 -- # ret=0 00:17:05.434 15:12:05 -- target/host_management.sh@60 -- # break 00:17:05.434 15:12:05 -- target/host_management.sh@64 -- # return 0 00:17:05.434 15:12:05 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:05.434 15:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.434 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:17:05.434 [2024-11-28 15:12:05.565203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1687ad0 is same with the state(5) to be set 00:17:05.434 [2024-11-28 15:12:05.565321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1687ad0 is same with the state(5) to be set 00:17:05.434 [2024-11-28 15:12:05.565345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1687ad0 is same with the state(5) to be set 00:17:05.434 [2024-11-28 15:12:05.566546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.566982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.566997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.567011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.567026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.567041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.567057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.434 [2024-11-28 15:12:05.567072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.434 [2024-11-28 15:12:05.567087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.567970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.567988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.568019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.568051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.568082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.568139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.568170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.435 [2024-11-28 15:12:05.568208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:18432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.435 [2024-11-28 15:12:05.568225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:18816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:20608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:21888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:05.436 [2024-11-28 15:12:05.568774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:05.436 [2024-11-28 15:12:05.568867] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x86b630 was disconnected and freed. reset controller. 00:17:05.436 15:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.436 15:12:05 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:05.436 15:12:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:05.436 15:12:05 -- common/autotest_common.sh@10 -- # set +x 00:17:05.436 [2024-11-28 15:12:05.570036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:05.436 task offset: 24064 on job bdev=Nvme0n1 fails 00:17:05.436 00:17:05.436 Latency(us) 00:17:05.436 [2024-11-28T14:12:05.670Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.436 [2024-11-28T14:12:05.670Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:05.436 [2024-11-28T14:12:05.670Z] Job: Nvme0n1 ended in about 0.65 seconds with error 00:17:05.436 Verification LBA range: start 0x0 length 0x400 00:17:05.436 Nvme0n1 : 0.65 3412.05 213.25 98.41 0.00 17976.66 2694.26 25631.86 00:17:05.436 [2024-11-28T14:12:05.670Z] =================================================================================================================== 00:17:05.436 [2024-11-28T14:12:05.670Z] Total : 3412.05 213.25 98.41 0.00 17976.66 2694.26 25631.86 00:17:05.436 [2024-11-28 15:12:05.571916] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:05.436 [2024-11-28 15:12:05.571947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8711d0 (9): Bad file descriptor 00:17:05.436 15:12:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:05.436 15:12:05 -- target/host_management.sh@87 -- # sleep 1 00:17:05.436 [2024-11-28 15:12:05.579263] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:06.370 15:12:06 -- target/host_management.sh@91 -- # kill -9 695639 00:17:06.370 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (695639) - No such process 00:17:06.370 15:12:06 -- target/host_management.sh@91 -- # true 00:17:06.370 15:12:06 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:06.371 15:12:06 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:06.371 15:12:06 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:06.371 15:12:06 -- nvmf/common.sh@520 -- # config=() 00:17:06.371 15:12:06 -- nvmf/common.sh@520 -- # local subsystem config 00:17:06.371 15:12:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:06.371 15:12:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:06.371 { 00:17:06.371 "params": { 00:17:06.371 "name": "Nvme$subsystem", 00:17:06.371 "trtype": "$TEST_TRANSPORT", 00:17:06.371 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:06.371 "adrfam": "ipv4", 00:17:06.371 "trsvcid": "$NVMF_PORT", 00:17:06.371 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:06.371 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:06.371 "hdgst": ${hdgst:-false}, 00:17:06.371 "ddgst": ${ddgst:-false} 00:17:06.371 }, 00:17:06.371 "method": "bdev_nvme_attach_controller" 00:17:06.371 } 00:17:06.371 EOF 00:17:06.371 )") 00:17:06.371 15:12:06 -- nvmf/common.sh@542 -- # cat 00:17:06.371 15:12:06 -- nvmf/common.sh@544 -- # jq . 00:17:06.371 15:12:06 -- nvmf/common.sh@545 -- # IFS=, 00:17:06.371 15:12:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:06.371 "params": { 00:17:06.371 "name": "Nvme0", 00:17:06.371 "trtype": "tcp", 00:17:06.371 "traddr": "10.0.0.2", 00:17:06.371 "adrfam": "ipv4", 00:17:06.371 "trsvcid": "4420", 00:17:06.371 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:06.371 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:06.371 "hdgst": false, 00:17:06.371 "ddgst": false 00:17:06.371 }, 00:17:06.371 "method": "bdev_nvme_attach_controller" 00:17:06.371 }' 00:17:06.629 [2024-11-28 15:12:06.619654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:06.629 [2024-11-28 15:12:06.619752] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid695926 ] 00:17:06.629 EAL: No free 2048 kB hugepages reported on node 1 00:17:06.629 [2024-11-28 15:12:06.680312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:06.629 [2024-11-28 15:12:06.762440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:06.888 Running I/O for 1 seconds... 00:17:07.824 00:17:07.824 Latency(us) 00:17:07.824 [2024-11-28T14:12:08.058Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:07.824 [2024-11-28T14:12:08.058Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:07.824 Verification LBA range: start 0x0 length 0x400 00:17:07.824 Nvme0n1 : 1.01 3512.63 219.54 0.00 0.00 17906.74 1771.90 25826.04 00:17:07.824 [2024-11-28T14:12:08.058Z] =================================================================================================================== 00:17:07.824 [2024-11-28T14:12:08.058Z] Total : 3512.63 219.54 0.00 0.00 17906.74 1771.90 25826.04 00:17:08.083 15:12:08 -- target/host_management.sh@101 -- # stoptarget 00:17:08.083 15:12:08 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:08.083 15:12:08 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:08.083 15:12:08 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:08.083 15:12:08 -- target/host_management.sh@40 -- # nvmftestfini 00:17:08.083 15:12:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:08.083 15:12:08 -- nvmf/common.sh@116 -- # sync 00:17:08.083 15:12:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:08.083 15:12:08 -- nvmf/common.sh@119 -- # set +e 00:17:08.083 15:12:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:08.083 15:12:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:08.083 rmmod nvme_tcp 00:17:08.083 rmmod nvme_fabrics 00:17:08.083 rmmod nvme_keyring 00:17:08.083 15:12:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:08.083 15:12:08 -- nvmf/common.sh@123 -- # set -e 00:17:08.083 15:12:08 -- nvmf/common.sh@124 -- # return 0 00:17:08.083 15:12:08 -- nvmf/common.sh@477 -- # '[' -n 695454 ']' 00:17:08.083 15:12:08 -- nvmf/common.sh@478 -- # killprocess 695454 00:17:08.083 15:12:08 -- common/autotest_common.sh@936 -- # '[' -z 695454 ']' 00:17:08.083 15:12:08 -- common/autotest_common.sh@940 -- # kill -0 695454 00:17:08.083 15:12:08 -- common/autotest_common.sh@941 -- # uname 00:17:08.083 15:12:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:08.083 15:12:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 695454 00:17:08.083 15:12:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:08.083 15:12:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:08.083 15:12:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 695454' 00:17:08.083 killing process with pid 695454 00:17:08.083 15:12:08 -- common/autotest_common.sh@955 -- # kill 695454 00:17:08.083 15:12:08 -- common/autotest_common.sh@960 -- # wait 695454 00:17:08.342 [2024-11-28 15:12:08.496150] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:08.342 15:12:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:08.342 15:12:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:08.342 15:12:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:08.342 15:12:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:08.342 15:12:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:08.342 15:12:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.342 15:12:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.342 15:12:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.876 15:12:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:10.876 00:17:10.876 real 0m7.192s 00:17:10.876 user 0m21.810s 00:17:10.876 sys 0m1.542s 00:17:10.876 15:12:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:10.876 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:17:10.876 ************************************ 00:17:10.876 END TEST nvmf_host_management 00:17:10.876 ************************************ 00:17:10.876 15:12:10 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:10.876 00:17:10.876 real 0m9.486s 00:17:10.876 user 0m22.634s 00:17:10.877 sys 0m3.043s 00:17:10.877 15:12:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:10.877 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:17:10.877 ************************************ 00:17:10.877 END TEST nvmf_host_management 00:17:10.877 ************************************ 00:17:10.877 15:12:10 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:10.877 15:12:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:10.877 15:12:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:10.877 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:17:10.877 ************************************ 00:17:10.877 START TEST nvmf_lvol 00:17:10.877 ************************************ 00:17:10.877 15:12:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:10.877 * Looking for test storage... 00:17:10.877 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:10.877 15:12:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:10.877 15:12:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:10.877 15:12:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:10.877 15:12:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:10.877 15:12:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:10.877 15:12:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:10.877 15:12:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:10.877 15:12:10 -- scripts/common.sh@335 -- # IFS=.-: 00:17:10.877 15:12:10 -- scripts/common.sh@335 -- # read -ra ver1 00:17:10.877 15:12:10 -- scripts/common.sh@336 -- # IFS=.-: 00:17:10.877 15:12:10 -- scripts/common.sh@336 -- # read -ra ver2 00:17:10.877 15:12:10 -- scripts/common.sh@337 -- # local 'op=<' 00:17:10.877 15:12:10 -- scripts/common.sh@339 -- # ver1_l=2 00:17:10.877 15:12:10 -- scripts/common.sh@340 -- # ver2_l=1 00:17:10.877 15:12:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:10.877 15:12:10 -- scripts/common.sh@343 -- # case "$op" in 00:17:10.877 15:12:10 -- scripts/common.sh@344 -- # : 1 00:17:10.877 15:12:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:10.877 15:12:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:10.877 15:12:10 -- scripts/common.sh@364 -- # decimal 1 00:17:10.877 15:12:10 -- scripts/common.sh@352 -- # local d=1 00:17:10.877 15:12:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:10.877 15:12:10 -- scripts/common.sh@354 -- # echo 1 00:17:10.877 15:12:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:10.877 15:12:10 -- scripts/common.sh@365 -- # decimal 2 00:17:10.877 15:12:10 -- scripts/common.sh@352 -- # local d=2 00:17:10.877 15:12:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:10.877 15:12:10 -- scripts/common.sh@354 -- # echo 2 00:17:10.877 15:12:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:10.877 15:12:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:10.877 15:12:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:10.877 15:12:10 -- scripts/common.sh@367 -- # return 0 00:17:10.877 15:12:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:10.877 15:12:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:10.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.877 --rc genhtml_branch_coverage=1 00:17:10.877 --rc genhtml_function_coverage=1 00:17:10.877 --rc genhtml_legend=1 00:17:10.877 --rc geninfo_all_blocks=1 00:17:10.877 --rc geninfo_unexecuted_blocks=1 00:17:10.877 00:17:10.877 ' 00:17:10.877 15:12:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:10.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.877 --rc genhtml_branch_coverage=1 00:17:10.877 --rc genhtml_function_coverage=1 00:17:10.877 --rc genhtml_legend=1 00:17:10.877 --rc geninfo_all_blocks=1 00:17:10.877 --rc geninfo_unexecuted_blocks=1 00:17:10.877 00:17:10.877 ' 00:17:10.877 15:12:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:10.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.877 --rc genhtml_branch_coverage=1 00:17:10.877 --rc genhtml_function_coverage=1 00:17:10.877 --rc genhtml_legend=1 00:17:10.877 --rc geninfo_all_blocks=1 00:17:10.877 --rc geninfo_unexecuted_blocks=1 00:17:10.877 00:17:10.877 ' 00:17:10.877 15:12:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:10.877 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:10.877 --rc genhtml_branch_coverage=1 00:17:10.877 --rc genhtml_function_coverage=1 00:17:10.877 --rc genhtml_legend=1 00:17:10.877 --rc geninfo_all_blocks=1 00:17:10.877 --rc geninfo_unexecuted_blocks=1 00:17:10.877 00:17:10.877 ' 00:17:10.877 15:12:10 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:10.877 15:12:10 -- nvmf/common.sh@7 -- # uname -s 00:17:10.877 15:12:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:10.877 15:12:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:10.877 15:12:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:10.877 15:12:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:10.877 15:12:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:10.877 15:12:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:10.877 15:12:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:10.877 15:12:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:10.877 15:12:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:10.877 15:12:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:10.877 15:12:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.877 15:12:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:10.877 15:12:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:10.877 15:12:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:10.877 15:12:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:10.877 15:12:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:10.877 15:12:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:10.877 15:12:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:10.877 15:12:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:10.877 15:12:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.877 15:12:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.877 15:12:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.877 15:12:10 -- paths/export.sh@5 -- # export PATH 00:17:10.877 15:12:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:10.877 15:12:10 -- nvmf/common.sh@46 -- # : 0 00:17:10.877 15:12:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:10.877 15:12:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:10.877 15:12:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:10.877 15:12:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:10.877 15:12:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:10.877 15:12:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:10.877 15:12:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:10.877 15:12:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:10.877 15:12:10 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:10.877 15:12:10 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:10.877 15:12:10 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:10.877 15:12:10 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:10.877 15:12:10 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:10.878 15:12:10 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:10.878 15:12:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:10.878 15:12:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:10.878 15:12:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:10.878 15:12:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:10.878 15:12:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:10.878 15:12:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.878 15:12:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.878 15:12:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:10.878 15:12:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:10.878 15:12:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:10.878 15:12:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:10.878 15:12:10 -- common/autotest_common.sh@10 -- # set +x 00:17:12.778 15:12:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:12.778 15:12:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:12.778 15:12:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:12.778 15:12:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:12.778 15:12:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:12.778 15:12:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:12.778 15:12:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:12.778 15:12:12 -- nvmf/common.sh@294 -- # net_devs=() 00:17:12.778 15:12:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:12.778 15:12:12 -- nvmf/common.sh@295 -- # e810=() 00:17:12.778 15:12:12 -- nvmf/common.sh@295 -- # local -ga e810 00:17:12.778 15:12:12 -- nvmf/common.sh@296 -- # x722=() 00:17:12.778 15:12:12 -- nvmf/common.sh@296 -- # local -ga x722 00:17:12.778 15:12:12 -- nvmf/common.sh@297 -- # mlx=() 00:17:12.778 15:12:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:12.778 15:12:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:12.778 15:12:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:12.778 15:12:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:12.778 15:12:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:12.778 15:12:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:12.778 15:12:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:12.778 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:12.778 15:12:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:12.778 15:12:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:12.778 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:12.778 15:12:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:12.778 15:12:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:12.778 15:12:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:12.778 15:12:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:12.778 15:12:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:12.778 15:12:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:12.778 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:12.778 15:12:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:12.778 15:12:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:12.778 15:12:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:12.778 15:12:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:12.778 15:12:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:12.778 15:12:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:12.778 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:12.778 15:12:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:12.778 15:12:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:12.778 15:12:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:12.778 15:12:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:12.778 15:12:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:12.778 15:12:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:12.778 15:12:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:12.778 15:12:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:12.778 15:12:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:12.778 15:12:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:12.778 15:12:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:12.778 15:12:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:12.778 15:12:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:12.778 15:12:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:12.778 15:12:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:12.779 15:12:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:12.779 15:12:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:12.779 15:12:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:12.779 15:12:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:12.779 15:12:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:12.779 15:12:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:12.779 15:12:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:12.779 15:12:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:12.779 15:12:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:12.779 15:12:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:12.779 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:12.779 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:17:12.779 00:17:12.779 --- 10.0.0.2 ping statistics --- 00:17:12.779 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.779 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:17:12.779 15:12:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:12.779 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:12.779 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:17:12.779 00:17:12.779 --- 10.0.0.1 ping statistics --- 00:17:12.779 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.779 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:17:12.779 15:12:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:12.779 15:12:12 -- nvmf/common.sh@410 -- # return 0 00:17:12.779 15:12:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:12.779 15:12:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:12.779 15:12:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:12.779 15:12:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:12.779 15:12:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:12.779 15:12:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:12.779 15:12:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:13.038 15:12:13 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:13.038 15:12:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:13.038 15:12:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:13.038 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:17:13.038 15:12:13 -- nvmf/common.sh@469 -- # nvmfpid=698580 00:17:13.038 15:12:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:13.038 15:12:13 -- nvmf/common.sh@470 -- # waitforlisten 698580 00:17:13.038 15:12:13 -- common/autotest_common.sh@829 -- # '[' -z 698580 ']' 00:17:13.038 15:12:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:13.038 15:12:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:13.038 15:12:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:13.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:13.038 15:12:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:13.038 15:12:13 -- common/autotest_common.sh@10 -- # set +x 00:17:13.038 [2024-11-28 15:12:13.076448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:13.038 [2024-11-28 15:12:13.076531] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:13.038 EAL: No free 2048 kB hugepages reported on node 1 00:17:13.038 [2024-11-28 15:12:13.141088] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:13.038 [2024-11-28 15:12:13.228157] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:13.038 [2024-11-28 15:12:13.228295] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:13.038 [2024-11-28 15:12:13.228313] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:13.038 [2024-11-28 15:12:13.228325] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:13.038 [2024-11-28 15:12:13.228486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:13.038 [2024-11-28 15:12:13.228551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:13.038 [2024-11-28 15:12:13.228554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:13.972 15:12:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.972 15:12:14 -- common/autotest_common.sh@862 -- # return 0 00:17:13.972 15:12:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:13.973 15:12:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:13.973 15:12:14 -- common/autotest_common.sh@10 -- # set +x 00:17:13.973 15:12:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:13.973 15:12:14 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:14.231 [2024-11-28 15:12:14.322704] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:14.231 15:12:14 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:14.489 15:12:14 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:14.489 15:12:14 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:14.748 15:12:14 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:14.748 15:12:14 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:15.004 15:12:15 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:15.261 15:12:15 -- target/nvmf_lvol.sh@29 -- # lvs=fab3fc21-9cc7-4dc6-accb-10360f5d2675 00:17:15.261 15:12:15 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u fab3fc21-9cc7-4dc6-accb-10360f5d2675 lvol 20 00:17:15.519 15:12:15 -- target/nvmf_lvol.sh@32 -- # lvol=e2677678-70f6-43cb-9bf9-5cfe2b08fe00 00:17:15.519 15:12:15 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:15.777 15:12:15 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 e2677678-70f6-43cb-9bf9-5cfe2b08fe00 00:17:16.035 15:12:16 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:16.292 [2024-11-28 15:12:16.404100] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:16.292 15:12:16 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:16.550 15:12:16 -- target/nvmf_lvol.sh@42 -- # perf_pid=699117 00:17:16.550 15:12:16 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:16.550 15:12:16 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:16.550 EAL: No free 2048 kB hugepages reported on node 1 00:17:17.485 15:12:17 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot e2677678-70f6-43cb-9bf9-5cfe2b08fe00 MY_SNAPSHOT 00:17:17.744 15:12:17 -- target/nvmf_lvol.sh@47 -- # snapshot=879406e6-03b2-4cd5-b986-876a1800d2dd 00:17:18.035 15:12:17 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize e2677678-70f6-43cb-9bf9-5cfe2b08fe00 30 00:17:18.293 15:12:18 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 879406e6-03b2-4cd5-b986-876a1800d2dd MY_CLONE 00:17:18.551 15:12:18 -- target/nvmf_lvol.sh@49 -- # clone=4dbffa0a-3727-4f5f-a590-5229946f4979 00:17:18.551 15:12:18 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 4dbffa0a-3727-4f5f-a590-5229946f4979 00:17:19.116 15:12:19 -- target/nvmf_lvol.sh@53 -- # wait 699117 00:17:27.247 Initializing NVMe Controllers 00:17:27.247 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:27.247 Controller IO queue size 128, less than required. 00:17:27.247 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:27.247 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:27.247 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:27.247 Initialization complete. Launching workers. 00:17:27.247 ======================================================== 00:17:27.247 Latency(us) 00:17:27.247 Device Information : IOPS MiB/s Average min max 00:17:27.247 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10965.70 42.83 11673.63 1118.57 71543.78 00:17:27.247 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10681.40 41.72 11984.48 1841.23 60582.91 00:17:27.247 ======================================================== 00:17:27.247 Total : 21647.10 84.56 11827.01 1118.57 71543.78 00:17:27.247 00:17:27.247 15:12:26 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:27.247 15:12:27 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e2677678-70f6-43cb-9bf9-5cfe2b08fe00 00:17:27.505 15:12:27 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u fab3fc21-9cc7-4dc6-accb-10360f5d2675 00:17:27.763 15:12:27 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:27.763 15:12:27 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:27.763 15:12:27 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:27.763 15:12:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:27.763 15:12:27 -- nvmf/common.sh@116 -- # sync 00:17:27.763 15:12:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:27.763 15:12:27 -- nvmf/common.sh@119 -- # set +e 00:17:27.763 15:12:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:27.763 15:12:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:27.763 rmmod nvme_tcp 00:17:27.763 rmmod nvme_fabrics 00:17:27.763 rmmod nvme_keyring 00:17:27.763 15:12:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:27.763 15:12:27 -- nvmf/common.sh@123 -- # set -e 00:17:27.763 15:12:27 -- nvmf/common.sh@124 -- # return 0 00:17:27.763 15:12:27 -- nvmf/common.sh@477 -- # '[' -n 698580 ']' 00:17:27.763 15:12:27 -- nvmf/common.sh@478 -- # killprocess 698580 00:17:27.763 15:12:27 -- common/autotest_common.sh@936 -- # '[' -z 698580 ']' 00:17:27.763 15:12:27 -- common/autotest_common.sh@940 -- # kill -0 698580 00:17:27.763 15:12:27 -- common/autotest_common.sh@941 -- # uname 00:17:27.763 15:12:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:27.763 15:12:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 698580 00:17:27.763 15:12:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:27.763 15:12:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:27.763 15:12:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 698580' 00:17:27.763 killing process with pid 698580 00:17:27.763 15:12:27 -- common/autotest_common.sh@955 -- # kill 698580 00:17:27.763 15:12:27 -- common/autotest_common.sh@960 -- # wait 698580 00:17:28.022 15:12:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:28.022 15:12:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:28.022 15:12:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:28.022 15:12:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:28.022 15:12:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:28.022 15:12:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.022 15:12:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.022 15:12:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:30.557 15:12:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:30.557 00:17:30.557 real 0m19.581s 00:17:30.557 user 1m6.376s 00:17:30.557 sys 0m5.400s 00:17:30.557 15:12:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:30.557 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:17:30.557 ************************************ 00:17:30.557 END TEST nvmf_lvol 00:17:30.557 ************************************ 00:17:30.557 15:12:30 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:30.557 15:12:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:30.557 15:12:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:30.557 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:17:30.557 ************************************ 00:17:30.557 START TEST nvmf_lvs_grow 00:17:30.557 ************************************ 00:17:30.557 15:12:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:30.557 * Looking for test storage... 00:17:30.557 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:30.557 15:12:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:30.557 15:12:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:30.557 15:12:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:30.557 15:12:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:30.557 15:12:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:30.557 15:12:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:30.557 15:12:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:30.557 15:12:30 -- scripts/common.sh@335 -- # IFS=.-: 00:17:30.557 15:12:30 -- scripts/common.sh@335 -- # read -ra ver1 00:17:30.557 15:12:30 -- scripts/common.sh@336 -- # IFS=.-: 00:17:30.557 15:12:30 -- scripts/common.sh@336 -- # read -ra ver2 00:17:30.557 15:12:30 -- scripts/common.sh@337 -- # local 'op=<' 00:17:30.557 15:12:30 -- scripts/common.sh@339 -- # ver1_l=2 00:17:30.557 15:12:30 -- scripts/common.sh@340 -- # ver2_l=1 00:17:30.557 15:12:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:30.557 15:12:30 -- scripts/common.sh@343 -- # case "$op" in 00:17:30.557 15:12:30 -- scripts/common.sh@344 -- # : 1 00:17:30.557 15:12:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:30.557 15:12:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:30.557 15:12:30 -- scripts/common.sh@364 -- # decimal 1 00:17:30.557 15:12:30 -- scripts/common.sh@352 -- # local d=1 00:17:30.557 15:12:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:30.557 15:12:30 -- scripts/common.sh@354 -- # echo 1 00:17:30.557 15:12:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:30.557 15:12:30 -- scripts/common.sh@365 -- # decimal 2 00:17:30.557 15:12:30 -- scripts/common.sh@352 -- # local d=2 00:17:30.557 15:12:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:30.557 15:12:30 -- scripts/common.sh@354 -- # echo 2 00:17:30.557 15:12:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:30.557 15:12:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:30.557 15:12:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:30.557 15:12:30 -- scripts/common.sh@367 -- # return 0 00:17:30.557 15:12:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:30.557 15:12:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:30.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.557 --rc genhtml_branch_coverage=1 00:17:30.557 --rc genhtml_function_coverage=1 00:17:30.557 --rc genhtml_legend=1 00:17:30.557 --rc geninfo_all_blocks=1 00:17:30.557 --rc geninfo_unexecuted_blocks=1 00:17:30.557 00:17:30.557 ' 00:17:30.557 15:12:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:30.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.557 --rc genhtml_branch_coverage=1 00:17:30.557 --rc genhtml_function_coverage=1 00:17:30.557 --rc genhtml_legend=1 00:17:30.557 --rc geninfo_all_blocks=1 00:17:30.557 --rc geninfo_unexecuted_blocks=1 00:17:30.557 00:17:30.557 ' 00:17:30.557 15:12:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:30.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.557 --rc genhtml_branch_coverage=1 00:17:30.557 --rc genhtml_function_coverage=1 00:17:30.557 --rc genhtml_legend=1 00:17:30.557 --rc geninfo_all_blocks=1 00:17:30.557 --rc geninfo_unexecuted_blocks=1 00:17:30.557 00:17:30.557 ' 00:17:30.557 15:12:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:30.557 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:30.557 --rc genhtml_branch_coverage=1 00:17:30.557 --rc genhtml_function_coverage=1 00:17:30.557 --rc genhtml_legend=1 00:17:30.557 --rc geninfo_all_blocks=1 00:17:30.557 --rc geninfo_unexecuted_blocks=1 00:17:30.557 00:17:30.557 ' 00:17:30.557 15:12:30 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:30.557 15:12:30 -- nvmf/common.sh@7 -- # uname -s 00:17:30.557 15:12:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:30.557 15:12:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:30.557 15:12:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:30.557 15:12:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:30.557 15:12:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:30.557 15:12:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:30.557 15:12:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:30.557 15:12:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:30.557 15:12:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:30.557 15:12:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:30.557 15:12:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:30.557 15:12:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:30.557 15:12:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:30.557 15:12:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:30.557 15:12:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:30.557 15:12:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:30.557 15:12:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:30.557 15:12:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:30.557 15:12:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:30.557 15:12:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.558 15:12:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.558 15:12:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.558 15:12:30 -- paths/export.sh@5 -- # export PATH 00:17:30.558 15:12:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:30.558 15:12:30 -- nvmf/common.sh@46 -- # : 0 00:17:30.558 15:12:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:30.558 15:12:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:30.558 15:12:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:30.558 15:12:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:30.558 15:12:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:30.558 15:12:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:30.558 15:12:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:30.558 15:12:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:30.558 15:12:30 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:30.558 15:12:30 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:30.558 15:12:30 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:30.558 15:12:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:30.558 15:12:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:30.558 15:12:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:30.558 15:12:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:30.558 15:12:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:30.558 15:12:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:30.558 15:12:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:30.558 15:12:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:30.558 15:12:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:30.558 15:12:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:30.558 15:12:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:30.558 15:12:30 -- common/autotest_common.sh@10 -- # set +x 00:17:32.579 15:12:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:32.579 15:12:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:32.579 15:12:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:32.579 15:12:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:32.579 15:12:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:32.579 15:12:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:32.579 15:12:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:32.579 15:12:32 -- nvmf/common.sh@294 -- # net_devs=() 00:17:32.579 15:12:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:32.579 15:12:32 -- nvmf/common.sh@295 -- # e810=() 00:17:32.579 15:12:32 -- nvmf/common.sh@295 -- # local -ga e810 00:17:32.579 15:12:32 -- nvmf/common.sh@296 -- # x722=() 00:17:32.579 15:12:32 -- nvmf/common.sh@296 -- # local -ga x722 00:17:32.579 15:12:32 -- nvmf/common.sh@297 -- # mlx=() 00:17:32.579 15:12:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:32.579 15:12:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:32.579 15:12:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:32.579 15:12:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:32.579 15:12:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:32.579 15:12:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:32.579 15:12:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:32.579 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:32.579 15:12:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:32.579 15:12:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:32.579 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:32.579 15:12:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:32.579 15:12:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:32.579 15:12:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.579 15:12:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:32.579 15:12:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.579 15:12:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:32.579 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:32.579 15:12:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.579 15:12:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:32.579 15:12:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:32.579 15:12:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:32.579 15:12:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:32.579 15:12:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:32.579 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:32.579 15:12:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:32.579 15:12:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:32.579 15:12:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:32.579 15:12:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:32.579 15:12:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:32.579 15:12:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:32.579 15:12:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:32.579 15:12:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:32.579 15:12:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:32.579 15:12:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:32.579 15:12:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:32.579 15:12:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:32.579 15:12:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:32.579 15:12:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:32.579 15:12:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:32.579 15:12:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:32.579 15:12:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:32.579 15:12:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:32.579 15:12:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:32.579 15:12:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:32.579 15:12:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:32.579 15:12:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:32.579 15:12:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:32.579 15:12:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:32.579 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:32.579 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.301 ms 00:17:32.579 00:17:32.579 --- 10.0.0.2 ping statistics --- 00:17:32.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:32.579 rtt min/avg/max/mdev = 0.301/0.301/0.301/0.000 ms 00:17:32.579 15:12:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:32.579 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:32.579 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:17:32.579 00:17:32.579 --- 10.0.0.1 ping statistics --- 00:17:32.579 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:32.579 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:17:32.579 15:12:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:32.579 15:12:32 -- nvmf/common.sh@410 -- # return 0 00:17:32.579 15:12:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:32.579 15:12:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:32.579 15:12:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:32.579 15:12:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:32.579 15:12:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:32.579 15:12:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:32.579 15:12:32 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:32.579 15:12:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:32.579 15:12:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:32.579 15:12:32 -- common/autotest_common.sh@10 -- # set +x 00:17:32.579 15:12:32 -- nvmf/common.sh@469 -- # nvmfpid=702431 00:17:32.580 15:12:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:32.580 15:12:32 -- nvmf/common.sh@470 -- # waitforlisten 702431 00:17:32.580 15:12:32 -- common/autotest_common.sh@829 -- # '[' -z 702431 ']' 00:17:32.580 15:12:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:32.580 15:12:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:32.580 15:12:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:32.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:32.580 15:12:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:32.580 15:12:32 -- common/autotest_common.sh@10 -- # set +x 00:17:32.580 [2024-11-28 15:12:32.600771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:32.580 [2024-11-28 15:12:32.600848] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:32.580 EAL: No free 2048 kB hugepages reported on node 1 00:17:32.580 [2024-11-28 15:12:32.665603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:32.580 [2024-11-28 15:12:32.751686] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:32.580 [2024-11-28 15:12:32.751838] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:32.580 [2024-11-28 15:12:32.751855] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:32.580 [2024-11-28 15:12:32.751868] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:32.580 [2024-11-28 15:12:32.751894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:33.515 15:12:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:33.515 15:12:33 -- common/autotest_common.sh@862 -- # return 0 00:17:33.515 15:12:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:33.515 15:12:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:33.515 15:12:33 -- common/autotest_common.sh@10 -- # set +x 00:17:33.515 15:12:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:33.515 15:12:33 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:33.774 [2024-11-28 15:12:33.875261] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:33.774 15:12:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:33.774 15:12:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:33.774 15:12:33 -- common/autotest_common.sh@10 -- # set +x 00:17:33.774 ************************************ 00:17:33.774 START TEST lvs_grow_clean 00:17:33.774 ************************************ 00:17:33.774 15:12:33 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:33.774 15:12:33 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:34.033 15:12:34 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:34.033 15:12:34 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:34.291 15:12:34 -- target/nvmf_lvs_grow.sh@28 -- # lvs=12b40742-1f93-4e50-9251-8ce546effccd 00:17:34.291 15:12:34 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:34.291 15:12:34 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:34.549 15:12:34 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:34.549 15:12:34 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:34.549 15:12:34 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 12b40742-1f93-4e50-9251-8ce546effccd lvol 150 00:17:34.807 15:12:34 -- target/nvmf_lvs_grow.sh@33 -- # lvol=37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9 00:17:34.807 15:12:34 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:34.807 15:12:34 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:35.065 [2024-11-28 15:12:35.173426] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:35.065 [2024-11-28 15:12:35.173502] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:35.065 true 00:17:35.065 15:12:35 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:35.065 15:12:35 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:35.323 15:12:35 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:35.323 15:12:35 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:35.581 15:12:35 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9 00:17:35.839 15:12:36 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:36.098 [2024-11-28 15:12:36.244714] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:36.098 15:12:36 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:36.357 15:12:36 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=702894 00:17:36.357 15:12:36 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:36.357 15:12:36 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:36.357 15:12:36 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 702894 /var/tmp/bdevperf.sock 00:17:36.357 15:12:36 -- common/autotest_common.sh@829 -- # '[' -z 702894 ']' 00:17:36.357 15:12:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:36.357 15:12:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:36.357 15:12:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:36.357 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:36.357 15:12:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:36.357 15:12:36 -- common/autotest_common.sh@10 -- # set +x 00:17:36.357 [2024-11-28 15:12:36.544210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:36.357 [2024-11-28 15:12:36.544274] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid702894 ] 00:17:36.357 EAL: No free 2048 kB hugepages reported on node 1 00:17:36.616 [2024-11-28 15:12:36.604948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:36.616 [2024-11-28 15:12:36.693941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:37.552 15:12:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:37.552 15:12:37 -- common/autotest_common.sh@862 -- # return 0 00:17:37.552 15:12:37 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:37.810 Nvme0n1 00:17:37.810 15:12:37 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:38.069 [ 00:17:38.069 { 00:17:38.069 "name": "Nvme0n1", 00:17:38.069 "aliases": [ 00:17:38.069 "37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9" 00:17:38.069 ], 00:17:38.069 "product_name": "NVMe disk", 00:17:38.069 "block_size": 4096, 00:17:38.069 "num_blocks": 38912, 00:17:38.069 "uuid": "37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9", 00:17:38.069 "assigned_rate_limits": { 00:17:38.069 "rw_ios_per_sec": 0, 00:17:38.069 "rw_mbytes_per_sec": 0, 00:17:38.069 "r_mbytes_per_sec": 0, 00:17:38.069 "w_mbytes_per_sec": 0 00:17:38.069 }, 00:17:38.069 "claimed": false, 00:17:38.069 "zoned": false, 00:17:38.069 "supported_io_types": { 00:17:38.069 "read": true, 00:17:38.069 "write": true, 00:17:38.069 "unmap": true, 00:17:38.069 "write_zeroes": true, 00:17:38.069 "flush": true, 00:17:38.069 "reset": true, 00:17:38.069 "compare": true, 00:17:38.069 "compare_and_write": true, 00:17:38.069 "abort": true, 00:17:38.069 "nvme_admin": true, 00:17:38.069 "nvme_io": true 00:17:38.069 }, 00:17:38.069 "driver_specific": { 00:17:38.069 "nvme": [ 00:17:38.069 { 00:17:38.069 "trid": { 00:17:38.069 "trtype": "TCP", 00:17:38.069 "adrfam": "IPv4", 00:17:38.069 "traddr": "10.0.0.2", 00:17:38.069 "trsvcid": "4420", 00:17:38.069 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:38.069 }, 00:17:38.069 "ctrlr_data": { 00:17:38.069 "cntlid": 1, 00:17:38.069 "vendor_id": "0x8086", 00:17:38.069 "model_number": "SPDK bdev Controller", 00:17:38.069 "serial_number": "SPDK0", 00:17:38.069 "firmware_revision": "24.01.1", 00:17:38.069 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:38.069 "oacs": { 00:17:38.069 "security": 0, 00:17:38.069 "format": 0, 00:17:38.069 "firmware": 0, 00:17:38.069 "ns_manage": 0 00:17:38.069 }, 00:17:38.069 "multi_ctrlr": true, 00:17:38.069 "ana_reporting": false 00:17:38.069 }, 00:17:38.069 "vs": { 00:17:38.069 "nvme_version": "1.3" 00:17:38.069 }, 00:17:38.069 "ns_data": { 00:17:38.069 "id": 1, 00:17:38.069 "can_share": true 00:17:38.069 } 00:17:38.069 } 00:17:38.069 ], 00:17:38.069 "mp_policy": "active_passive" 00:17:38.069 } 00:17:38.069 } 00:17:38.069 ] 00:17:38.069 15:12:38 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=703163 00:17:38.069 15:12:38 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:38.069 15:12:38 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:38.069 Running I/O for 10 seconds... 00:17:39.444 Latency(us) 00:17:39.444 [2024-11-28T14:12:39.678Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:39.444 [2024-11-28T14:12:39.678Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.444 Nvme0n1 : 1.00 14670.00 57.30 0.00 0.00 0.00 0.00 0.00 00:17:39.444 [2024-11-28T14:12:39.678Z] =================================================================================================================== 00:17:39.444 [2024-11-28T14:12:39.678Z] Total : 14670.00 57.30 0.00 0.00 0.00 0.00 0.00 00:17:39.444 00:17:40.011 15:12:40 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:40.011 [2024-11-28T14:12:40.245Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.011 Nvme0n1 : 2.00 14776.00 57.72 0.00 0.00 0.00 0.00 0.00 00:17:40.011 [2024-11-28T14:12:40.245Z] =================================================================================================================== 00:17:40.011 [2024-11-28T14:12:40.245Z] Total : 14776.00 57.72 0.00 0.00 0.00 0.00 0.00 00:17:40.011 00:17:40.269 true 00:17:40.269 15:12:40 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:40.269 15:12:40 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:40.528 15:12:40 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:40.528 15:12:40 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:40.528 15:12:40 -- target/nvmf_lvs_grow.sh@65 -- # wait 703163 00:17:41.097 [2024-11-28T14:12:41.331Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.097 Nvme0n1 : 3.00 14868.33 58.08 0.00 0.00 0.00 0.00 0.00 00:17:41.097 [2024-11-28T14:12:41.331Z] =================================================================================================================== 00:17:41.097 [2024-11-28T14:12:41.331Z] Total : 14868.33 58.08 0.00 0.00 0.00 0.00 0.00 00:17:41.097 00:17:42.031 [2024-11-28T14:12:42.265Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.031 Nvme0n1 : 4.00 14961.75 58.44 0.00 0.00 0.00 0.00 0.00 00:17:42.031 [2024-11-28T14:12:42.265Z] =================================================================================================================== 00:17:42.031 [2024-11-28T14:12:42.265Z] Total : 14961.75 58.44 0.00 0.00 0.00 0.00 0.00 00:17:42.031 00:17:43.406 [2024-11-28T14:12:43.640Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.406 Nvme0n1 : 5.00 15030.40 58.71 0.00 0.00 0.00 0.00 0.00 00:17:43.406 [2024-11-28T14:12:43.640Z] =================================================================================================================== 00:17:43.406 [2024-11-28T14:12:43.640Z] Total : 15030.40 58.71 0.00 0.00 0.00 0.00 0.00 00:17:43.406 00:17:44.341 [2024-11-28T14:12:44.575Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.341 Nvme0n1 : 6.00 15086.50 58.93 0.00 0.00 0.00 0.00 0.00 00:17:44.341 [2024-11-28T14:12:44.575Z] =================================================================================================================== 00:17:44.341 [2024-11-28T14:12:44.575Z] Total : 15086.50 58.93 0.00 0.00 0.00 0.00 0.00 00:17:44.341 00:17:45.276 [2024-11-28T14:12:45.510Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.276 Nvme0n1 : 7.00 15131.57 59.11 0.00 0.00 0.00 0.00 0.00 00:17:45.276 [2024-11-28T14:12:45.510Z] =================================================================================================================== 00:17:45.276 [2024-11-28T14:12:45.510Z] Total : 15131.57 59.11 0.00 0.00 0.00 0.00 0.00 00:17:45.276 00:17:46.212 [2024-11-28T14:12:46.446Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.212 Nvme0n1 : 8.00 15169.50 59.26 0.00 0.00 0.00 0.00 0.00 00:17:46.212 [2024-11-28T14:12:46.446Z] =================================================================================================================== 00:17:46.212 [2024-11-28T14:12:46.446Z] Total : 15169.50 59.26 0.00 0.00 0.00 0.00 0.00 00:17:46.212 00:17:47.148 [2024-11-28T14:12:47.382Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:47.148 Nvme0n1 : 9.00 15255.44 59.59 0.00 0.00 0.00 0.00 0.00 00:17:47.148 [2024-11-28T14:12:47.382Z] =================================================================================================================== 00:17:47.148 [2024-11-28T14:12:47.382Z] Total : 15255.44 59.59 0.00 0.00 0.00 0.00 0.00 00:17:47.148 00:17:48.083 [2024-11-28T14:12:48.317Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.084 Nvme0n1 : 10.00 15279.30 59.68 0.00 0.00 0.00 0.00 0.00 00:17:48.084 [2024-11-28T14:12:48.318Z] =================================================================================================================== 00:17:48.084 [2024-11-28T14:12:48.318Z] Total : 15279.30 59.68 0.00 0.00 0.00 0.00 0.00 00:17:48.084 00:17:48.084 00:17:48.084 Latency(us) 00:17:48.084 [2024-11-28T14:12:48.318Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.084 [2024-11-28T14:12:48.318Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:48.084 Nvme0n1 : 10.01 15281.10 59.69 0.00 0.00 8371.58 2281.62 16505.36 00:17:48.084 [2024-11-28T14:12:48.318Z] =================================================================================================================== 00:17:48.084 [2024-11-28T14:12:48.318Z] Total : 15281.10 59.69 0.00 0.00 8371.58 2281.62 16505.36 00:17:48.084 0 00:17:48.084 15:12:48 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 702894 00:17:48.084 15:12:48 -- common/autotest_common.sh@936 -- # '[' -z 702894 ']' 00:17:48.084 15:12:48 -- common/autotest_common.sh@940 -- # kill -0 702894 00:17:48.084 15:12:48 -- common/autotest_common.sh@941 -- # uname 00:17:48.084 15:12:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:48.084 15:12:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 702894 00:17:48.342 15:12:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:48.342 15:12:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:48.342 15:12:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 702894' 00:17:48.342 killing process with pid 702894 00:17:48.342 15:12:48 -- common/autotest_common.sh@955 -- # kill 702894 00:17:48.342 Received shutdown signal, test time was about 10.000000 seconds 00:17:48.342 00:17:48.342 Latency(us) 00:17:48.342 [2024-11-28T14:12:48.576Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:48.342 [2024-11-28T14:12:48.576Z] =================================================================================================================== 00:17:48.342 [2024-11-28T14:12:48.576Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:48.342 15:12:48 -- common/autotest_common.sh@960 -- # wait 702894 00:17:48.342 15:12:48 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:48.600 15:12:48 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:48.600 15:12:48 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:48.859 15:12:49 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:48.859 15:12:49 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:48.859 15:12:49 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:49.117 [2024-11-28 15:12:49.275962] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:49.117 15:12:49 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:49.117 15:12:49 -- common/autotest_common.sh@650 -- # local es=0 00:17:49.117 15:12:49 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:49.117 15:12:49 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.117 15:12:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.117 15:12:49 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.117 15:12:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.117 15:12:49 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.117 15:12:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.117 15:12:49 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.117 15:12:49 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:49.117 15:12:49 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:49.376 request: 00:17:49.376 { 00:17:49.376 "uuid": "12b40742-1f93-4e50-9251-8ce546effccd", 00:17:49.376 "method": "bdev_lvol_get_lvstores", 00:17:49.376 "req_id": 1 00:17:49.376 } 00:17:49.376 Got JSON-RPC error response 00:17:49.376 response: 00:17:49.376 { 00:17:49.376 "code": -19, 00:17:49.376 "message": "No such device" 00:17:49.376 } 00:17:49.376 15:12:49 -- common/autotest_common.sh@653 -- # es=1 00:17:49.376 15:12:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:49.376 15:12:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:49.376 15:12:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:49.376 15:12:49 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:49.634 aio_bdev 00:17:49.634 15:12:49 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9 00:17:49.634 15:12:49 -- common/autotest_common.sh@897 -- # local bdev_name=37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9 00:17:49.634 15:12:49 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:49.634 15:12:49 -- common/autotest_common.sh@899 -- # local i 00:17:49.634 15:12:49 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:49.634 15:12:49 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:49.634 15:12:49 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:49.892 15:12:50 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9 -t 2000 00:17:50.151 [ 00:17:50.151 { 00:17:50.151 "name": "37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9", 00:17:50.151 "aliases": [ 00:17:50.151 "lvs/lvol" 00:17:50.151 ], 00:17:50.151 "product_name": "Logical Volume", 00:17:50.151 "block_size": 4096, 00:17:50.151 "num_blocks": 38912, 00:17:50.151 "uuid": "37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9", 00:17:50.151 "assigned_rate_limits": { 00:17:50.151 "rw_ios_per_sec": 0, 00:17:50.151 "rw_mbytes_per_sec": 0, 00:17:50.151 "r_mbytes_per_sec": 0, 00:17:50.151 "w_mbytes_per_sec": 0 00:17:50.151 }, 00:17:50.151 "claimed": false, 00:17:50.151 "zoned": false, 00:17:50.151 "supported_io_types": { 00:17:50.151 "read": true, 00:17:50.151 "write": true, 00:17:50.151 "unmap": true, 00:17:50.151 "write_zeroes": true, 00:17:50.151 "flush": false, 00:17:50.151 "reset": true, 00:17:50.151 "compare": false, 00:17:50.151 "compare_and_write": false, 00:17:50.151 "abort": false, 00:17:50.151 "nvme_admin": false, 00:17:50.151 "nvme_io": false 00:17:50.151 }, 00:17:50.151 "driver_specific": { 00:17:50.151 "lvol": { 00:17:50.151 "lvol_store_uuid": "12b40742-1f93-4e50-9251-8ce546effccd", 00:17:50.151 "base_bdev": "aio_bdev", 00:17:50.151 "thin_provision": false, 00:17:50.151 "snapshot": false, 00:17:50.151 "clone": false, 00:17:50.151 "esnap_clone": false 00:17:50.151 } 00:17:50.151 } 00:17:50.151 } 00:17:50.151 ] 00:17:50.151 15:12:50 -- common/autotest_common.sh@905 -- # return 0 00:17:50.151 15:12:50 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:50.151 15:12:50 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:50.409 15:12:50 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:50.410 15:12:50 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:50.410 15:12:50 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:50.667 15:12:50 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:50.667 15:12:50 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 37e0b1bf-33b3-44d9-8b61-4a1a4205d1b9 00:17:50.925 15:12:51 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 12b40742-1f93-4e50-9251-8ce546effccd 00:17:51.182 15:12:51 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:51.441 15:12:51 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.441 00:17:51.441 real 0m17.778s 00:17:51.441 user 0m17.567s 00:17:51.441 sys 0m1.797s 00:17:51.441 15:12:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:51.441 15:12:51 -- common/autotest_common.sh@10 -- # set +x 00:17:51.441 ************************************ 00:17:51.441 END TEST lvs_grow_clean 00:17:51.441 ************************************ 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:51.699 15:12:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:51.699 15:12:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:51.699 15:12:51 -- common/autotest_common.sh@10 -- # set +x 00:17:51.699 ************************************ 00:17:51.699 START TEST lvs_grow_dirty 00:17:51.699 ************************************ 00:17:51.699 15:12:51 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.699 15:12:51 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:51.957 15:12:51 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:51.958 15:12:51 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:52.216 15:12:52 -- target/nvmf_lvs_grow.sh@28 -- # lvs=2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:17:52.216 15:12:52 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:17:52.216 15:12:52 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:52.475 15:12:52 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:52.475 15:12:52 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:52.475 15:12:52 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 lvol 150 00:17:52.733 15:12:52 -- target/nvmf_lvs_grow.sh@33 -- # lvol=43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:17:52.733 15:12:52 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:52.734 15:12:52 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:52.992 [2024-11-28 15:12:53.004554] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:52.992 [2024-11-28 15:12:53.004631] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:52.992 true 00:17:52.992 15:12:53 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:17:52.992 15:12:53 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:53.250 15:12:53 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:53.250 15:12:53 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:53.509 15:12:53 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:17:53.768 15:12:53 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:54.026 15:12:54 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:54.285 15:12:54 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=705130 00:17:54.285 15:12:54 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:54.285 15:12:54 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:54.285 15:12:54 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 705130 /var/tmp/bdevperf.sock 00:17:54.285 15:12:54 -- common/autotest_common.sh@829 -- # '[' -z 705130 ']' 00:17:54.285 15:12:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:54.285 15:12:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:54.285 15:12:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:54.285 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:54.285 15:12:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:54.285 15:12:54 -- common/autotest_common.sh@10 -- # set +x 00:17:54.285 [2024-11-28 15:12:54.313326] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:17:54.285 [2024-11-28 15:12:54.313407] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid705130 ] 00:17:54.285 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.285 [2024-11-28 15:12:54.373266] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:54.285 [2024-11-28 15:12:54.463408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:55.219 15:12:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:55.219 15:12:55 -- common/autotest_common.sh@862 -- # return 0 00:17:55.219 15:12:55 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:55.476 Nvme0n1 00:17:55.476 15:12:55 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:55.733 [ 00:17:55.734 { 00:17:55.734 "name": "Nvme0n1", 00:17:55.734 "aliases": [ 00:17:55.734 "43c1fa9b-c7a8-4ac1-9367-9a29706b9b55" 00:17:55.734 ], 00:17:55.734 "product_name": "NVMe disk", 00:17:55.734 "block_size": 4096, 00:17:55.734 "num_blocks": 38912, 00:17:55.734 "uuid": "43c1fa9b-c7a8-4ac1-9367-9a29706b9b55", 00:17:55.734 "assigned_rate_limits": { 00:17:55.734 "rw_ios_per_sec": 0, 00:17:55.734 "rw_mbytes_per_sec": 0, 00:17:55.734 "r_mbytes_per_sec": 0, 00:17:55.734 "w_mbytes_per_sec": 0 00:17:55.734 }, 00:17:55.734 "claimed": false, 00:17:55.734 "zoned": false, 00:17:55.734 "supported_io_types": { 00:17:55.734 "read": true, 00:17:55.734 "write": true, 00:17:55.734 "unmap": true, 00:17:55.734 "write_zeroes": true, 00:17:55.734 "flush": true, 00:17:55.734 "reset": true, 00:17:55.734 "compare": true, 00:17:55.734 "compare_and_write": true, 00:17:55.734 "abort": true, 00:17:55.734 "nvme_admin": true, 00:17:55.734 "nvme_io": true 00:17:55.734 }, 00:17:55.734 "driver_specific": { 00:17:55.734 "nvme": [ 00:17:55.734 { 00:17:55.734 "trid": { 00:17:55.734 "trtype": "TCP", 00:17:55.734 "adrfam": "IPv4", 00:17:55.734 "traddr": "10.0.0.2", 00:17:55.734 "trsvcid": "4420", 00:17:55.734 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:55.734 }, 00:17:55.734 "ctrlr_data": { 00:17:55.734 "cntlid": 1, 00:17:55.734 "vendor_id": "0x8086", 00:17:55.734 "model_number": "SPDK bdev Controller", 00:17:55.734 "serial_number": "SPDK0", 00:17:55.734 "firmware_revision": "24.01.1", 00:17:55.734 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:55.734 "oacs": { 00:17:55.734 "security": 0, 00:17:55.734 "format": 0, 00:17:55.734 "firmware": 0, 00:17:55.734 "ns_manage": 0 00:17:55.734 }, 00:17:55.734 "multi_ctrlr": true, 00:17:55.734 "ana_reporting": false 00:17:55.734 }, 00:17:55.734 "vs": { 00:17:55.734 "nvme_version": "1.3" 00:17:55.734 }, 00:17:55.734 "ns_data": { 00:17:55.734 "id": 1, 00:17:55.734 "can_share": true 00:17:55.734 } 00:17:55.734 } 00:17:55.734 ], 00:17:55.734 "mp_policy": "active_passive" 00:17:55.734 } 00:17:55.734 } 00:17:55.734 ] 00:17:55.734 15:12:55 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=705279 00:17:55.734 15:12:55 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:55.734 15:12:55 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:55.992 Running I/O for 10 seconds... 00:17:56.926 Latency(us) 00:17:56.926 [2024-11-28T14:12:57.160Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.926 [2024-11-28T14:12:57.160Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.926 Nvme0n1 : 1.00 14489.00 56.60 0.00 0.00 0.00 0.00 0.00 00:17:56.926 [2024-11-28T14:12:57.160Z] =================================================================================================================== 00:17:56.926 [2024-11-28T14:12:57.160Z] Total : 14489.00 56.60 0.00 0.00 0.00 0.00 0.00 00:17:56.926 00:17:57.859 15:12:57 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:17:57.859 [2024-11-28T14:12:58.093Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.859 Nvme0n1 : 2.00 14737.50 57.57 0.00 0.00 0.00 0.00 0.00 00:17:57.859 [2024-11-28T14:12:58.093Z] =================================================================================================================== 00:17:57.859 [2024-11-28T14:12:58.093Z] Total : 14737.50 57.57 0.00 0.00 0.00 0.00 0.00 00:17:57.859 00:17:58.118 true 00:17:58.118 15:12:58 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:17:58.118 15:12:58 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:58.376 15:12:58 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:58.376 15:12:58 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:58.376 15:12:58 -- target/nvmf_lvs_grow.sh@65 -- # wait 705279 00:17:58.942 [2024-11-28T14:12:59.176Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.942 Nvme0n1 : 3.00 14844.67 57.99 0.00 0.00 0.00 0.00 0.00 00:17:58.942 [2024-11-28T14:12:59.176Z] =================================================================================================================== 00:17:58.942 [2024-11-28T14:12:59.176Z] Total : 14844.67 57.99 0.00 0.00 0.00 0.00 0.00 00:17:58.942 00:17:59.877 [2024-11-28T14:13:00.111Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.877 Nvme0n1 : 4.00 14919.00 58.28 0.00 0.00 0.00 0.00 0.00 00:17:59.877 [2024-11-28T14:13:00.111Z] =================================================================================================================== 00:17:59.877 [2024-11-28T14:13:00.111Z] Total : 14919.00 58.28 0.00 0.00 0.00 0.00 0.00 00:17:59.877 00:18:01.249 [2024-11-28T14:13:01.483Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.249 Nvme0n1 : 5.00 14945.40 58.38 0.00 0.00 0.00 0.00 0.00 00:18:01.249 [2024-11-28T14:13:01.483Z] =================================================================================================================== 00:18:01.249 [2024-11-28T14:13:01.483Z] Total : 14945.40 58.38 0.00 0.00 0.00 0.00 0.00 00:18:01.249 00:18:02.183 [2024-11-28T14:13:02.417Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.183 Nvme0n1 : 6.00 15039.50 58.75 0.00 0.00 0.00 0.00 0.00 00:18:02.183 [2024-11-28T14:13:02.417Z] =================================================================================================================== 00:18:02.183 [2024-11-28T14:13:02.417Z] Total : 15039.50 58.75 0.00 0.00 0.00 0.00 0.00 00:18:02.183 00:18:03.174 [2024-11-28T14:13:03.408Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.174 Nvme0n1 : 7.00 15123.71 59.08 0.00 0.00 0.00 0.00 0.00 00:18:03.174 [2024-11-28T14:13:03.408Z] =================================================================================================================== 00:18:03.174 [2024-11-28T14:13:03.408Z] Total : 15123.71 59.08 0.00 0.00 0.00 0.00 0.00 00:18:03.174 00:18:04.109 [2024-11-28T14:13:04.343Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.109 Nvme0n1 : 8.00 15154.38 59.20 0.00 0.00 0.00 0.00 0.00 00:18:04.109 [2024-11-28T14:13:04.343Z] =================================================================================================================== 00:18:04.109 [2024-11-28T14:13:04.343Z] Total : 15154.38 59.20 0.00 0.00 0.00 0.00 0.00 00:18:04.109 00:18:05.052 [2024-11-28T14:13:05.286Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.052 Nvme0n1 : 9.00 15193.00 59.35 0.00 0.00 0.00 0.00 0.00 00:18:05.052 [2024-11-28T14:13:05.286Z] =================================================================================================================== 00:18:05.052 [2024-11-28T14:13:05.286Z] Total : 15193.00 59.35 0.00 0.00 0.00 0.00 0.00 00:18:05.052 00:18:05.985 [2024-11-28T14:13:06.219Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.985 Nvme0n1 : 10.00 15267.90 59.64 0.00 0.00 0.00 0.00 0.00 00:18:05.986 [2024-11-28T14:13:06.220Z] =================================================================================================================== 00:18:05.986 [2024-11-28T14:13:06.220Z] Total : 15267.90 59.64 0.00 0.00 0.00 0.00 0.00 00:18:05.986 00:18:05.986 00:18:05.986 Latency(us) 00:18:05.986 [2024-11-28T14:13:06.220Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:05.986 [2024-11-28T14:13:06.220Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:05.986 Nvme0n1 : 10.00 15262.94 59.62 0.00 0.00 8380.24 4563.25 17767.54 00:18:05.986 [2024-11-28T14:13:06.220Z] =================================================================================================================== 00:18:05.986 [2024-11-28T14:13:06.220Z] Total : 15262.94 59.62 0.00 0.00 8380.24 4563.25 17767.54 00:18:05.986 0 00:18:05.986 15:13:06 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 705130 00:18:05.986 15:13:06 -- common/autotest_common.sh@936 -- # '[' -z 705130 ']' 00:18:05.986 15:13:06 -- common/autotest_common.sh@940 -- # kill -0 705130 00:18:05.986 15:13:06 -- common/autotest_common.sh@941 -- # uname 00:18:05.986 15:13:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:05.986 15:13:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 705130 00:18:05.986 15:13:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:05.986 15:13:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:05.986 15:13:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 705130' 00:18:05.986 killing process with pid 705130 00:18:05.986 15:13:06 -- common/autotest_common.sh@955 -- # kill 705130 00:18:05.986 Received shutdown signal, test time was about 10.000000 seconds 00:18:05.986 00:18:05.986 Latency(us) 00:18:05.986 [2024-11-28T14:13:06.220Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:05.986 [2024-11-28T14:13:06.220Z] =================================================================================================================== 00:18:05.986 [2024-11-28T14:13:06.220Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:05.986 15:13:06 -- common/autotest_common.sh@960 -- # wait 705130 00:18:06.244 15:13:06 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:06.502 15:13:06 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:06.502 15:13:06 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:06.760 15:13:06 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:06.760 15:13:06 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:06.760 15:13:06 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 702431 00:18:06.760 15:13:06 -- target/nvmf_lvs_grow.sh@74 -- # wait 702431 00:18:06.760 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 702431 Killed "${NVMF_APP[@]}" "$@" 00:18:06.760 15:13:06 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:06.760 15:13:06 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:06.760 15:13:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:06.760 15:13:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:06.760 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:18:06.760 15:13:06 -- nvmf/common.sh@469 -- # nvmfpid=706643 00:18:06.760 15:13:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:06.760 15:13:06 -- nvmf/common.sh@470 -- # waitforlisten 706643 00:18:06.760 15:13:06 -- common/autotest_common.sh@829 -- # '[' -z 706643 ']' 00:18:06.760 15:13:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:06.760 15:13:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:06.760 15:13:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:06.760 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:06.760 15:13:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:06.760 15:13:06 -- common/autotest_common.sh@10 -- # set +x 00:18:06.760 [2024-11-28 15:13:06.967485] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:06.760 [2024-11-28 15:13:06.967558] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:07.020 EAL: No free 2048 kB hugepages reported on node 1 00:18:07.020 [2024-11-28 15:13:07.032730] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:07.020 [2024-11-28 15:13:07.120575] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:07.020 [2024-11-28 15:13:07.120719] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:07.020 [2024-11-28 15:13:07.120736] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:07.020 [2024-11-28 15:13:07.120747] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:07.020 [2024-11-28 15:13:07.120774] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:07.954 15:13:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:07.954 15:13:07 -- common/autotest_common.sh@862 -- # return 0 00:18:07.954 15:13:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:07.954 15:13:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:07.954 15:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:07.954 15:13:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:07.954 15:13:08 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:08.212 [2024-11-28 15:13:08.288721] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:08.212 [2024-11-28 15:13:08.288879] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:08.212 [2024-11-28 15:13:08.288936] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:08.212 15:13:08 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:08.212 15:13:08 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:18:08.212 15:13:08 -- common/autotest_common.sh@897 -- # local bdev_name=43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:18:08.212 15:13:08 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:08.212 15:13:08 -- common/autotest_common.sh@899 -- # local i 00:18:08.212 15:13:08 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:08.212 15:13:08 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:08.212 15:13:08 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:08.471 15:13:08 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 -t 2000 00:18:08.729 [ 00:18:08.729 { 00:18:08.729 "name": "43c1fa9b-c7a8-4ac1-9367-9a29706b9b55", 00:18:08.729 "aliases": [ 00:18:08.729 "lvs/lvol" 00:18:08.729 ], 00:18:08.729 "product_name": "Logical Volume", 00:18:08.729 "block_size": 4096, 00:18:08.729 "num_blocks": 38912, 00:18:08.729 "uuid": "43c1fa9b-c7a8-4ac1-9367-9a29706b9b55", 00:18:08.729 "assigned_rate_limits": { 00:18:08.729 "rw_ios_per_sec": 0, 00:18:08.729 "rw_mbytes_per_sec": 0, 00:18:08.729 "r_mbytes_per_sec": 0, 00:18:08.729 "w_mbytes_per_sec": 0 00:18:08.729 }, 00:18:08.729 "claimed": false, 00:18:08.729 "zoned": false, 00:18:08.729 "supported_io_types": { 00:18:08.729 "read": true, 00:18:08.729 "write": true, 00:18:08.729 "unmap": true, 00:18:08.729 "write_zeroes": true, 00:18:08.729 "flush": false, 00:18:08.729 "reset": true, 00:18:08.729 "compare": false, 00:18:08.729 "compare_and_write": false, 00:18:08.729 "abort": false, 00:18:08.729 "nvme_admin": false, 00:18:08.729 "nvme_io": false 00:18:08.729 }, 00:18:08.729 "driver_specific": { 00:18:08.729 "lvol": { 00:18:08.729 "lvol_store_uuid": "2a4500bf-337a-4e73-a1ce-9a85c08ef7c1", 00:18:08.729 "base_bdev": "aio_bdev", 00:18:08.729 "thin_provision": false, 00:18:08.729 "snapshot": false, 00:18:08.729 "clone": false, 00:18:08.729 "esnap_clone": false 00:18:08.729 } 00:18:08.729 } 00:18:08.729 } 00:18:08.729 ] 00:18:08.729 15:13:08 -- common/autotest_common.sh@905 -- # return 0 00:18:08.729 15:13:08 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:08.729 15:13:08 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:08.987 15:13:09 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:08.987 15:13:09 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:08.987 15:13:09 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:09.245 15:13:09 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:09.245 15:13:09 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:09.504 [2024-11-28 15:13:09.593780] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:09.504 15:13:09 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:09.504 15:13:09 -- common/autotest_common.sh@650 -- # local es=0 00:18:09.504 15:13:09 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:09.504 15:13:09 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:09.504 15:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.504 15:13:09 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:09.504 15:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.504 15:13:09 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:09.504 15:13:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:09.504 15:13:09 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:09.504 15:13:09 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:09.504 15:13:09 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:09.763 request: 00:18:09.763 { 00:18:09.763 "uuid": "2a4500bf-337a-4e73-a1ce-9a85c08ef7c1", 00:18:09.763 "method": "bdev_lvol_get_lvstores", 00:18:09.763 "req_id": 1 00:18:09.763 } 00:18:09.763 Got JSON-RPC error response 00:18:09.763 response: 00:18:09.763 { 00:18:09.763 "code": -19, 00:18:09.763 "message": "No such device" 00:18:09.763 } 00:18:09.763 15:13:09 -- common/autotest_common.sh@653 -- # es=1 00:18:09.763 15:13:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:09.763 15:13:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:09.763 15:13:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:09.763 15:13:09 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:10.022 aio_bdev 00:18:10.022 15:13:10 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:18:10.022 15:13:10 -- common/autotest_common.sh@897 -- # local bdev_name=43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:18:10.022 15:13:10 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:10.022 15:13:10 -- common/autotest_common.sh@899 -- # local i 00:18:10.022 15:13:10 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:10.280 15:13:10 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:10.280 15:13:10 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:10.538 15:13:10 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 -t 2000 00:18:10.796 [ 00:18:10.796 { 00:18:10.796 "name": "43c1fa9b-c7a8-4ac1-9367-9a29706b9b55", 00:18:10.796 "aliases": [ 00:18:10.796 "lvs/lvol" 00:18:10.796 ], 00:18:10.796 "product_name": "Logical Volume", 00:18:10.796 "block_size": 4096, 00:18:10.796 "num_blocks": 38912, 00:18:10.796 "uuid": "43c1fa9b-c7a8-4ac1-9367-9a29706b9b55", 00:18:10.796 "assigned_rate_limits": { 00:18:10.796 "rw_ios_per_sec": 0, 00:18:10.796 "rw_mbytes_per_sec": 0, 00:18:10.796 "r_mbytes_per_sec": 0, 00:18:10.796 "w_mbytes_per_sec": 0 00:18:10.796 }, 00:18:10.796 "claimed": false, 00:18:10.796 "zoned": false, 00:18:10.796 "supported_io_types": { 00:18:10.796 "read": true, 00:18:10.796 "write": true, 00:18:10.796 "unmap": true, 00:18:10.796 "write_zeroes": true, 00:18:10.796 "flush": false, 00:18:10.796 "reset": true, 00:18:10.796 "compare": false, 00:18:10.796 "compare_and_write": false, 00:18:10.796 "abort": false, 00:18:10.796 "nvme_admin": false, 00:18:10.796 "nvme_io": false 00:18:10.796 }, 00:18:10.796 "driver_specific": { 00:18:10.796 "lvol": { 00:18:10.796 "lvol_store_uuid": "2a4500bf-337a-4e73-a1ce-9a85c08ef7c1", 00:18:10.796 "base_bdev": "aio_bdev", 00:18:10.796 "thin_provision": false, 00:18:10.796 "snapshot": false, 00:18:10.796 "clone": false, 00:18:10.796 "esnap_clone": false 00:18:10.796 } 00:18:10.796 } 00:18:10.796 } 00:18:10.796 ] 00:18:10.796 15:13:10 -- common/autotest_common.sh@905 -- # return 0 00:18:10.796 15:13:10 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:10.796 15:13:10 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:11.054 15:13:11 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:11.054 15:13:11 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:11.054 15:13:11 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:11.312 15:13:11 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:11.312 15:13:11 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 43c1fa9b-c7a8-4ac1-9367-9a29706b9b55 00:18:11.570 15:13:11 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 2a4500bf-337a-4e73-a1ce-9a85c08ef7c1 00:18:11.829 15:13:11 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:12.087 15:13:12 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:12.087 00:18:12.087 real 0m20.460s 00:18:12.087 user 0m50.882s 00:18:12.087 sys 0m4.696s 00:18:12.087 15:13:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:12.087 15:13:12 -- common/autotest_common.sh@10 -- # set +x 00:18:12.087 ************************************ 00:18:12.087 END TEST lvs_grow_dirty 00:18:12.087 ************************************ 00:18:12.087 15:13:12 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:12.087 15:13:12 -- common/autotest_common.sh@806 -- # type=--id 00:18:12.087 15:13:12 -- common/autotest_common.sh@807 -- # id=0 00:18:12.087 15:13:12 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:12.087 15:13:12 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:12.087 15:13:12 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:12.087 15:13:12 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:12.087 15:13:12 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:12.087 15:13:12 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:12.087 nvmf_trace.0 00:18:12.087 15:13:12 -- common/autotest_common.sh@821 -- # return 0 00:18:12.087 15:13:12 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:12.087 15:13:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:12.087 15:13:12 -- nvmf/common.sh@116 -- # sync 00:18:12.087 15:13:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:12.087 15:13:12 -- nvmf/common.sh@119 -- # set +e 00:18:12.087 15:13:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:12.087 15:13:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:12.087 rmmod nvme_tcp 00:18:12.087 rmmod nvme_fabrics 00:18:12.087 rmmod nvme_keyring 00:18:12.087 15:13:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:12.087 15:13:12 -- nvmf/common.sh@123 -- # set -e 00:18:12.087 15:13:12 -- nvmf/common.sh@124 -- # return 0 00:18:12.087 15:13:12 -- nvmf/common.sh@477 -- # '[' -n 706643 ']' 00:18:12.087 15:13:12 -- nvmf/common.sh@478 -- # killprocess 706643 00:18:12.087 15:13:12 -- common/autotest_common.sh@936 -- # '[' -z 706643 ']' 00:18:12.087 15:13:12 -- common/autotest_common.sh@940 -- # kill -0 706643 00:18:12.087 15:13:12 -- common/autotest_common.sh@941 -- # uname 00:18:12.087 15:13:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.087 15:13:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 706643 00:18:12.087 15:13:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:12.087 15:13:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:12.087 15:13:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 706643' 00:18:12.087 killing process with pid 706643 00:18:12.087 15:13:12 -- common/autotest_common.sh@955 -- # kill 706643 00:18:12.087 15:13:12 -- common/autotest_common.sh@960 -- # wait 706643 00:18:12.346 15:13:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:12.346 15:13:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:12.346 15:13:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:12.346 15:13:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:12.346 15:13:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:12.346 15:13:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:12.346 15:13:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:12.346 15:13:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:14.880 15:13:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:14.880 00:18:14.880 real 0m44.360s 00:18:14.880 user 1m15.441s 00:18:14.880 sys 0m8.417s 00:18:14.880 15:13:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:14.880 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:18:14.880 ************************************ 00:18:14.880 END TEST nvmf_lvs_grow 00:18:14.880 ************************************ 00:18:14.880 15:13:14 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:14.880 15:13:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:14.880 15:13:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:14.880 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:18:14.880 ************************************ 00:18:14.880 START TEST nvmf_bdev_io_wait 00:18:14.880 ************************************ 00:18:14.880 15:13:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:14.880 * Looking for test storage... 00:18:14.880 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:14.880 15:13:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:14.880 15:13:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:14.880 15:13:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:14.880 15:13:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:14.880 15:13:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:14.880 15:13:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:14.880 15:13:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:14.880 15:13:14 -- scripts/common.sh@335 -- # IFS=.-: 00:18:14.880 15:13:14 -- scripts/common.sh@335 -- # read -ra ver1 00:18:14.880 15:13:14 -- scripts/common.sh@336 -- # IFS=.-: 00:18:14.880 15:13:14 -- scripts/common.sh@336 -- # read -ra ver2 00:18:14.880 15:13:14 -- scripts/common.sh@337 -- # local 'op=<' 00:18:14.880 15:13:14 -- scripts/common.sh@339 -- # ver1_l=2 00:18:14.880 15:13:14 -- scripts/common.sh@340 -- # ver2_l=1 00:18:14.880 15:13:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:14.880 15:13:14 -- scripts/common.sh@343 -- # case "$op" in 00:18:14.880 15:13:14 -- scripts/common.sh@344 -- # : 1 00:18:14.880 15:13:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:14.880 15:13:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:14.880 15:13:14 -- scripts/common.sh@364 -- # decimal 1 00:18:14.880 15:13:14 -- scripts/common.sh@352 -- # local d=1 00:18:14.880 15:13:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:14.880 15:13:14 -- scripts/common.sh@354 -- # echo 1 00:18:14.880 15:13:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:14.880 15:13:14 -- scripts/common.sh@365 -- # decimal 2 00:18:14.880 15:13:14 -- scripts/common.sh@352 -- # local d=2 00:18:14.880 15:13:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:14.880 15:13:14 -- scripts/common.sh@354 -- # echo 2 00:18:14.880 15:13:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:14.880 15:13:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:14.880 15:13:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:14.880 15:13:14 -- scripts/common.sh@367 -- # return 0 00:18:14.880 15:13:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:14.880 15:13:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:14.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.880 --rc genhtml_branch_coverage=1 00:18:14.880 --rc genhtml_function_coverage=1 00:18:14.880 --rc genhtml_legend=1 00:18:14.880 --rc geninfo_all_blocks=1 00:18:14.880 --rc geninfo_unexecuted_blocks=1 00:18:14.880 00:18:14.880 ' 00:18:14.880 15:13:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:14.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.880 --rc genhtml_branch_coverage=1 00:18:14.880 --rc genhtml_function_coverage=1 00:18:14.880 --rc genhtml_legend=1 00:18:14.880 --rc geninfo_all_blocks=1 00:18:14.880 --rc geninfo_unexecuted_blocks=1 00:18:14.880 00:18:14.880 ' 00:18:14.880 15:13:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:14.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.880 --rc genhtml_branch_coverage=1 00:18:14.880 --rc genhtml_function_coverage=1 00:18:14.880 --rc genhtml_legend=1 00:18:14.880 --rc geninfo_all_blocks=1 00:18:14.880 --rc geninfo_unexecuted_blocks=1 00:18:14.880 00:18:14.880 ' 00:18:14.880 15:13:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:14.880 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:14.880 --rc genhtml_branch_coverage=1 00:18:14.880 --rc genhtml_function_coverage=1 00:18:14.880 --rc genhtml_legend=1 00:18:14.880 --rc geninfo_all_blocks=1 00:18:14.880 --rc geninfo_unexecuted_blocks=1 00:18:14.880 00:18:14.880 ' 00:18:14.880 15:13:14 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:14.880 15:13:14 -- nvmf/common.sh@7 -- # uname -s 00:18:14.880 15:13:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:14.880 15:13:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:14.880 15:13:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:14.880 15:13:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:14.880 15:13:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:14.880 15:13:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:14.880 15:13:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:14.880 15:13:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:14.880 15:13:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:14.880 15:13:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:14.880 15:13:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:14.880 15:13:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:14.880 15:13:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:14.880 15:13:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:14.880 15:13:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:14.880 15:13:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:14.880 15:13:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:14.880 15:13:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:14.880 15:13:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:14.880 15:13:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.880 15:13:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.880 15:13:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.880 15:13:14 -- paths/export.sh@5 -- # export PATH 00:18:14.880 15:13:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:14.880 15:13:14 -- nvmf/common.sh@46 -- # : 0 00:18:14.880 15:13:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:14.880 15:13:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:14.880 15:13:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:14.880 15:13:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:14.880 15:13:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:14.880 15:13:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:14.880 15:13:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:14.880 15:13:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:14.880 15:13:14 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:14.880 15:13:14 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:14.880 15:13:14 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:14.880 15:13:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:14.880 15:13:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:14.880 15:13:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:14.880 15:13:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:14.880 15:13:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:14.880 15:13:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:14.880 15:13:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:14.880 15:13:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:14.880 15:13:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:14.880 15:13:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:14.880 15:13:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:14.880 15:13:14 -- common/autotest_common.sh@10 -- # set +x 00:18:16.777 15:13:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:16.777 15:13:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:16.777 15:13:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:16.777 15:13:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:16.777 15:13:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:16.777 15:13:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:16.777 15:13:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:16.777 15:13:16 -- nvmf/common.sh@294 -- # net_devs=() 00:18:16.777 15:13:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:16.777 15:13:16 -- nvmf/common.sh@295 -- # e810=() 00:18:16.777 15:13:16 -- nvmf/common.sh@295 -- # local -ga e810 00:18:16.777 15:13:16 -- nvmf/common.sh@296 -- # x722=() 00:18:16.777 15:13:16 -- nvmf/common.sh@296 -- # local -ga x722 00:18:16.777 15:13:16 -- nvmf/common.sh@297 -- # mlx=() 00:18:16.777 15:13:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:16.777 15:13:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:16.777 15:13:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:16.777 15:13:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:16.777 15:13:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:16.777 15:13:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:16.777 15:13:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:16.777 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:16.777 15:13:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:16.777 15:13:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:16.777 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:16.777 15:13:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:16.777 15:13:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:16.777 15:13:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:16.777 15:13:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:16.777 15:13:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:16.777 15:13:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:16.777 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:16.777 15:13:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:16.777 15:13:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:16.777 15:13:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:16.777 15:13:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:16.777 15:13:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:16.777 15:13:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:16.777 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:16.777 15:13:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:16.777 15:13:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:16.777 15:13:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:16.777 15:13:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:16.777 15:13:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:16.777 15:13:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:16.777 15:13:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:16.777 15:13:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:16.777 15:13:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:16.778 15:13:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:16.778 15:13:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:16.778 15:13:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:16.778 15:13:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:16.778 15:13:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:16.778 15:13:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:16.778 15:13:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:16.778 15:13:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:16.778 15:13:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:17.036 15:13:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:17.036 15:13:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:17.036 15:13:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:17.036 15:13:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:17.036 15:13:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:17.036 15:13:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:17.036 15:13:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:17.036 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:17.036 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.238 ms 00:18:17.036 00:18:17.036 --- 10.0.0.2 ping statistics --- 00:18:17.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.036 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:18:17.036 15:13:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:17.036 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:17.036 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.174 ms 00:18:17.036 00:18:17.036 --- 10.0.0.1 ping statistics --- 00:18:17.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:17.036 rtt min/avg/max/mdev = 0.174/0.174/0.174/0.000 ms 00:18:17.036 15:13:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:17.036 15:13:17 -- nvmf/common.sh@410 -- # return 0 00:18:17.036 15:13:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:17.036 15:13:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:17.036 15:13:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:17.036 15:13:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:17.036 15:13:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:17.036 15:13:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:17.036 15:13:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:17.036 15:13:17 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:17.036 15:13:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:17.036 15:13:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:17.036 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.036 15:13:17 -- nvmf/common.sh@469 -- # nvmfpid=709335 00:18:17.036 15:13:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:17.036 15:13:17 -- nvmf/common.sh@470 -- # waitforlisten 709335 00:18:17.036 15:13:17 -- common/autotest_common.sh@829 -- # '[' -z 709335 ']' 00:18:17.036 15:13:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:17.036 15:13:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:17.036 15:13:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:17.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:17.036 15:13:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:17.036 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.036 [2024-11-28 15:13:17.181693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:17.036 [2024-11-28 15:13:17.181779] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:17.036 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.036 [2024-11-28 15:13:17.251298] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:17.295 [2024-11-28 15:13:17.344516] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:17.295 [2024-11-28 15:13:17.344676] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:17.295 [2024-11-28 15:13:17.344698] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:17.295 [2024-11-28 15:13:17.344712] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:17.295 [2024-11-28 15:13:17.344768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.295 [2024-11-28 15:13:17.344822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:17.295 [2024-11-28 15:13:17.346130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:17.295 [2024-11-28 15:13:17.346134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:17.295 15:13:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.295 15:13:17 -- common/autotest_common.sh@862 -- # return 0 00:18:17.295 15:13:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.295 15:13:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:17.295 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.295 15:13:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.295 15:13:17 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:17.295 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.295 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.295 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.295 15:13:17 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:17.295 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.295 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.553 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.553 15:13:17 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:17.553 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.553 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.553 [2024-11-28 15:13:17.532778] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:17.553 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.553 15:13:17 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:17.553 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.553 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.553 Malloc0 00:18:17.553 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.553 15:13:17 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:17.553 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.553 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.554 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:17.554 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.554 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.554 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:17.554 15:13:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.554 15:13:17 -- common/autotest_common.sh@10 -- # set +x 00:18:17.554 [2024-11-28 15:13:17.595542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:17.554 15:13:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=709387 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@30 -- # READ_PID=709390 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # config=() 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # local subsystem config 00:18:17.554 15:13:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:17.554 { 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme$subsystem", 00:18:17.554 "trtype": "$TEST_TRANSPORT", 00:18:17.554 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "$NVMF_PORT", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:17.554 "hdgst": ${hdgst:-false}, 00:18:17.554 "ddgst": ${ddgst:-false} 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 } 00:18:17.554 EOF 00:18:17.554 )") 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=709392 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # config=() 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # local subsystem config 00:18:17.554 15:13:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:17.554 { 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme$subsystem", 00:18:17.554 "trtype": "$TEST_TRANSPORT", 00:18:17.554 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "$NVMF_PORT", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:17.554 "hdgst": ${hdgst:-false}, 00:18:17.554 "ddgst": ${ddgst:-false} 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 } 00:18:17.554 EOF 00:18:17.554 )") 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # cat 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=709396 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # config=() 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@35 -- # sync 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # local subsystem config 00:18:17.554 15:13:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:17.554 { 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme$subsystem", 00:18:17.554 "trtype": "$TEST_TRANSPORT", 00:18:17.554 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "$NVMF_PORT", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:17.554 "hdgst": ${hdgst:-false}, 00:18:17.554 "ddgst": ${ddgst:-false} 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 } 00:18:17.554 EOF 00:18:17.554 )") 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # cat 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # config=() 00:18:17.554 15:13:17 -- nvmf/common.sh@520 -- # local subsystem config 00:18:17.554 15:13:17 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:17.554 { 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme$subsystem", 00:18:17.554 "trtype": "$TEST_TRANSPORT", 00:18:17.554 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "$NVMF_PORT", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:17.554 "hdgst": ${hdgst:-false}, 00:18:17.554 "ddgst": ${ddgst:-false} 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 } 00:18:17.554 EOF 00:18:17.554 )") 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # cat 00:18:17.554 15:13:17 -- target/bdev_io_wait.sh@37 -- # wait 709387 00:18:17.554 15:13:17 -- nvmf/common.sh@544 -- # jq . 00:18:17.554 15:13:17 -- nvmf/common.sh@542 -- # cat 00:18:17.554 15:13:17 -- nvmf/common.sh@544 -- # jq . 00:18:17.554 15:13:17 -- nvmf/common.sh@545 -- # IFS=, 00:18:17.554 15:13:17 -- nvmf/common.sh@544 -- # jq . 00:18:17.554 15:13:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme1", 00:18:17.554 "trtype": "tcp", 00:18:17.554 "traddr": "10.0.0.2", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "4420", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:17.554 "hdgst": false, 00:18:17.554 "ddgst": false 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 }' 00:18:17.554 15:13:17 -- nvmf/common.sh@545 -- # IFS=, 00:18:17.554 15:13:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme1", 00:18:17.554 "trtype": "tcp", 00:18:17.554 "traddr": "10.0.0.2", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "4420", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:17.554 "hdgst": false, 00:18:17.554 "ddgst": false 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 }' 00:18:17.554 15:13:17 -- nvmf/common.sh@544 -- # jq . 00:18:17.554 15:13:17 -- nvmf/common.sh@545 -- # IFS=, 00:18:17.554 15:13:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme1", 00:18:17.554 "trtype": "tcp", 00:18:17.554 "traddr": "10.0.0.2", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "4420", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:17.554 "hdgst": false, 00:18:17.554 "ddgst": false 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 }' 00:18:17.554 15:13:17 -- nvmf/common.sh@545 -- # IFS=, 00:18:17.554 15:13:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:17.554 "params": { 00:18:17.554 "name": "Nvme1", 00:18:17.554 "trtype": "tcp", 00:18:17.554 "traddr": "10.0.0.2", 00:18:17.554 "adrfam": "ipv4", 00:18:17.554 "trsvcid": "4420", 00:18:17.554 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:17.554 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:17.554 "hdgst": false, 00:18:17.554 "ddgst": false 00:18:17.554 }, 00:18:17.554 "method": "bdev_nvme_attach_controller" 00:18:17.554 }' 00:18:17.554 [2024-11-28 15:13:17.639217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:17.554 [2024-11-28 15:13:17.639217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:17.554 [2024-11-28 15:13:17.639217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:17.555 [2024-11-28 15:13:17.639307] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 15:13:17.639307] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:17.555 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:17.555 [2024-11-28 15:13:17.639310] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:17.555 [2024-11-28 15:13:17.640312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:17.555 [2024-11-28 15:13:17.640381] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:17.555 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.555 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.813 [2024-11-28 15:13:17.813533] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.813 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.813 [2024-11-28 15:13:17.886260] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:17.813 [2024-11-28 15:13:17.912776] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:17.813 EAL: No free 2048 kB hugepages reported on node 1 00:18:17.813 [2024-11-28 15:13:17.985502] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:17.813 [2024-11-28 15:13:18.011275] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.071 [2024-11-28 15:13:18.088694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:18.071 [2024-11-28 15:13:18.091162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:18.071 [2024-11-28 15:13:18.159562] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:18.071 Running I/O for 1 seconds... 00:18:18.329 Running I/O for 1 seconds... 00:18:18.329 Running I/O for 1 seconds... 00:18:18.329 Running I/O for 1 seconds... 00:18:19.261 00:18:19.261 Latency(us) 00:18:19.261 [2024-11-28T14:13:19.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.261 [2024-11-28T14:13:19.495Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:19.261 Nvme1n1 : 1.01 12262.36 47.90 0.00 0.00 10403.29 5534.15 18738.44 00:18:19.261 [2024-11-28T14:13:19.495Z] =================================================================================================================== 00:18:19.261 [2024-11-28T14:13:19.495Z] Total : 12262.36 47.90 0.00 0.00 10403.29 5534.15 18738.44 00:18:19.261 00:18:19.261 Latency(us) 00:18:19.261 [2024-11-28T14:13:19.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.261 [2024-11-28T14:13:19.495Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:19.261 Nvme1n1 : 1.02 5343.20 20.87 0.00 0.00 23800.52 7184.69 33204.91 00:18:19.261 [2024-11-28T14:13:19.495Z] =================================================================================================================== 00:18:19.261 [2024-11-28T14:13:19.495Z] Total : 5343.20 20.87 0.00 0.00 23800.52 7184.69 33204.91 00:18:19.261 00:18:19.261 Latency(us) 00:18:19.261 [2024-11-28T14:13:19.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.261 [2024-11-28T14:13:19.495Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:19.261 Nvme1n1 : 1.00 169439.75 661.87 0.00 0.00 752.56 285.20 1001.24 00:18:19.261 [2024-11-28T14:13:19.495Z] =================================================================================================================== 00:18:19.261 [2024-11-28T14:13:19.495Z] Total : 169439.75 661.87 0.00 0.00 752.56 285.20 1001.24 00:18:19.261 00:18:19.261 Latency(us) 00:18:19.261 [2024-11-28T14:13:19.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:19.261 [2024-11-28T14:13:19.495Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:19.261 Nvme1n1 : 1.01 5312.48 20.75 0.00 0.00 23988.10 8252.68 52817.16 00:18:19.261 [2024-11-28T14:13:19.495Z] =================================================================================================================== 00:18:19.261 [2024-11-28T14:13:19.495Z] Total : 5312.48 20.75 0.00 0.00 23988.10 8252.68 52817.16 00:18:19.519 15:13:19 -- target/bdev_io_wait.sh@38 -- # wait 709390 00:18:19.519 15:13:19 -- target/bdev_io_wait.sh@39 -- # wait 709392 00:18:19.519 15:13:19 -- target/bdev_io_wait.sh@40 -- # wait 709396 00:18:19.519 15:13:19 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:19.519 15:13:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:19.519 15:13:19 -- common/autotest_common.sh@10 -- # set +x 00:18:19.777 15:13:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:19.777 15:13:19 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:19.777 15:13:19 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:19.777 15:13:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:19.777 15:13:19 -- nvmf/common.sh@116 -- # sync 00:18:19.777 15:13:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:19.778 15:13:19 -- nvmf/common.sh@119 -- # set +e 00:18:19.778 15:13:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:19.778 15:13:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:19.778 rmmod nvme_tcp 00:18:19.778 rmmod nvme_fabrics 00:18:19.778 rmmod nvme_keyring 00:18:19.778 15:13:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:19.778 15:13:19 -- nvmf/common.sh@123 -- # set -e 00:18:19.778 15:13:19 -- nvmf/common.sh@124 -- # return 0 00:18:19.778 15:13:19 -- nvmf/common.sh@477 -- # '[' -n 709335 ']' 00:18:19.778 15:13:19 -- nvmf/common.sh@478 -- # killprocess 709335 00:18:19.778 15:13:19 -- common/autotest_common.sh@936 -- # '[' -z 709335 ']' 00:18:19.778 15:13:19 -- common/autotest_common.sh@940 -- # kill -0 709335 00:18:19.778 15:13:19 -- common/autotest_common.sh@941 -- # uname 00:18:19.778 15:13:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:19.778 15:13:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 709335 00:18:19.778 15:13:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:19.778 15:13:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:19.778 15:13:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 709335' 00:18:19.778 killing process with pid 709335 00:18:19.778 15:13:19 -- common/autotest_common.sh@955 -- # kill 709335 00:18:19.778 15:13:19 -- common/autotest_common.sh@960 -- # wait 709335 00:18:20.036 15:13:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:20.036 15:13:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:20.036 15:13:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:20.036 15:13:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:20.036 15:13:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:20.036 15:13:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.036 15:13:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.036 15:13:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:21.938 15:13:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:21.938 00:18:21.938 real 0m7.500s 00:18:21.938 user 0m16.710s 00:18:21.938 sys 0m3.627s 00:18:21.938 15:13:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:21.938 15:13:22 -- common/autotest_common.sh@10 -- # set +x 00:18:21.938 ************************************ 00:18:21.938 END TEST nvmf_bdev_io_wait 00:18:21.938 ************************************ 00:18:21.938 15:13:22 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:21.938 15:13:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:21.938 15:13:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:21.938 15:13:22 -- common/autotest_common.sh@10 -- # set +x 00:18:21.938 ************************************ 00:18:21.938 START TEST nvmf_queue_depth 00:18:21.938 ************************************ 00:18:21.938 15:13:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:22.196 * Looking for test storage... 00:18:22.196 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:22.196 15:13:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:22.197 15:13:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:22.197 15:13:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:22.197 15:13:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:22.197 15:13:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:22.197 15:13:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:22.197 15:13:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:22.197 15:13:22 -- scripts/common.sh@335 -- # IFS=.-: 00:18:22.197 15:13:22 -- scripts/common.sh@335 -- # read -ra ver1 00:18:22.197 15:13:22 -- scripts/common.sh@336 -- # IFS=.-: 00:18:22.197 15:13:22 -- scripts/common.sh@336 -- # read -ra ver2 00:18:22.197 15:13:22 -- scripts/common.sh@337 -- # local 'op=<' 00:18:22.197 15:13:22 -- scripts/common.sh@339 -- # ver1_l=2 00:18:22.197 15:13:22 -- scripts/common.sh@340 -- # ver2_l=1 00:18:22.197 15:13:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:22.197 15:13:22 -- scripts/common.sh@343 -- # case "$op" in 00:18:22.197 15:13:22 -- scripts/common.sh@344 -- # : 1 00:18:22.197 15:13:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:22.197 15:13:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:22.197 15:13:22 -- scripts/common.sh@364 -- # decimal 1 00:18:22.197 15:13:22 -- scripts/common.sh@352 -- # local d=1 00:18:22.197 15:13:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:22.197 15:13:22 -- scripts/common.sh@354 -- # echo 1 00:18:22.197 15:13:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:22.197 15:13:22 -- scripts/common.sh@365 -- # decimal 2 00:18:22.197 15:13:22 -- scripts/common.sh@352 -- # local d=2 00:18:22.197 15:13:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:22.197 15:13:22 -- scripts/common.sh@354 -- # echo 2 00:18:22.197 15:13:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:22.197 15:13:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:22.197 15:13:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:22.197 15:13:22 -- scripts/common.sh@367 -- # return 0 00:18:22.197 15:13:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:22.197 15:13:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:22.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.197 --rc genhtml_branch_coverage=1 00:18:22.197 --rc genhtml_function_coverage=1 00:18:22.197 --rc genhtml_legend=1 00:18:22.197 --rc geninfo_all_blocks=1 00:18:22.197 --rc geninfo_unexecuted_blocks=1 00:18:22.197 00:18:22.197 ' 00:18:22.197 15:13:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:22.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.197 --rc genhtml_branch_coverage=1 00:18:22.197 --rc genhtml_function_coverage=1 00:18:22.197 --rc genhtml_legend=1 00:18:22.197 --rc geninfo_all_blocks=1 00:18:22.197 --rc geninfo_unexecuted_blocks=1 00:18:22.197 00:18:22.197 ' 00:18:22.197 15:13:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:22.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.197 --rc genhtml_branch_coverage=1 00:18:22.197 --rc genhtml_function_coverage=1 00:18:22.197 --rc genhtml_legend=1 00:18:22.197 --rc geninfo_all_blocks=1 00:18:22.197 --rc geninfo_unexecuted_blocks=1 00:18:22.197 00:18:22.197 ' 00:18:22.197 15:13:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:22.197 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:22.197 --rc genhtml_branch_coverage=1 00:18:22.197 --rc genhtml_function_coverage=1 00:18:22.197 --rc genhtml_legend=1 00:18:22.197 --rc geninfo_all_blocks=1 00:18:22.197 --rc geninfo_unexecuted_blocks=1 00:18:22.197 00:18:22.197 ' 00:18:22.197 15:13:22 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:22.197 15:13:22 -- nvmf/common.sh@7 -- # uname -s 00:18:22.197 15:13:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:22.197 15:13:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:22.197 15:13:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:22.197 15:13:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:22.197 15:13:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:22.197 15:13:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:22.197 15:13:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:22.197 15:13:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:22.197 15:13:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:22.197 15:13:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:22.197 15:13:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.197 15:13:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:22.197 15:13:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:22.197 15:13:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:22.197 15:13:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:22.197 15:13:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:22.197 15:13:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:22.197 15:13:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:22.197 15:13:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:22.197 15:13:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.197 15:13:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.197 15:13:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.197 15:13:22 -- paths/export.sh@5 -- # export PATH 00:18:22.197 15:13:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:22.197 15:13:22 -- nvmf/common.sh@46 -- # : 0 00:18:22.197 15:13:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:22.197 15:13:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:22.197 15:13:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:22.197 15:13:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:22.197 15:13:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:22.197 15:13:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:22.197 15:13:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:22.197 15:13:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:22.197 15:13:22 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:22.197 15:13:22 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:22.197 15:13:22 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:22.197 15:13:22 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:22.197 15:13:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:22.197 15:13:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:22.197 15:13:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:22.197 15:13:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:22.197 15:13:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:22.197 15:13:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:22.197 15:13:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:22.197 15:13:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:22.197 15:13:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:22.197 15:13:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:22.197 15:13:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:22.197 15:13:22 -- common/autotest_common.sh@10 -- # set +x 00:18:24.732 15:13:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:24.732 15:13:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:24.732 15:13:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:24.732 15:13:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:24.732 15:13:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:24.732 15:13:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:24.732 15:13:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:24.732 15:13:24 -- nvmf/common.sh@294 -- # net_devs=() 00:18:24.732 15:13:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:24.732 15:13:24 -- nvmf/common.sh@295 -- # e810=() 00:18:24.732 15:13:24 -- nvmf/common.sh@295 -- # local -ga e810 00:18:24.732 15:13:24 -- nvmf/common.sh@296 -- # x722=() 00:18:24.732 15:13:24 -- nvmf/common.sh@296 -- # local -ga x722 00:18:24.732 15:13:24 -- nvmf/common.sh@297 -- # mlx=() 00:18:24.732 15:13:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:24.732 15:13:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:24.732 15:13:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:24.732 15:13:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:24.732 15:13:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:24.732 15:13:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.732 15:13:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:24.732 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:24.732 15:13:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:24.732 15:13:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:24.732 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:24.732 15:13:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:24.732 15:13:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.732 15:13:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.732 15:13:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.732 15:13:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.732 15:13:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:24.732 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:24.732 15:13:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.732 15:13:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:24.732 15:13:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:24.732 15:13:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:24.732 15:13:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:24.732 15:13:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:24.732 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:24.732 15:13:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:24.732 15:13:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:24.732 15:13:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:24.732 15:13:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:24.732 15:13:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:24.732 15:13:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:24.732 15:13:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:24.732 15:13:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:24.732 15:13:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:24.732 15:13:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:24.732 15:13:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:24.732 15:13:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:24.732 15:13:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:24.732 15:13:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:24.732 15:13:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:24.732 15:13:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:24.732 15:13:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:24.732 15:13:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:24.732 15:13:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:24.732 15:13:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:24.732 15:13:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:24.732 15:13:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:24.732 15:13:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:24.732 15:13:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:24.732 15:13:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:24.732 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:24.732 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:18:24.732 00:18:24.733 --- 10.0.0.2 ping statistics --- 00:18:24.733 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.733 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:18:24.733 15:13:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:24.733 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:24.733 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.153 ms 00:18:24.733 00:18:24.733 --- 10.0.0.1 ping statistics --- 00:18:24.733 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:24.733 rtt min/avg/max/mdev = 0.153/0.153/0.153/0.000 ms 00:18:24.733 15:13:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:24.733 15:13:24 -- nvmf/common.sh@410 -- # return 0 00:18:24.733 15:13:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:24.733 15:13:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:24.733 15:13:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:24.733 15:13:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:24.733 15:13:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:24.733 15:13:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:24.733 15:13:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:24.733 15:13:24 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:24.733 15:13:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:24.733 15:13:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:24.733 15:13:24 -- common/autotest_common.sh@10 -- # set +x 00:18:24.733 15:13:24 -- nvmf/common.sh@469 -- # nvmfpid=711736 00:18:24.733 15:13:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:24.733 15:13:24 -- nvmf/common.sh@470 -- # waitforlisten 711736 00:18:24.733 15:13:24 -- common/autotest_common.sh@829 -- # '[' -z 711736 ']' 00:18:24.733 15:13:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:24.733 15:13:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:24.733 15:13:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:24.733 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:24.733 15:13:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:24.733 15:13:24 -- common/autotest_common.sh@10 -- # set +x 00:18:24.733 [2024-11-28 15:13:24.564220] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:24.733 [2024-11-28 15:13:24.564298] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:24.733 EAL: No free 2048 kB hugepages reported on node 1 00:18:24.733 [2024-11-28 15:13:24.628201] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:24.733 [2024-11-28 15:13:24.716641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:24.733 [2024-11-28 15:13:24.716793] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:24.733 [2024-11-28 15:13:24.716812] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:24.733 [2024-11-28 15:13:24.716825] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:24.733 [2024-11-28 15:13:24.716852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:25.300 15:13:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:25.300 15:13:25 -- common/autotest_common.sh@862 -- # return 0 00:18:25.300 15:13:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:25.300 15:13:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:25.300 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.558 15:13:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:25.558 15:13:25 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:25.558 15:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.558 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.558 [2024-11-28 15:13:25.551617] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:25.558 15:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.558 15:13:25 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:25.558 15:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.558 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.558 Malloc0 00:18:25.559 15:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.559 15:13:25 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:25.559 15:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.559 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.559 15:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.559 15:13:25 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:25.559 15:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.559 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.559 15:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.559 15:13:25 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:25.559 15:13:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:25.559 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.559 [2024-11-28 15:13:25.623808] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:25.559 15:13:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:25.559 15:13:25 -- target/queue_depth.sh@30 -- # bdevperf_pid=711895 00:18:25.559 15:13:25 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:25.559 15:13:25 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:25.559 15:13:25 -- target/queue_depth.sh@33 -- # waitforlisten 711895 /var/tmp/bdevperf.sock 00:18:25.559 15:13:25 -- common/autotest_common.sh@829 -- # '[' -z 711895 ']' 00:18:25.559 15:13:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:25.559 15:13:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:25.559 15:13:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:25.559 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:25.559 15:13:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:25.559 15:13:25 -- common/autotest_common.sh@10 -- # set +x 00:18:25.559 [2024-11-28 15:13:25.667329] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:25.559 [2024-11-28 15:13:25.667388] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid711895 ] 00:18:25.559 EAL: No free 2048 kB hugepages reported on node 1 00:18:25.559 [2024-11-28 15:13:25.726884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:25.818 [2024-11-28 15:13:25.815571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:26.384 15:13:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:26.384 15:13:26 -- common/autotest_common.sh@862 -- # return 0 00:18:26.384 15:13:26 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:26.384 15:13:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:26.384 15:13:26 -- common/autotest_common.sh@10 -- # set +x 00:18:26.642 NVMe0n1 00:18:26.642 15:13:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:26.642 15:13:26 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:26.900 Running I/O for 10 seconds... 00:18:36.878 00:18:36.878 Latency(us) 00:18:36.878 [2024-11-28T14:13:37.112Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.878 [2024-11-28T14:13:37.112Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:36.878 Verification LBA range: start 0x0 length 0x4000 00:18:36.878 NVMe0n1 : 10.07 12280.36 47.97 0.00 0.00 83059.77 14854.83 76118.85 00:18:36.878 [2024-11-28T14:13:37.112Z] =================================================================================================================== 00:18:36.878 [2024-11-28T14:13:37.112Z] Total : 12280.36 47.97 0.00 0.00 83059.77 14854.83 76118.85 00:18:36.878 0 00:18:36.878 15:13:37 -- target/queue_depth.sh@39 -- # killprocess 711895 00:18:36.878 15:13:37 -- common/autotest_common.sh@936 -- # '[' -z 711895 ']' 00:18:36.878 15:13:37 -- common/autotest_common.sh@940 -- # kill -0 711895 00:18:36.878 15:13:37 -- common/autotest_common.sh@941 -- # uname 00:18:36.878 15:13:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:36.878 15:13:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 711895 00:18:36.878 15:13:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:36.878 15:13:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:36.878 15:13:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 711895' 00:18:36.878 killing process with pid 711895 00:18:36.878 15:13:37 -- common/autotest_common.sh@955 -- # kill 711895 00:18:36.878 Received shutdown signal, test time was about 10.000000 seconds 00:18:36.878 00:18:36.878 Latency(us) 00:18:36.878 [2024-11-28T14:13:37.112Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:36.878 [2024-11-28T14:13:37.112Z] =================================================================================================================== 00:18:36.878 [2024-11-28T14:13:37.112Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:36.878 15:13:37 -- common/autotest_common.sh@960 -- # wait 711895 00:18:37.136 15:13:37 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:37.136 15:13:37 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:37.136 15:13:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:37.136 15:13:37 -- nvmf/common.sh@116 -- # sync 00:18:37.136 15:13:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:37.136 15:13:37 -- nvmf/common.sh@119 -- # set +e 00:18:37.137 15:13:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:37.137 15:13:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:37.137 rmmod nvme_tcp 00:18:37.137 rmmod nvme_fabrics 00:18:37.137 rmmod nvme_keyring 00:18:37.395 15:13:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:37.395 15:13:37 -- nvmf/common.sh@123 -- # set -e 00:18:37.395 15:13:37 -- nvmf/common.sh@124 -- # return 0 00:18:37.395 15:13:37 -- nvmf/common.sh@477 -- # '[' -n 711736 ']' 00:18:37.395 15:13:37 -- nvmf/common.sh@478 -- # killprocess 711736 00:18:37.395 15:13:37 -- common/autotest_common.sh@936 -- # '[' -z 711736 ']' 00:18:37.395 15:13:37 -- common/autotest_common.sh@940 -- # kill -0 711736 00:18:37.395 15:13:37 -- common/autotest_common.sh@941 -- # uname 00:18:37.395 15:13:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:37.395 15:13:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 711736 00:18:37.395 15:13:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:37.395 15:13:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:37.395 15:13:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 711736' 00:18:37.395 killing process with pid 711736 00:18:37.395 15:13:37 -- common/autotest_common.sh@955 -- # kill 711736 00:18:37.395 15:13:37 -- common/autotest_common.sh@960 -- # wait 711736 00:18:37.655 15:13:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:37.655 15:13:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:37.655 15:13:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:37.655 15:13:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:37.655 15:13:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:37.655 15:13:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.655 15:13:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.655 15:13:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:39.554 15:13:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:39.554 00:18:39.554 real 0m17.554s 00:18:39.554 user 0m25.060s 00:18:39.554 sys 0m3.226s 00:18:39.554 15:13:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:39.554 15:13:39 -- common/autotest_common.sh@10 -- # set +x 00:18:39.554 ************************************ 00:18:39.554 END TEST nvmf_queue_depth 00:18:39.554 ************************************ 00:18:39.554 15:13:39 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:39.554 15:13:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:39.554 15:13:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:39.554 15:13:39 -- common/autotest_common.sh@10 -- # set +x 00:18:39.554 ************************************ 00:18:39.554 START TEST nvmf_multipath 00:18:39.554 ************************************ 00:18:39.554 15:13:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:39.554 * Looking for test storage... 00:18:39.555 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:39.555 15:13:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:39.555 15:13:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:39.555 15:13:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:39.813 15:13:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:39.813 15:13:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:39.813 15:13:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:39.813 15:13:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:39.813 15:13:39 -- scripts/common.sh@335 -- # IFS=.-: 00:18:39.813 15:13:39 -- scripts/common.sh@335 -- # read -ra ver1 00:18:39.813 15:13:39 -- scripts/common.sh@336 -- # IFS=.-: 00:18:39.813 15:13:39 -- scripts/common.sh@336 -- # read -ra ver2 00:18:39.813 15:13:39 -- scripts/common.sh@337 -- # local 'op=<' 00:18:39.813 15:13:39 -- scripts/common.sh@339 -- # ver1_l=2 00:18:39.813 15:13:39 -- scripts/common.sh@340 -- # ver2_l=1 00:18:39.813 15:13:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:39.813 15:13:39 -- scripts/common.sh@343 -- # case "$op" in 00:18:39.813 15:13:39 -- scripts/common.sh@344 -- # : 1 00:18:39.813 15:13:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:39.813 15:13:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:39.813 15:13:39 -- scripts/common.sh@364 -- # decimal 1 00:18:39.813 15:13:39 -- scripts/common.sh@352 -- # local d=1 00:18:39.813 15:13:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:39.813 15:13:39 -- scripts/common.sh@354 -- # echo 1 00:18:39.813 15:13:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:39.813 15:13:39 -- scripts/common.sh@365 -- # decimal 2 00:18:39.813 15:13:39 -- scripts/common.sh@352 -- # local d=2 00:18:39.813 15:13:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:39.813 15:13:39 -- scripts/common.sh@354 -- # echo 2 00:18:39.813 15:13:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:39.813 15:13:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:39.813 15:13:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:39.813 15:13:39 -- scripts/common.sh@367 -- # return 0 00:18:39.813 15:13:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:39.813 15:13:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:39.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.813 --rc genhtml_branch_coverage=1 00:18:39.813 --rc genhtml_function_coverage=1 00:18:39.813 --rc genhtml_legend=1 00:18:39.813 --rc geninfo_all_blocks=1 00:18:39.813 --rc geninfo_unexecuted_blocks=1 00:18:39.813 00:18:39.813 ' 00:18:39.813 15:13:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:39.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.813 --rc genhtml_branch_coverage=1 00:18:39.813 --rc genhtml_function_coverage=1 00:18:39.813 --rc genhtml_legend=1 00:18:39.813 --rc geninfo_all_blocks=1 00:18:39.813 --rc geninfo_unexecuted_blocks=1 00:18:39.813 00:18:39.813 ' 00:18:39.813 15:13:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:39.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.813 --rc genhtml_branch_coverage=1 00:18:39.813 --rc genhtml_function_coverage=1 00:18:39.813 --rc genhtml_legend=1 00:18:39.813 --rc geninfo_all_blocks=1 00:18:39.813 --rc geninfo_unexecuted_blocks=1 00:18:39.813 00:18:39.813 ' 00:18:39.813 15:13:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:39.813 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:39.813 --rc genhtml_branch_coverage=1 00:18:39.813 --rc genhtml_function_coverage=1 00:18:39.813 --rc genhtml_legend=1 00:18:39.813 --rc geninfo_all_blocks=1 00:18:39.813 --rc geninfo_unexecuted_blocks=1 00:18:39.813 00:18:39.813 ' 00:18:39.813 15:13:39 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:39.813 15:13:39 -- nvmf/common.sh@7 -- # uname -s 00:18:39.813 15:13:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:39.814 15:13:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:39.814 15:13:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:39.814 15:13:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:39.814 15:13:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:39.814 15:13:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:39.814 15:13:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:39.814 15:13:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:39.814 15:13:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:39.814 15:13:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:39.814 15:13:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:39.814 15:13:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:39.814 15:13:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:39.814 15:13:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:39.814 15:13:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:39.814 15:13:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:39.814 15:13:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:39.814 15:13:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:39.814 15:13:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:39.814 15:13:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.814 15:13:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.814 15:13:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.814 15:13:39 -- paths/export.sh@5 -- # export PATH 00:18:39.814 15:13:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:39.814 15:13:39 -- nvmf/common.sh@46 -- # : 0 00:18:39.814 15:13:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:39.814 15:13:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:39.814 15:13:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:39.814 15:13:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:39.814 15:13:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:39.814 15:13:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:39.814 15:13:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:39.814 15:13:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:39.814 15:13:39 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:39.814 15:13:39 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:39.814 15:13:39 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:39.814 15:13:39 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:39.814 15:13:39 -- target/multipath.sh@43 -- # nvmftestinit 00:18:39.814 15:13:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:39.814 15:13:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:39.814 15:13:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:39.814 15:13:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:39.814 15:13:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:39.814 15:13:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:39.814 15:13:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:39.814 15:13:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:39.814 15:13:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:39.814 15:13:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:39.814 15:13:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:39.814 15:13:39 -- common/autotest_common.sh@10 -- # set +x 00:18:41.714 15:13:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:41.714 15:13:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:41.714 15:13:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:41.714 15:13:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:41.714 15:13:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:41.714 15:13:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:41.714 15:13:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:41.714 15:13:41 -- nvmf/common.sh@294 -- # net_devs=() 00:18:41.714 15:13:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:41.714 15:13:41 -- nvmf/common.sh@295 -- # e810=() 00:18:41.714 15:13:41 -- nvmf/common.sh@295 -- # local -ga e810 00:18:41.714 15:13:41 -- nvmf/common.sh@296 -- # x722=() 00:18:41.714 15:13:41 -- nvmf/common.sh@296 -- # local -ga x722 00:18:41.714 15:13:41 -- nvmf/common.sh@297 -- # mlx=() 00:18:41.714 15:13:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:41.714 15:13:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:41.714 15:13:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:41.714 15:13:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:41.714 15:13:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:41.714 15:13:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:41.714 15:13:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:41.714 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:41.714 15:13:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:41.714 15:13:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:41.714 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:41.714 15:13:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:41.714 15:13:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:41.714 15:13:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:41.714 15:13:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:41.714 15:13:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:41.714 15:13:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:41.714 15:13:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:41.714 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:41.714 15:13:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:41.714 15:13:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:41.714 15:13:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:41.714 15:13:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:41.714 15:13:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:41.714 15:13:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:41.714 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:41.714 15:13:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:41.715 15:13:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:41.715 15:13:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:41.715 15:13:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:41.715 15:13:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:41.715 15:13:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:41.715 15:13:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:41.715 15:13:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:41.715 15:13:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:41.715 15:13:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:41.715 15:13:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:41.715 15:13:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:41.715 15:13:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:41.715 15:13:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:41.715 15:13:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:41.715 15:13:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:41.715 15:13:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:41.715 15:13:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:41.715 15:13:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:42.006 15:13:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:42.006 15:13:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:42.006 15:13:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:42.006 15:13:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:42.006 15:13:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:42.006 15:13:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:42.006 15:13:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:42.006 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:42.006 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.257 ms 00:18:42.006 00:18:42.006 --- 10.0.0.2 ping statistics --- 00:18:42.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.006 rtt min/avg/max/mdev = 0.257/0.257/0.257/0.000 ms 00:18:42.006 15:13:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:42.006 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:42.006 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:18:42.006 00:18:42.006 --- 10.0.0.1 ping statistics --- 00:18:42.006 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:42.006 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:18:42.006 15:13:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:42.006 15:13:42 -- nvmf/common.sh@410 -- # return 0 00:18:42.006 15:13:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:42.006 15:13:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:42.006 15:13:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:42.006 15:13:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:42.006 15:13:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:42.006 15:13:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:42.006 15:13:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:42.006 15:13:42 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:42.006 15:13:42 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:42.006 only one NIC for nvmf test 00:18:42.006 15:13:42 -- target/multipath.sh@47 -- # nvmftestfini 00:18:42.006 15:13:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:42.006 15:13:42 -- nvmf/common.sh@116 -- # sync 00:18:42.006 15:13:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:42.006 15:13:42 -- nvmf/common.sh@119 -- # set +e 00:18:42.006 15:13:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:42.006 15:13:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:42.006 rmmod nvme_tcp 00:18:42.006 rmmod nvme_fabrics 00:18:42.006 rmmod nvme_keyring 00:18:42.006 15:13:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:42.006 15:13:42 -- nvmf/common.sh@123 -- # set -e 00:18:42.006 15:13:42 -- nvmf/common.sh@124 -- # return 0 00:18:42.006 15:13:42 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:42.006 15:13:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:42.006 15:13:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:42.006 15:13:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:42.006 15:13:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:42.006 15:13:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:42.006 15:13:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.006 15:13:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.006 15:13:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.558 15:13:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:44.558 15:13:44 -- target/multipath.sh@48 -- # exit 0 00:18:44.558 15:13:44 -- target/multipath.sh@1 -- # nvmftestfini 00:18:44.558 15:13:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:44.558 15:13:44 -- nvmf/common.sh@116 -- # sync 00:18:44.558 15:13:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:44.558 15:13:44 -- nvmf/common.sh@119 -- # set +e 00:18:44.558 15:13:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:44.558 15:13:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:44.558 15:13:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:44.558 15:13:44 -- nvmf/common.sh@123 -- # set -e 00:18:44.558 15:13:44 -- nvmf/common.sh@124 -- # return 0 00:18:44.558 15:13:44 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:44.558 15:13:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:44.558 15:13:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:44.558 15:13:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:44.558 15:13:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:44.558 15:13:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:44.558 15:13:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:44.558 15:13:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:44.558 15:13:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.559 15:13:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:44.559 00:18:44.559 real 0m4.536s 00:18:44.559 user 0m0.902s 00:18:44.559 sys 0m1.502s 00:18:44.559 15:13:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:44.559 15:13:44 -- common/autotest_common.sh@10 -- # set +x 00:18:44.559 ************************************ 00:18:44.559 END TEST nvmf_multipath 00:18:44.559 ************************************ 00:18:44.559 15:13:44 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:44.559 15:13:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:44.559 15:13:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:44.559 15:13:44 -- common/autotest_common.sh@10 -- # set +x 00:18:44.559 ************************************ 00:18:44.559 START TEST nvmf_zcopy 00:18:44.559 ************************************ 00:18:44.559 15:13:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:44.559 * Looking for test storage... 00:18:44.559 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:44.559 15:13:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:44.559 15:13:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:44.559 15:13:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:44.559 15:13:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:44.559 15:13:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:44.559 15:13:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:44.559 15:13:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:44.559 15:13:44 -- scripts/common.sh@335 -- # IFS=.-: 00:18:44.559 15:13:44 -- scripts/common.sh@335 -- # read -ra ver1 00:18:44.559 15:13:44 -- scripts/common.sh@336 -- # IFS=.-: 00:18:44.559 15:13:44 -- scripts/common.sh@336 -- # read -ra ver2 00:18:44.559 15:13:44 -- scripts/common.sh@337 -- # local 'op=<' 00:18:44.559 15:13:44 -- scripts/common.sh@339 -- # ver1_l=2 00:18:44.559 15:13:44 -- scripts/common.sh@340 -- # ver2_l=1 00:18:44.559 15:13:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:44.559 15:13:44 -- scripts/common.sh@343 -- # case "$op" in 00:18:44.559 15:13:44 -- scripts/common.sh@344 -- # : 1 00:18:44.559 15:13:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:44.559 15:13:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:44.559 15:13:44 -- scripts/common.sh@364 -- # decimal 1 00:18:44.559 15:13:44 -- scripts/common.sh@352 -- # local d=1 00:18:44.559 15:13:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:44.559 15:13:44 -- scripts/common.sh@354 -- # echo 1 00:18:44.559 15:13:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:44.559 15:13:44 -- scripts/common.sh@365 -- # decimal 2 00:18:44.559 15:13:44 -- scripts/common.sh@352 -- # local d=2 00:18:44.559 15:13:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:44.559 15:13:44 -- scripts/common.sh@354 -- # echo 2 00:18:44.559 15:13:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:44.559 15:13:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:44.559 15:13:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:44.559 15:13:44 -- scripts/common.sh@367 -- # return 0 00:18:44.559 15:13:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:44.559 15:13:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:44.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.559 --rc genhtml_branch_coverage=1 00:18:44.559 --rc genhtml_function_coverage=1 00:18:44.559 --rc genhtml_legend=1 00:18:44.559 --rc geninfo_all_blocks=1 00:18:44.559 --rc geninfo_unexecuted_blocks=1 00:18:44.559 00:18:44.559 ' 00:18:44.559 15:13:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:44.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.559 --rc genhtml_branch_coverage=1 00:18:44.559 --rc genhtml_function_coverage=1 00:18:44.559 --rc genhtml_legend=1 00:18:44.559 --rc geninfo_all_blocks=1 00:18:44.559 --rc geninfo_unexecuted_blocks=1 00:18:44.559 00:18:44.559 ' 00:18:44.559 15:13:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:44.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.559 --rc genhtml_branch_coverage=1 00:18:44.559 --rc genhtml_function_coverage=1 00:18:44.559 --rc genhtml_legend=1 00:18:44.559 --rc geninfo_all_blocks=1 00:18:44.559 --rc geninfo_unexecuted_blocks=1 00:18:44.559 00:18:44.559 ' 00:18:44.559 15:13:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:44.559 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:44.559 --rc genhtml_branch_coverage=1 00:18:44.559 --rc genhtml_function_coverage=1 00:18:44.559 --rc genhtml_legend=1 00:18:44.559 --rc geninfo_all_blocks=1 00:18:44.559 --rc geninfo_unexecuted_blocks=1 00:18:44.559 00:18:44.559 ' 00:18:44.559 15:13:44 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:44.559 15:13:44 -- nvmf/common.sh@7 -- # uname -s 00:18:44.559 15:13:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:44.559 15:13:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:44.559 15:13:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:44.559 15:13:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:44.559 15:13:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:44.559 15:13:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:44.559 15:13:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:44.559 15:13:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:44.559 15:13:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:44.559 15:13:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:44.559 15:13:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:44.559 15:13:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:44.559 15:13:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:44.559 15:13:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:44.559 15:13:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:44.559 15:13:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:44.559 15:13:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:44.559 15:13:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:44.559 15:13:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:44.559 15:13:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.559 15:13:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.559 15:13:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.559 15:13:44 -- paths/export.sh@5 -- # export PATH 00:18:44.559 15:13:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:44.559 15:13:44 -- nvmf/common.sh@46 -- # : 0 00:18:44.559 15:13:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:44.559 15:13:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:44.559 15:13:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:44.559 15:13:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:44.559 15:13:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:44.559 15:13:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:44.559 15:13:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:44.559 15:13:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:44.560 15:13:44 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:44.560 15:13:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:44.560 15:13:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:44.560 15:13:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:44.560 15:13:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:44.560 15:13:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:44.560 15:13:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:44.560 15:13:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:44.560 15:13:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:44.560 15:13:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:44.560 15:13:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:44.560 15:13:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:44.560 15:13:44 -- common/autotest_common.sh@10 -- # set +x 00:18:46.460 15:13:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:46.460 15:13:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:46.460 15:13:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:46.460 15:13:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:46.460 15:13:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:46.460 15:13:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:46.460 15:13:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:46.460 15:13:46 -- nvmf/common.sh@294 -- # net_devs=() 00:18:46.460 15:13:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:46.460 15:13:46 -- nvmf/common.sh@295 -- # e810=() 00:18:46.460 15:13:46 -- nvmf/common.sh@295 -- # local -ga e810 00:18:46.460 15:13:46 -- nvmf/common.sh@296 -- # x722=() 00:18:46.460 15:13:46 -- nvmf/common.sh@296 -- # local -ga x722 00:18:46.460 15:13:46 -- nvmf/common.sh@297 -- # mlx=() 00:18:46.460 15:13:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:46.460 15:13:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:46.460 15:13:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:46.460 15:13:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:46.460 15:13:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:46.460 15:13:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:46.460 15:13:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:46.460 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:46.460 15:13:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:46.460 15:13:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:46.460 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:46.460 15:13:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:46.460 15:13:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:46.460 15:13:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:46.460 15:13:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:46.460 15:13:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:46.460 15:13:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:46.460 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:46.460 15:13:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:46.460 15:13:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:46.460 15:13:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:46.460 15:13:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:46.460 15:13:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:46.460 15:13:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:46.460 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:46.460 15:13:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:46.460 15:13:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:46.460 15:13:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:46.460 15:13:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:46.460 15:13:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:46.460 15:13:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:46.460 15:13:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:46.460 15:13:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:46.460 15:13:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:46.460 15:13:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:46.460 15:13:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:46.460 15:13:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:46.460 15:13:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:46.460 15:13:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:46.460 15:13:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:46.460 15:13:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:46.460 15:13:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:46.460 15:13:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:46.460 15:13:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:46.460 15:13:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:46.460 15:13:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:46.460 15:13:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:46.460 15:13:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:46.460 15:13:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:46.460 15:13:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:46.460 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:46.460 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:18:46.460 00:18:46.460 --- 10.0.0.2 ping statistics --- 00:18:46.460 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:46.460 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:18:46.460 15:13:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:46.719 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:46.719 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:18:46.719 00:18:46.719 --- 10.0.0.1 ping statistics --- 00:18:46.719 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:46.719 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:18:46.719 15:13:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:46.719 15:13:46 -- nvmf/common.sh@410 -- # return 0 00:18:46.719 15:13:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:46.719 15:13:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:46.719 15:13:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:46.719 15:13:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:46.719 15:13:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:46.719 15:13:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:46.719 15:13:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:46.719 15:13:46 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:46.719 15:13:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:46.719 15:13:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:46.719 15:13:46 -- common/autotest_common.sh@10 -- # set +x 00:18:46.719 15:13:46 -- nvmf/common.sh@469 -- # nvmfpid=717151 00:18:46.719 15:13:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:46.719 15:13:46 -- nvmf/common.sh@470 -- # waitforlisten 717151 00:18:46.719 15:13:46 -- common/autotest_common.sh@829 -- # '[' -z 717151 ']' 00:18:46.719 15:13:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:46.719 15:13:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:46.719 15:13:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:46.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:46.719 15:13:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:46.719 15:13:46 -- common/autotest_common.sh@10 -- # set +x 00:18:46.719 [2024-11-28 15:13:46.764830] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:46.719 [2024-11-28 15:13:46.764922] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:46.720 EAL: No free 2048 kB hugepages reported on node 1 00:18:46.720 [2024-11-28 15:13:46.833475] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:46.720 [2024-11-28 15:13:46.925618] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:46.720 [2024-11-28 15:13:46.925796] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:46.720 [2024-11-28 15:13:46.925816] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:46.720 [2024-11-28 15:13:46.925830] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:46.720 [2024-11-28 15:13:46.925868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:47.655 15:13:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:47.655 15:13:47 -- common/autotest_common.sh@862 -- # return 0 00:18:47.655 15:13:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:47.655 15:13:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 15:13:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:47.655 15:13:47 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:47.655 15:13:47 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:47.655 15:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 [2024-11-28 15:13:47.793595] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:47.655 15:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.655 15:13:47 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:47.655 15:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 15:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.655 15:13:47 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:47.655 15:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 [2024-11-28 15:13:47.809740] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:47.655 15:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.655 15:13:47 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:47.655 15:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 15:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.655 15:13:47 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:47.655 15:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 malloc0 00:18:47.655 15:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.655 15:13:47 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:47.655 15:13:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:47.655 15:13:47 -- common/autotest_common.sh@10 -- # set +x 00:18:47.655 15:13:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:47.655 15:13:47 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:47.655 15:13:47 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:47.655 15:13:47 -- nvmf/common.sh@520 -- # config=() 00:18:47.655 15:13:47 -- nvmf/common.sh@520 -- # local subsystem config 00:18:47.655 15:13:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:47.655 15:13:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:47.655 { 00:18:47.655 "params": { 00:18:47.655 "name": "Nvme$subsystem", 00:18:47.655 "trtype": "$TEST_TRANSPORT", 00:18:47.655 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:47.655 "adrfam": "ipv4", 00:18:47.655 "trsvcid": "$NVMF_PORT", 00:18:47.655 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:47.655 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:47.655 "hdgst": ${hdgst:-false}, 00:18:47.655 "ddgst": ${ddgst:-false} 00:18:47.655 }, 00:18:47.655 "method": "bdev_nvme_attach_controller" 00:18:47.655 } 00:18:47.655 EOF 00:18:47.655 )") 00:18:47.655 15:13:47 -- nvmf/common.sh@542 -- # cat 00:18:47.655 15:13:47 -- nvmf/common.sh@544 -- # jq . 00:18:47.655 15:13:47 -- nvmf/common.sh@545 -- # IFS=, 00:18:47.655 15:13:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:47.655 "params": { 00:18:47.655 "name": "Nvme1", 00:18:47.655 "trtype": "tcp", 00:18:47.655 "traddr": "10.0.0.2", 00:18:47.655 "adrfam": "ipv4", 00:18:47.655 "trsvcid": "4420", 00:18:47.655 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:47.655 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:47.655 "hdgst": false, 00:18:47.655 "ddgst": false 00:18:47.655 }, 00:18:47.655 "method": "bdev_nvme_attach_controller" 00:18:47.655 }' 00:18:47.914 [2024-11-28 15:13:47.890315] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:47.914 [2024-11-28 15:13:47.890392] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid717314 ] 00:18:47.914 EAL: No free 2048 kB hugepages reported on node 1 00:18:47.914 [2024-11-28 15:13:47.959514] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:47.914 [2024-11-28 15:13:48.054016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:48.173 Running I/O for 10 seconds... 00:18:58.148 00:18:58.148 Latency(us) 00:18:58.148 [2024-11-28T14:13:58.382Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:58.148 [2024-11-28T14:13:58.382Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:58.148 Verification LBA range: start 0x0 length 0x1000 00:18:58.148 Nvme1n1 : 10.01 8655.71 67.62 0.00 0.00 14752.32 1565.58 22719.15 00:18:58.148 [2024-11-28T14:13:58.382Z] =================================================================================================================== 00:18:58.148 [2024-11-28T14:13:58.382Z] Total : 8655.71 67.62 0.00 0.00 14752.32 1565.58 22719.15 00:18:58.407 15:13:58 -- target/zcopy.sh@39 -- # perfpid=718656 00:18:58.407 15:13:58 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:58.407 15:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:58.407 15:13:58 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:58.407 15:13:58 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:58.407 15:13:58 -- nvmf/common.sh@520 -- # config=() 00:18:58.407 15:13:58 -- nvmf/common.sh@520 -- # local subsystem config 00:18:58.407 15:13:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:58.407 15:13:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:58.407 { 00:18:58.407 "params": { 00:18:58.407 "name": "Nvme$subsystem", 00:18:58.407 "trtype": "$TEST_TRANSPORT", 00:18:58.407 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:58.407 "adrfam": "ipv4", 00:18:58.407 "trsvcid": "$NVMF_PORT", 00:18:58.407 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:58.407 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:58.407 "hdgst": ${hdgst:-false}, 00:18:58.407 "ddgst": ${ddgst:-false} 00:18:58.407 }, 00:18:58.407 "method": "bdev_nvme_attach_controller" 00:18:58.407 } 00:18:58.407 EOF 00:18:58.407 )") 00:18:58.407 15:13:58 -- nvmf/common.sh@542 -- # cat 00:18:58.407 [2024-11-28 15:13:58.557824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.557874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 15:13:58 -- nvmf/common.sh@544 -- # jq . 00:18:58.407 15:13:58 -- nvmf/common.sh@545 -- # IFS=, 00:18:58.407 15:13:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:58.407 "params": { 00:18:58.407 "name": "Nvme1", 00:18:58.407 "trtype": "tcp", 00:18:58.407 "traddr": "10.0.0.2", 00:18:58.407 "adrfam": "ipv4", 00:18:58.407 "trsvcid": "4420", 00:18:58.407 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:58.407 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:58.407 "hdgst": false, 00:18:58.407 "ddgst": false 00:18:58.407 }, 00:18:58.407 "method": "bdev_nvme_attach_controller" 00:18:58.407 }' 00:18:58.407 [2024-11-28 15:13:58.565772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.565808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.573792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.573817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.581802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.581823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.589823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.589843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.593340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:18:58.407 [2024-11-28 15:13:58.593411] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid718656 ] 00:18:58.407 [2024-11-28 15:13:58.597841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.597861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.605864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.605885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.613885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.613905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 EAL: No free 2048 kB hugepages reported on node 1 00:18:58.407 [2024-11-28 15:13:58.621907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.621927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.629948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.629973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.407 [2024-11-28 15:13:58.637971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.407 [2024-11-28 15:13:58.637996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.645994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.646019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.654016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.654041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.656839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:58.666 [2024-11-28 15:13:58.662051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.662081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.670108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.670173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.678091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.678151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.686116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.686154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.694150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.694172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.702166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.702188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.710198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.710225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.718236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.718270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.726220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.726242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.734243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.734264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.742264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.742286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.750283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.750304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.666 [2024-11-28 15:13:58.751374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:58.666 [2024-11-28 15:13:58.758305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.666 [2024-11-28 15:13:58.758326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.766340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.766366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.774399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.774435] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.782418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.782468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.790447] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.790485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.798477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.798517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.806502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.806543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.814516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.814556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.822525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.822550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.830563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.830600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.838596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.838638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.846602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.846651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.854599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.854624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.862630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.862659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.870655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.870684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.878673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.878701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.886697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.886724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.667 [2024-11-28 15:13:58.894716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.667 [2024-11-28 15:13:58.894744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.925 [2024-11-28 15:13:58.902734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.902759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.910761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.910786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.918785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.918809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.926808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.926833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.934834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.934862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.942857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.942885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.950879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.950904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.958901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.958926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.966921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.966947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.974942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.974967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.982963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.982989] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.990986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.991012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:58.999009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:58.999041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.007033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.007059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.015054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.015080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.023079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.023113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.031117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.031158] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.039146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.039168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.047164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.047185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.055182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.055204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.063202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.063225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.071225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.071248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.079250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.079273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.087276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.087303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.095291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.095313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 Running I/O for 5 seconds... 00:18:58.926 [2024-11-28 15:13:59.106267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.106295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.115660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.115691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.127477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.127524] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.138402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.138446] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.926 [2024-11-28 15:13:59.151263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.926 [2024-11-28 15:13:59.151292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.161300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.161328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.171706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.171737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.182626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.182655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.195274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.195302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.205369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.205399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.216913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.216944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.228259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.228287] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.241647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.241678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.251684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.251716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.262992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.263023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.273975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.274006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.285532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.285564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.296256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.296284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.307000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.307031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.317613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.317644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.328392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.328423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.339466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.339498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.352027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.352057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.362004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.362035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.372603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.372634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.385386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.385418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.395481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.395512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.185 [2024-11-28 15:13:59.406291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.185 [2024-11-28 15:13:59.406321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.444 [2024-11-28 15:13:59.418968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.444 [2024-11-28 15:13:59.418998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.444 [2024-11-28 15:13:59.429520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.444 [2024-11-28 15:13:59.429551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.444 [2024-11-28 15:13:59.440568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.440600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.451840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.451872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.462806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.462836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.475534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.475565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.486163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.486193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.497315] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.497346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.509925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.509956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.520040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.520070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.531174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.531205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.544009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.544041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.554032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.554063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.565248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.565279] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.577952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.577984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.588146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.588184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.599304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.599336] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.611854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.611885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.622069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.622110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.633281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.633312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.643662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.643693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.654586] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.654617] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.667418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.667449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.445 [2024-11-28 15:13:59.677607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.445 [2024-11-28 15:13:59.677638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.688555] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.688586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.699088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.699126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.710010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.710041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.723475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.723506] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.733913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.733943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.744331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.744362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.755356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.755387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.768458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.768489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.778452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.778483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.789627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.789658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.800692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.800732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.811946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.811977] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.822657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.822687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.835259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.835291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.845168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.845200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.856522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.856553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.869056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.869087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.878206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.878237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.890318] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.890348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.900871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.900902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.912209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.912241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.924912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.924943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.704 [2024-11-28 15:13:59.934569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.704 [2024-11-28 15:13:59.934600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.963 [2024-11-28 15:13:59.945403] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.963 [2024-11-28 15:13:59.945434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.963 [2024-11-28 15:13:59.956594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.963 [2024-11-28 15:13:59.956626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.963 [2024-11-28 15:13:59.967628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.963 [2024-11-28 15:13:59.967659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.963 [2024-11-28 15:13:59.980530] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.963 [2024-11-28 15:13:59.980561] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.963 [2024-11-28 15:13:59.991255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.963 [2024-11-28 15:13:59.991286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.963 [2024-11-28 15:14:00.002214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.963 [2024-11-28 15:14:00.002245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.013497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.013540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.025420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.025453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.036228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.036259] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.049452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.049485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.059977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.060009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.070951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.070981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.081591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.081622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.092957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.092988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.103872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.103903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.115091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.115132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.126576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.126608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.137880] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.137911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.148871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.148902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.160303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.160334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.171411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.171442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.182411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.182442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.964 [2024-11-28 15:14:00.193160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.964 [2024-11-28 15:14:00.193191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.204430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.204462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.215322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.215354] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.228663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.228704] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.238920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.238951] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.249723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.249755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.260899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.260930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.272065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.272105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.282950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.282982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.294451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.294483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.305492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.305523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.316688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.316719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.328200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.328232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.338856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.338888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.349972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.350004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.360655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.360687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.373383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.373415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.383888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.383919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.394983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.395014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.407953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.407985] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.418380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.418410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.429236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.429267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.441707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.441750] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.223 [2024-11-28 15:14:00.451706] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.223 [2024-11-28 15:14:00.451738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.482 [2024-11-28 15:14:00.463894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.482 [2024-11-28 15:14:00.463926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.482 [2024-11-28 15:14:00.474470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.482 [2024-11-28 15:14:00.474500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.482 [2024-11-28 15:14:00.485479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.482 [2024-11-28 15:14:00.485511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.482 [2024-11-28 15:14:00.496577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.482 [2024-11-28 15:14:00.496608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.482 [2024-11-28 15:14:00.507420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.482 [2024-11-28 15:14:00.507451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.482 [2024-11-28 15:14:00.518327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.482 [2024-11-28 15:14:00.518359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.529316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.529348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.540392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.540423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.551524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.551556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.564439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.564470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.574997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.575028] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.586084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.586126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.598520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.598551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.608333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.608365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.619619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.619651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.633204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.633236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.643341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.643372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.654664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.654695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.665172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.665204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.676135] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.676167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.687217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.687248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.698313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.698346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.483 [2024-11-28 15:14:00.709453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.483 [2024-11-28 15:14:00.709484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.720594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.720626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.731619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.731651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.742614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.742646] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.754291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.754322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.765495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.765527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.776443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.776475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.789965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.790001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.800552] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.800583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.811705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.811737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.824490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.824521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.834387] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.834417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.845510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.845541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.856983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.857013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.868423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.868455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.881431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.881472] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.891525] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.891556] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.902342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.902372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.913343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.913374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.923910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.923942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.934576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.934606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.945268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.945298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.956035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.956068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.742 [2024-11-28 15:14:00.966798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.742 [2024-11-28 15:14:00.966829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:00.979386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.001 [2024-11-28 15:14:00.979417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:00.989114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.001 [2024-11-28 15:14:00.989145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:01.001179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.001 [2024-11-28 15:14:01.001224] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:01.011678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.001 [2024-11-28 15:14:01.011708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:01.022565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.001 [2024-11-28 15:14:01.022596] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:01.035327] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.001 [2024-11-28 15:14:01.035358] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.001 [2024-11-28 15:14:01.045190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.045221] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.056090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.056130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.068263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.068294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.077375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.077405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.089263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.089294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.102022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.102053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.112255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.112285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.123886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.123917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.134675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.134705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.145498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.145529] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.156149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.156180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.168776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.168807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.179186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.179217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.189890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.189921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.202288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.202320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.211680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.211716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.002 [2024-11-28 15:14:01.224916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.002 [2024-11-28 15:14:01.224947] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.235180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.235211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.246941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.246973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.257689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.257720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.268959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.268990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.279868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.279907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.292757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.292789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.302701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.302731] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.313818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.313849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.326769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.326800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.336809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.336841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.348320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.348351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.361163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.361194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.371395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.371426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.382323] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.382355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.394704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.394735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.403781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.403813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.416082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.416125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.427759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.427791] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.438840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.438871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.451653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.451684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.461829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.261 [2024-11-28 15:14:01.461861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.261 [2024-11-28 15:14:01.472529] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.262 [2024-11-28 15:14:01.472560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.262 [2024-11-28 15:14:01.483217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.262 [2024-11-28 15:14:01.483249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.262 [2024-11-28 15:14:01.493932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.262 [2024-11-28 15:14:01.493971] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.504766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.504798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.515677] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.515709] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.526986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.527018] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.538293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.538325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.549181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.549212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.560066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.560106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.571178] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.571208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.582536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.519 [2024-11-28 15:14:01.582567] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.519 [2024-11-28 15:14:01.593299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.593331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.603668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.603700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.614767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.614798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.625711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.625742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.636709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.636739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.647478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.647510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.658574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.658606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.671393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.671426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.681954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.681986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.693129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.693160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.705737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.705777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.715937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.715968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.727229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.727261] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.740146] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.740178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.520 [2024-11-28 15:14:01.750762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.520 [2024-11-28 15:14:01.750795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.761598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.761629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.774246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.774278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.784275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.784306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.794884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.794916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.807939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.807972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.818547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.818579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.829459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.829490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.842271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.842302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.852158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.852190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.864343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.864374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.875448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.875480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.888314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.888346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.898562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.898594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.909580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.909612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.922513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.922552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.932815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.932846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.943740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.943771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.954864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.954896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.965734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.965766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.978579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.978612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.988808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.988839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:01.999590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:01.999622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.779 [2024-11-28 15:14:02.010889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.779 [2024-11-28 15:14:02.010921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.038 [2024-11-28 15:14:02.021813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.038 [2024-11-28 15:14:02.021844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.038 [2024-11-28 15:14:02.034766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.038 [2024-11-28 15:14:02.034797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.038 [2024-11-28 15:14:02.045461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.045492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.056384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.056415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.068750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.068781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.077909] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.077941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.090967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.090999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.101897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.101929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.113132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.113164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.124088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.124128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.134925] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.134965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.146108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.146140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.159138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.159171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.169328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.169360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.179992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.180025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.190804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.190835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.201592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.201623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.214460] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.214492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.224667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.224699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.235276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.235307] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.246307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.246338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.257543] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.257575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.039 [2024-11-28 15:14:02.268520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.039 [2024-11-28 15:14:02.268550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.279504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.279535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.290535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.290565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.301675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.301706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.312779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.312809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.324253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.324284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.337164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.337195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.348041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.348073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.358968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.359000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.370405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.370437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.381492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.381523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.392410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.392442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.403645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.403676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.415132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.415163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.426354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.426384] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.437688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.437719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.448955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.448986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.460258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.460289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.471472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.471504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.482792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.482823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.493449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.493481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.505912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.505943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.515230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.515262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.299 [2024-11-28 15:14:02.528259] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.299 [2024-11-28 15:14:02.528290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.538696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.538728] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.549674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.549706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.560886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.560917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.572444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.572475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.583886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.583917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.596676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.596708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.606293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.606324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.618289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.618321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.628874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.628905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.640273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.640305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.653718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.653749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.664086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.664127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.675154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.675186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.685682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.685713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.696881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.696912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.709829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.709860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.720439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.720470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.731861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.731893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.743352] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.743383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.756182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.756214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.766809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.766841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.559 [2024-11-28 15:14:02.777935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.559 [2024-11-28 15:14:02.777966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.560 [2024-11-28 15:14:02.789062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.560 [2024-11-28 15:14:02.789115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.800265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.800297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.812770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.812802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.822307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.822338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.834026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.834057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.846625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.846656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.857174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.857206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.867910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.867941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.878813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.878844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.889646] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.889677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.900511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.900542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.911948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.911980] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.924748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.924779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.933963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.933994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.946145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.946176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.959141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.959172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.969710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.969742] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.980742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.980783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:02.993897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:02.993930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:03.004194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:03.004225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:03.014928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:03.014959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:03.028263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:03.028295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:03.038058] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:03.038089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:02.819 [2024-11-28 15:14:03.049459] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:02.819 [2024-11-28 15:14:03.049491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.062601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.062633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.073360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.073391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.084107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.084147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.095351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.095382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.106202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.106234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.117410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.117441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.128625] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.128656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.141650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.141681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.151374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.151405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.161998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.162029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.175080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.175121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.185507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.185538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.196776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.196816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.209370] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.209401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.219269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.219301] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.230373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.230405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.242873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.242905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.252722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.252753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.263839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.263871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.274650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.274681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.286000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.286032] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.297086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.297125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.079 [2024-11-28 15:14:03.308081] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.079 [2024-11-28 15:14:03.308121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.321012] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.321043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.330827] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.330859] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.342123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.342154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.352843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.352875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.363969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.364000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.377414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.377445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.387648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.387680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.398382] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.398413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.408899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.408938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.419819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.419851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.430603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.430634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.442079] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.338 [2024-11-28 15:14:03.442121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.338 [2024-11-28 15:14:03.453725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.453758] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.464681] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.464711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.475948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.475981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.487075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.487115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.498361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.498392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.509741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.509771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.520678] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.520710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.531663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.531695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.544589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.544621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.554983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.555014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.339 [2024-11-28 15:14:03.566064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.339 [2024-11-28 15:14:03.566104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.577056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.577087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.588243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.588273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.598994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.599025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.610103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.610135] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.623161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.623206] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.633691] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.633722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.644220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.644251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.598 [2024-11-28 15:14:03.655052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.598 [2024-11-28 15:14:03.655083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.665906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.665938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.676844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.676875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.687979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.688010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.701036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.701067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.711251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.711282] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.721907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.721939] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.732755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.732787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.743835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.743867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.756372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.756403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.765841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.765874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.778911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.778943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.789380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.789412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.800173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.800205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.812999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.813031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.599 [2024-11-28 15:14:03.823260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.599 [2024-11-28 15:14:03.823291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.834214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.834253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.845395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.845427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.856609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.856640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.869161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.869193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.879069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.879110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.891086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.891127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.902334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.902366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.915271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.915305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.925666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.925698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.936798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.936830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.954021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.954053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.964528] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.964558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.975350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.975381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.988597] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.988628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:03.998979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:03.999010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:04.010045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:04.010076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:04.021124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.858 [2024-11-28 15:14:04.021154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.858 [2024-11-28 15:14:04.032194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.859 [2024-11-28 15:14:04.032225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.859 [2024-11-28 15:14:04.042794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.859 [2024-11-28 15:14:04.042825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.859 [2024-11-28 15:14:04.053978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.859 [2024-11-28 15:14:04.054009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.859 [2024-11-28 15:14:04.064768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.859 [2024-11-28 15:14:04.064799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.859 [2024-11-28 15:14:04.076009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.859 [2024-11-28 15:14:04.076040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:03.859 [2024-11-28 15:14:04.088881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:03.859 [2024-11-28 15:14:04.088912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.099109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.099140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.110028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.110060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.120313] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.120343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 00:19:04.118 Latency(us) 00:19:04.118 [2024-11-28T14:14:04.352Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:04.118 [2024-11-28T14:14:04.352Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:04.118 Nvme1n1 : 5.01 11585.36 90.51 0.00 0.00 11034.04 4708.88 17573.36 00:19:04.118 [2024-11-28T14:14:04.352Z] =================================================================================================================== 00:19:04.118 [2024-11-28T14:14:04.352Z] Total : 11585.36 90.51 0.00 0.00 11034.04 4708.88 17573.36 00:19:04.118 [2024-11-28 15:14:04.125671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.125699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.133686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.133715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.141728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.141763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.149806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.149854] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.157800] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.157846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.165837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.165900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.173837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.173885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.181884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.181943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.189904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.189952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.197913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.197960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.205960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.206008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.213961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.214009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.221985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.222034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.230009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.230057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.238026] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.238072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.246047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.118 [2024-11-28 15:14:04.246112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.118 [2024-11-28 15:14:04.254050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.254111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.262045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.262070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.270086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.270129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.278144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.278192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.286161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.286209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.294143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.294171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.302169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.302199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.310236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.310285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.318248] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.318294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.326222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.326246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.334247] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.334273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 [2024-11-28 15:14:04.342266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:04.119 [2024-11-28 15:14:04.342291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:04.119 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (718656) - No such process 00:19:04.119 15:14:04 -- target/zcopy.sh@49 -- # wait 718656 00:19:04.119 15:14:04 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:04.119 15:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.119 15:14:04 -- common/autotest_common.sh@10 -- # set +x 00:19:04.378 15:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.378 15:14:04 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:04.378 15:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.378 15:14:04 -- common/autotest_common.sh@10 -- # set +x 00:19:04.378 delay0 00:19:04.378 15:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.378 15:14:04 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:04.378 15:14:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:04.378 15:14:04 -- common/autotest_common.sh@10 -- # set +x 00:19:04.378 15:14:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:04.378 15:14:04 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:04.378 EAL: No free 2048 kB hugepages reported on node 1 00:19:04.378 [2024-11-28 15:14:04.509203] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:10.970 Initializing NVMe Controllers 00:19:10.970 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:10.970 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:10.970 Initialization complete. Launching workers. 00:19:10.970 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 82 00:19:10.970 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 369, failed to submit 33 00:19:10.970 success 174, unsuccess 195, failed 0 00:19:10.970 15:14:10 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:10.970 15:14:10 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:10.970 15:14:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:10.970 15:14:10 -- nvmf/common.sh@116 -- # sync 00:19:10.970 15:14:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:10.970 15:14:10 -- nvmf/common.sh@119 -- # set +e 00:19:10.971 15:14:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:10.971 15:14:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:10.971 rmmod nvme_tcp 00:19:10.971 rmmod nvme_fabrics 00:19:10.971 rmmod nvme_keyring 00:19:10.971 15:14:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:10.971 15:14:10 -- nvmf/common.sh@123 -- # set -e 00:19:10.971 15:14:10 -- nvmf/common.sh@124 -- # return 0 00:19:10.971 15:14:10 -- nvmf/common.sh@477 -- # '[' -n 717151 ']' 00:19:10.971 15:14:10 -- nvmf/common.sh@478 -- # killprocess 717151 00:19:10.971 15:14:10 -- common/autotest_common.sh@936 -- # '[' -z 717151 ']' 00:19:10.971 15:14:10 -- common/autotest_common.sh@940 -- # kill -0 717151 00:19:10.971 15:14:10 -- common/autotest_common.sh@941 -- # uname 00:19:10.971 15:14:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:10.971 15:14:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 717151 00:19:10.971 15:14:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:10.971 15:14:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:10.971 15:14:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 717151' 00:19:10.971 killing process with pid 717151 00:19:10.971 15:14:10 -- common/autotest_common.sh@955 -- # kill 717151 00:19:10.971 15:14:10 -- common/autotest_common.sh@960 -- # wait 717151 00:19:10.971 15:14:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:10.971 15:14:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:10.971 15:14:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:10.971 15:14:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:10.971 15:14:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:10.971 15:14:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:10.971 15:14:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:10.971 15:14:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:12.870 15:14:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:12.870 00:19:12.870 real 0m28.673s 00:19:12.870 user 0m42.059s 00:19:12.870 sys 0m8.271s 00:19:12.870 15:14:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:12.870 15:14:12 -- common/autotest_common.sh@10 -- # set +x 00:19:12.870 ************************************ 00:19:12.870 END TEST nvmf_zcopy 00:19:12.870 ************************************ 00:19:12.870 15:14:12 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:12.870 15:14:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:12.870 15:14:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:12.870 15:14:12 -- common/autotest_common.sh@10 -- # set +x 00:19:12.870 ************************************ 00:19:12.870 START TEST nvmf_nmic 00:19:12.870 ************************************ 00:19:12.870 15:14:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:12.870 * Looking for test storage... 00:19:12.870 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:12.870 15:14:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:12.870 15:14:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:12.870 15:14:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:13.128 15:14:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:13.128 15:14:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:13.128 15:14:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:13.128 15:14:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:13.128 15:14:13 -- scripts/common.sh@335 -- # IFS=.-: 00:19:13.128 15:14:13 -- scripts/common.sh@335 -- # read -ra ver1 00:19:13.128 15:14:13 -- scripts/common.sh@336 -- # IFS=.-: 00:19:13.128 15:14:13 -- scripts/common.sh@336 -- # read -ra ver2 00:19:13.128 15:14:13 -- scripts/common.sh@337 -- # local 'op=<' 00:19:13.128 15:14:13 -- scripts/common.sh@339 -- # ver1_l=2 00:19:13.128 15:14:13 -- scripts/common.sh@340 -- # ver2_l=1 00:19:13.128 15:14:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:13.128 15:14:13 -- scripts/common.sh@343 -- # case "$op" in 00:19:13.128 15:14:13 -- scripts/common.sh@344 -- # : 1 00:19:13.128 15:14:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:13.128 15:14:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:13.128 15:14:13 -- scripts/common.sh@364 -- # decimal 1 00:19:13.128 15:14:13 -- scripts/common.sh@352 -- # local d=1 00:19:13.128 15:14:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:13.128 15:14:13 -- scripts/common.sh@354 -- # echo 1 00:19:13.128 15:14:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:13.128 15:14:13 -- scripts/common.sh@365 -- # decimal 2 00:19:13.128 15:14:13 -- scripts/common.sh@352 -- # local d=2 00:19:13.128 15:14:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:13.128 15:14:13 -- scripts/common.sh@354 -- # echo 2 00:19:13.128 15:14:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:13.128 15:14:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:13.128 15:14:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:13.128 15:14:13 -- scripts/common.sh@367 -- # return 0 00:19:13.128 15:14:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:13.128 15:14:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:13.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:13.128 --rc genhtml_branch_coverage=1 00:19:13.128 --rc genhtml_function_coverage=1 00:19:13.128 --rc genhtml_legend=1 00:19:13.128 --rc geninfo_all_blocks=1 00:19:13.128 --rc geninfo_unexecuted_blocks=1 00:19:13.128 00:19:13.128 ' 00:19:13.128 15:14:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:13.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:13.128 --rc genhtml_branch_coverage=1 00:19:13.128 --rc genhtml_function_coverage=1 00:19:13.128 --rc genhtml_legend=1 00:19:13.128 --rc geninfo_all_blocks=1 00:19:13.128 --rc geninfo_unexecuted_blocks=1 00:19:13.128 00:19:13.128 ' 00:19:13.128 15:14:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:13.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:13.128 --rc genhtml_branch_coverage=1 00:19:13.128 --rc genhtml_function_coverage=1 00:19:13.128 --rc genhtml_legend=1 00:19:13.128 --rc geninfo_all_blocks=1 00:19:13.128 --rc geninfo_unexecuted_blocks=1 00:19:13.128 00:19:13.128 ' 00:19:13.128 15:14:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:13.128 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:13.128 --rc genhtml_branch_coverage=1 00:19:13.128 --rc genhtml_function_coverage=1 00:19:13.128 --rc genhtml_legend=1 00:19:13.128 --rc geninfo_all_blocks=1 00:19:13.128 --rc geninfo_unexecuted_blocks=1 00:19:13.128 00:19:13.128 ' 00:19:13.128 15:14:13 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:13.128 15:14:13 -- nvmf/common.sh@7 -- # uname -s 00:19:13.128 15:14:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:13.128 15:14:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:13.128 15:14:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:13.128 15:14:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:13.128 15:14:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:13.128 15:14:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:13.128 15:14:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:13.128 15:14:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:13.128 15:14:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:13.128 15:14:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:13.128 15:14:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:13.128 15:14:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:13.128 15:14:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:13.128 15:14:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:13.128 15:14:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:13.128 15:14:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:13.128 15:14:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:13.128 15:14:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:13.128 15:14:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:13.128 15:14:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.129 15:14:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.129 15:14:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.129 15:14:13 -- paths/export.sh@5 -- # export PATH 00:19:13.129 15:14:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:13.129 15:14:13 -- nvmf/common.sh@46 -- # : 0 00:19:13.129 15:14:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:13.129 15:14:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:13.129 15:14:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:13.129 15:14:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:13.129 15:14:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:13.129 15:14:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:13.129 15:14:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:13.129 15:14:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:13.129 15:14:13 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:13.129 15:14:13 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:13.129 15:14:13 -- target/nmic.sh@14 -- # nvmftestinit 00:19:13.129 15:14:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:13.129 15:14:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:13.129 15:14:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:13.129 15:14:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:13.129 15:14:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:13.129 15:14:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:13.129 15:14:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:13.129 15:14:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:13.129 15:14:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:13.129 15:14:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:13.129 15:14:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:13.129 15:14:13 -- common/autotest_common.sh@10 -- # set +x 00:19:15.044 15:14:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:15.044 15:14:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:15.044 15:14:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:15.044 15:14:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:15.044 15:14:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:15.044 15:14:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:15.044 15:14:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:15.044 15:14:15 -- nvmf/common.sh@294 -- # net_devs=() 00:19:15.044 15:14:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:15.044 15:14:15 -- nvmf/common.sh@295 -- # e810=() 00:19:15.044 15:14:15 -- nvmf/common.sh@295 -- # local -ga e810 00:19:15.044 15:14:15 -- nvmf/common.sh@296 -- # x722=() 00:19:15.044 15:14:15 -- nvmf/common.sh@296 -- # local -ga x722 00:19:15.044 15:14:15 -- nvmf/common.sh@297 -- # mlx=() 00:19:15.044 15:14:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:15.044 15:14:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:15.044 15:14:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:15.045 15:14:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:15.045 15:14:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:15.045 15:14:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:15.045 15:14:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:15.045 15:14:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:15.045 15:14:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:15.045 15:14:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:15.045 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:15.045 15:14:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:15.045 15:14:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:15.045 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:15.045 15:14:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:15.045 15:14:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:15.045 15:14:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:15.045 15:14:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:15.045 15:14:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:15.045 15:14:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:15.045 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:15.045 15:14:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:15.045 15:14:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:15.045 15:14:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:15.045 15:14:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:15.045 15:14:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:15.045 15:14:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:15.045 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:15.045 15:14:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:15.045 15:14:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:15.045 15:14:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:15.045 15:14:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:15.045 15:14:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:15.045 15:14:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:15.045 15:14:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:15.045 15:14:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:15.045 15:14:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:15.045 15:14:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:15.045 15:14:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:15.045 15:14:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:15.045 15:14:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:15.045 15:14:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:15.045 15:14:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:15.045 15:14:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:15.045 15:14:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:15.045 15:14:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:15.045 15:14:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:15.045 15:14:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:15.045 15:14:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:15.045 15:14:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:15.045 15:14:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:15.045 15:14:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:15.045 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:15.045 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.175 ms 00:19:15.045 00:19:15.045 --- 10.0.0.2 ping statistics --- 00:19:15.045 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:15.045 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:19:15.045 15:14:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:15.045 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:15.045 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:19:15.045 00:19:15.045 --- 10.0.0.1 ping statistics --- 00:19:15.045 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:15.045 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:19:15.045 15:14:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:15.045 15:14:15 -- nvmf/common.sh@410 -- # return 0 00:19:15.045 15:14:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:15.045 15:14:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:15.045 15:14:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:15.045 15:14:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:15.045 15:14:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:15.045 15:14:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:15.304 15:14:15 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:15.304 15:14:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:15.304 15:14:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:15.304 15:14:15 -- common/autotest_common.sh@10 -- # set +x 00:19:15.304 15:14:15 -- nvmf/common.sh@469 -- # nvmfpid=721984 00:19:15.304 15:14:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:15.304 15:14:15 -- nvmf/common.sh@470 -- # waitforlisten 721984 00:19:15.304 15:14:15 -- common/autotest_common.sh@829 -- # '[' -z 721984 ']' 00:19:15.304 15:14:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:15.304 15:14:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:15.304 15:14:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:15.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:15.304 15:14:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:15.304 15:14:15 -- common/autotest_common.sh@10 -- # set +x 00:19:15.304 [2024-11-28 15:14:15.334088] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:15.304 [2024-11-28 15:14:15.334165] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:15.304 EAL: No free 2048 kB hugepages reported on node 1 00:19:15.304 [2024-11-28 15:14:15.397273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:15.304 [2024-11-28 15:14:15.484788] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:15.304 [2024-11-28 15:14:15.484929] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:15.304 [2024-11-28 15:14:15.484946] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:15.304 [2024-11-28 15:14:15.484960] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:15.304 [2024-11-28 15:14:15.485012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:15.304 [2024-11-28 15:14:15.485040] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:15.304 [2024-11-28 15:14:15.485116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:15.304 [2024-11-28 15:14:15.485121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:16.239 15:14:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:16.239 15:14:16 -- common/autotest_common.sh@862 -- # return 0 00:19:16.239 15:14:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:16.239 15:14:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:16.239 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.239 15:14:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:16.239 15:14:16 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:16.239 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.239 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.239 [2024-11-28 15:14:16.340799] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:16.239 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.239 15:14:16 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:16.239 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.239 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.239 Malloc0 00:19:16.239 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.239 15:14:16 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:16.239 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.239 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:16.240 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.240 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:16.240 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.240 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 [2024-11-28 15:14:16.394171] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:16.240 test case1: single bdev can't be used in multiple subsystems 00:19:16.240 15:14:16 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:16.240 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.240 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:16.240 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.240 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@28 -- # nmic_status=0 00:19:16.240 15:14:16 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:16.240 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.240 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 [2024-11-28 15:14:16.417975] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:16.240 [2024-11-28 15:14:16.418005] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:16.240 [2024-11-28 15:14:16.418019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:16.240 request: 00:19:16.240 { 00:19:16.240 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:16.240 "namespace": { 00:19:16.240 "bdev_name": "Malloc0" 00:19:16.240 }, 00:19:16.240 "method": "nvmf_subsystem_add_ns", 00:19:16.240 "req_id": 1 00:19:16.240 } 00:19:16.240 Got JSON-RPC error response 00:19:16.240 response: 00:19:16.240 { 00:19:16.240 "code": -32602, 00:19:16.240 "message": "Invalid parameters" 00:19:16.240 } 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@29 -- # nmic_status=1 00:19:16.240 15:14:16 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:16.240 15:14:16 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:16.240 Adding namespace failed - expected result. 00:19:16.240 15:14:16 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:16.240 test case2: host connect to nvmf target in multiple paths 00:19:16.240 15:14:16 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:16.240 15:14:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:16.240 15:14:16 -- common/autotest_common.sh@10 -- # set +x 00:19:16.240 [2024-11-28 15:14:16.426118] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:16.240 15:14:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:16.240 15:14:16 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:16.842 15:14:17 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:17.435 15:14:17 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:17.435 15:14:17 -- common/autotest_common.sh@1187 -- # local i=0 00:19:17.435 15:14:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:17.435 15:14:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:17.435 15:14:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:19.962 15:14:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:19.962 15:14:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:19.962 15:14:19 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:19.962 15:14:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:19.962 15:14:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:19.962 15:14:19 -- common/autotest_common.sh@1197 -- # return 0 00:19:19.962 15:14:19 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:19.962 [global] 00:19:19.962 thread=1 00:19:19.962 invalidate=1 00:19:19.962 rw=write 00:19:19.962 time_based=1 00:19:19.962 runtime=1 00:19:19.962 ioengine=libaio 00:19:19.962 direct=1 00:19:19.962 bs=4096 00:19:19.962 iodepth=1 00:19:19.962 norandommap=0 00:19:19.962 numjobs=1 00:19:19.962 00:19:19.962 verify_dump=1 00:19:19.962 verify_backlog=512 00:19:19.962 verify_state_save=0 00:19:19.962 do_verify=1 00:19:19.962 verify=crc32c-intel 00:19:19.962 [job0] 00:19:19.962 filename=/dev/nvme0n1 00:19:19.962 Could not set queue depth (nvme0n1) 00:19:19.962 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.962 fio-3.35 00:19:19.962 Starting 1 thread 00:19:20.897 00:19:20.897 job0: (groupid=0, jobs=1): err= 0: pid=722643: Thu Nov 28 15:14:20 2024 00:19:20.897 read: IOPS=2445, BW=9782KiB/s (10.0MB/s)(9792KiB/1001msec) 00:19:20.897 slat (nsec): min=4418, max=69002, avg=11718.44, stdev=6707.57 00:19:20.897 clat (usec): min=175, max=431, avg=219.27, stdev=23.28 00:19:20.897 lat (usec): min=180, max=443, avg=230.99, stdev=27.11 00:19:20.897 clat percentiles (usec): 00:19:20.897 | 1.00th=[ 186], 5.00th=[ 192], 10.00th=[ 194], 20.00th=[ 200], 00:19:20.897 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 215], 60.00th=[ 221], 00:19:20.897 | 70.00th=[ 229], 80.00th=[ 237], 90.00th=[ 251], 95.00th=[ 265], 00:19:20.897 | 99.00th=[ 293], 99.50th=[ 297], 99.90th=[ 338], 99.95th=[ 347], 00:19:20.897 | 99.99th=[ 433] 00:19:20.897 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:19:20.897 slat (nsec): min=5841, max=43236, avg=12143.21, stdev=4462.12 00:19:20.897 clat (usec): min=121, max=1431, avg=150.66, stdev=30.34 00:19:20.897 lat (usec): min=127, max=1456, avg=162.80, stdev=31.27 00:19:20.897 clat percentiles (usec): 00:19:20.897 | 1.00th=[ 126], 5.00th=[ 133], 10.00th=[ 135], 20.00th=[ 139], 00:19:20.897 | 30.00th=[ 143], 40.00th=[ 145], 50.00th=[ 149], 60.00th=[ 151], 00:19:20.897 | 70.00th=[ 155], 80.00th=[ 159], 90.00th=[ 167], 95.00th=[ 174], 00:19:20.897 | 99.00th=[ 245], 99.50th=[ 247], 99.90th=[ 251], 99.95th=[ 293], 00:19:20.897 | 99.99th=[ 1434] 00:19:20.897 bw ( KiB/s): min=12288, max=12288, per=100.00%, avg=12288.00, stdev= 0.00, samples=1 00:19:20.897 iops : min= 3072, max= 3072, avg=3072.00, stdev= 0.00, samples=1 00:19:20.897 lat (usec) : 250=94.81%, 500=5.17% 00:19:20.897 lat (msec) : 2=0.02% 00:19:20.897 cpu : usr=3.20%, sys=6.80%, ctx=5009, majf=0, minf=1 00:19:20.897 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:20.897 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.897 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:20.897 issued rwts: total=2448,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:20.898 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:20.898 00:19:20.898 Run status group 0 (all jobs): 00:19:20.898 READ: bw=9782KiB/s (10.0MB/s), 9782KiB/s-9782KiB/s (10.0MB/s-10.0MB/s), io=9792KiB (10.0MB), run=1001-1001msec 00:19:20.898 WRITE: bw=9.99MiB/s (10.5MB/s), 9.99MiB/s-9.99MiB/s (10.5MB/s-10.5MB/s), io=10.0MiB (10.5MB), run=1001-1001msec 00:19:20.898 00:19:20.898 Disk stats (read/write): 00:19:20.898 nvme0n1: ios=2119/2560, merge=0/0, ticks=442/386, in_queue=828, util=91.48% 00:19:20.898 15:14:21 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:20.898 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:20.898 15:14:21 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:20.898 15:14:21 -- common/autotest_common.sh@1208 -- # local i=0 00:19:20.898 15:14:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:20.898 15:14:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:21.156 15:14:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:21.156 15:14:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:21.156 15:14:21 -- common/autotest_common.sh@1220 -- # return 0 00:19:21.156 15:14:21 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:21.156 15:14:21 -- target/nmic.sh@53 -- # nvmftestfini 00:19:21.156 15:14:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:21.156 15:14:21 -- nvmf/common.sh@116 -- # sync 00:19:21.156 15:14:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:21.156 15:14:21 -- nvmf/common.sh@119 -- # set +e 00:19:21.156 15:14:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:21.156 15:14:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:21.156 rmmod nvme_tcp 00:19:21.156 rmmod nvme_fabrics 00:19:21.156 rmmod nvme_keyring 00:19:21.156 15:14:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:21.156 15:14:21 -- nvmf/common.sh@123 -- # set -e 00:19:21.156 15:14:21 -- nvmf/common.sh@124 -- # return 0 00:19:21.156 15:14:21 -- nvmf/common.sh@477 -- # '[' -n 721984 ']' 00:19:21.156 15:14:21 -- nvmf/common.sh@478 -- # killprocess 721984 00:19:21.156 15:14:21 -- common/autotest_common.sh@936 -- # '[' -z 721984 ']' 00:19:21.156 15:14:21 -- common/autotest_common.sh@940 -- # kill -0 721984 00:19:21.156 15:14:21 -- common/autotest_common.sh@941 -- # uname 00:19:21.156 15:14:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:21.156 15:14:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 721984 00:19:21.156 15:14:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:21.156 15:14:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:21.156 15:14:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 721984' 00:19:21.156 killing process with pid 721984 00:19:21.156 15:14:21 -- common/autotest_common.sh@955 -- # kill 721984 00:19:21.156 15:14:21 -- common/autotest_common.sh@960 -- # wait 721984 00:19:21.414 15:14:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:21.414 15:14:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:21.414 15:14:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:21.414 15:14:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:21.414 15:14:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:21.414 15:14:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:21.414 15:14:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:21.415 15:14:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:23.318 15:14:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:23.318 00:19:23.318 real 0m10.532s 00:19:23.318 user 0m24.916s 00:19:23.318 sys 0m2.555s 00:19:23.318 15:14:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:23.318 15:14:23 -- common/autotest_common.sh@10 -- # set +x 00:19:23.318 ************************************ 00:19:23.318 END TEST nvmf_nmic 00:19:23.318 ************************************ 00:19:23.318 15:14:23 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:23.318 15:14:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:23.318 15:14:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:23.318 15:14:23 -- common/autotest_common.sh@10 -- # set +x 00:19:23.318 ************************************ 00:19:23.318 START TEST nvmf_fio_target 00:19:23.318 ************************************ 00:19:23.577 15:14:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:23.577 * Looking for test storage... 00:19:23.577 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:23.577 15:14:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:23.577 15:14:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:23.577 15:14:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:23.577 15:14:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:23.577 15:14:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:23.577 15:14:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:23.577 15:14:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:23.577 15:14:23 -- scripts/common.sh@335 -- # IFS=.-: 00:19:23.577 15:14:23 -- scripts/common.sh@335 -- # read -ra ver1 00:19:23.577 15:14:23 -- scripts/common.sh@336 -- # IFS=.-: 00:19:23.577 15:14:23 -- scripts/common.sh@336 -- # read -ra ver2 00:19:23.577 15:14:23 -- scripts/common.sh@337 -- # local 'op=<' 00:19:23.577 15:14:23 -- scripts/common.sh@339 -- # ver1_l=2 00:19:23.577 15:14:23 -- scripts/common.sh@340 -- # ver2_l=1 00:19:23.577 15:14:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:23.577 15:14:23 -- scripts/common.sh@343 -- # case "$op" in 00:19:23.577 15:14:23 -- scripts/common.sh@344 -- # : 1 00:19:23.577 15:14:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:23.577 15:14:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:23.577 15:14:23 -- scripts/common.sh@364 -- # decimal 1 00:19:23.577 15:14:23 -- scripts/common.sh@352 -- # local d=1 00:19:23.577 15:14:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:23.577 15:14:23 -- scripts/common.sh@354 -- # echo 1 00:19:23.577 15:14:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:23.577 15:14:23 -- scripts/common.sh@365 -- # decimal 2 00:19:23.577 15:14:23 -- scripts/common.sh@352 -- # local d=2 00:19:23.577 15:14:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:23.577 15:14:23 -- scripts/common.sh@354 -- # echo 2 00:19:23.577 15:14:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:23.577 15:14:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:23.577 15:14:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:23.577 15:14:23 -- scripts/common.sh@367 -- # return 0 00:19:23.577 15:14:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:23.577 15:14:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:23.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.577 --rc genhtml_branch_coverage=1 00:19:23.577 --rc genhtml_function_coverage=1 00:19:23.577 --rc genhtml_legend=1 00:19:23.577 --rc geninfo_all_blocks=1 00:19:23.577 --rc geninfo_unexecuted_blocks=1 00:19:23.577 00:19:23.577 ' 00:19:23.577 15:14:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:23.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.577 --rc genhtml_branch_coverage=1 00:19:23.577 --rc genhtml_function_coverage=1 00:19:23.577 --rc genhtml_legend=1 00:19:23.577 --rc geninfo_all_blocks=1 00:19:23.577 --rc geninfo_unexecuted_blocks=1 00:19:23.577 00:19:23.577 ' 00:19:23.577 15:14:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:23.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.577 --rc genhtml_branch_coverage=1 00:19:23.577 --rc genhtml_function_coverage=1 00:19:23.577 --rc genhtml_legend=1 00:19:23.577 --rc geninfo_all_blocks=1 00:19:23.577 --rc geninfo_unexecuted_blocks=1 00:19:23.577 00:19:23.577 ' 00:19:23.577 15:14:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:23.577 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:23.577 --rc genhtml_branch_coverage=1 00:19:23.577 --rc genhtml_function_coverage=1 00:19:23.577 --rc genhtml_legend=1 00:19:23.577 --rc geninfo_all_blocks=1 00:19:23.577 --rc geninfo_unexecuted_blocks=1 00:19:23.577 00:19:23.577 ' 00:19:23.577 15:14:23 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:23.577 15:14:23 -- nvmf/common.sh@7 -- # uname -s 00:19:23.577 15:14:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:23.577 15:14:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:23.577 15:14:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:23.577 15:14:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:23.577 15:14:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:23.577 15:14:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:23.577 15:14:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:23.577 15:14:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:23.577 15:14:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:23.577 15:14:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:23.577 15:14:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:23.577 15:14:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:23.577 15:14:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:23.577 15:14:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:23.577 15:14:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:23.577 15:14:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:23.577 15:14:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:23.577 15:14:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:23.577 15:14:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:23.577 15:14:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.577 15:14:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.577 15:14:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.577 15:14:23 -- paths/export.sh@5 -- # export PATH 00:19:23.577 15:14:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:23.577 15:14:23 -- nvmf/common.sh@46 -- # : 0 00:19:23.577 15:14:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:23.577 15:14:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:23.577 15:14:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:23.577 15:14:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:23.577 15:14:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:23.577 15:14:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:23.577 15:14:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:23.577 15:14:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:23.577 15:14:23 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:23.577 15:14:23 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:23.577 15:14:23 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:23.577 15:14:23 -- target/fio.sh@16 -- # nvmftestinit 00:19:23.577 15:14:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:23.577 15:14:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:23.577 15:14:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:23.577 15:14:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:23.577 15:14:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:23.577 15:14:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:23.577 15:14:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:23.577 15:14:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:23.577 15:14:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:23.578 15:14:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:23.578 15:14:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:23.578 15:14:23 -- common/autotest_common.sh@10 -- # set +x 00:19:26.109 15:14:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:26.110 15:14:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:26.110 15:14:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:26.110 15:14:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:26.110 15:14:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:26.110 15:14:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:26.110 15:14:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:26.110 15:14:25 -- nvmf/common.sh@294 -- # net_devs=() 00:19:26.110 15:14:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:26.110 15:14:25 -- nvmf/common.sh@295 -- # e810=() 00:19:26.110 15:14:25 -- nvmf/common.sh@295 -- # local -ga e810 00:19:26.110 15:14:25 -- nvmf/common.sh@296 -- # x722=() 00:19:26.110 15:14:25 -- nvmf/common.sh@296 -- # local -ga x722 00:19:26.110 15:14:25 -- nvmf/common.sh@297 -- # mlx=() 00:19:26.110 15:14:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:26.110 15:14:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:26.110 15:14:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:26.110 15:14:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:26.110 15:14:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:26.110 15:14:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:26.110 15:14:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:26.110 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:26.110 15:14:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:26.110 15:14:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:26.110 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:26.110 15:14:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:26.110 15:14:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:26.110 15:14:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:26.110 15:14:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:26.110 15:14:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:26.110 15:14:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:26.110 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:26.110 15:14:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:26.110 15:14:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:26.110 15:14:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:26.110 15:14:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:26.110 15:14:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:26.110 15:14:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:26.110 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:26.110 15:14:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:26.110 15:14:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:26.110 15:14:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:26.110 15:14:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:26.110 15:14:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:26.110 15:14:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:26.110 15:14:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:26.110 15:14:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:26.110 15:14:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:26.110 15:14:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:26.110 15:14:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:26.110 15:14:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:26.110 15:14:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:26.110 15:14:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:26.110 15:14:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:26.110 15:14:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:26.110 15:14:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:26.110 15:14:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:26.110 15:14:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:26.110 15:14:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:26.110 15:14:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:26.110 15:14:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:26.110 15:14:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:26.110 15:14:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:26.110 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:26.110 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:19:26.110 00:19:26.110 --- 10.0.0.2 ping statistics --- 00:19:26.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:26.110 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:19:26.110 15:14:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:26.110 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:26.110 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:19:26.110 00:19:26.110 --- 10.0.0.1 ping statistics --- 00:19:26.110 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:26.110 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:19:26.110 15:14:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:26.110 15:14:25 -- nvmf/common.sh@410 -- # return 0 00:19:26.110 15:14:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:26.110 15:14:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:26.110 15:14:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:26.110 15:14:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:26.110 15:14:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:26.110 15:14:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:26.110 15:14:25 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:26.110 15:14:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:26.110 15:14:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:26.110 15:14:25 -- common/autotest_common.sh@10 -- # set +x 00:19:26.110 15:14:25 -- nvmf/common.sh@469 -- # nvmfpid=724855 00:19:26.110 15:14:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:26.110 15:14:25 -- nvmf/common.sh@470 -- # waitforlisten 724855 00:19:26.110 15:14:25 -- common/autotest_common.sh@829 -- # '[' -z 724855 ']' 00:19:26.110 15:14:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:26.110 15:14:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:26.110 15:14:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:26.110 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:26.110 15:14:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:26.110 15:14:25 -- common/autotest_common.sh@10 -- # set +x 00:19:26.110 [2024-11-28 15:14:25.952504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:26.110 [2024-11-28 15:14:25.952590] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:26.110 EAL: No free 2048 kB hugepages reported on node 1 00:19:26.111 [2024-11-28 15:14:26.028888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:26.111 [2024-11-28 15:14:26.123040] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:26.111 [2024-11-28 15:14:26.123208] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:26.111 [2024-11-28 15:14:26.123230] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:26.111 [2024-11-28 15:14:26.123245] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:26.111 [2024-11-28 15:14:26.123300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:26.111 [2024-11-28 15:14:26.123366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:26.111 [2024-11-28 15:14:26.123360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:26.111 [2024-11-28 15:14:26.123335] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:27.046 15:14:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:27.046 15:14:26 -- common/autotest_common.sh@862 -- # return 0 00:19:27.046 15:14:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:27.046 15:14:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:27.046 15:14:26 -- common/autotest_common.sh@10 -- # set +x 00:19:27.046 15:14:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:27.046 15:14:26 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:27.046 [2024-11-28 15:14:27.250727] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:27.046 15:14:27 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:27.613 15:14:27 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:27.613 15:14:27 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:27.871 15:14:27 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:27.871 15:14:27 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:28.130 15:14:28 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:28.130 15:14:28 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:28.389 15:14:28 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:28.389 15:14:28 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:28.647 15:14:28 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:28.905 15:14:28 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:28.905 15:14:28 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.164 15:14:29 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:29.164 15:14:29 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:29.423 15:14:29 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:29.423 15:14:29 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:29.680 15:14:29 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:29.938 15:14:29 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:29.938 15:14:29 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:30.196 15:14:30 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:30.196 15:14:30 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:30.454 15:14:30 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:30.711 [2024-11-28 15:14:30.704089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:30.711 15:14:30 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:30.969 15:14:30 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:31.228 15:14:31 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:31.794 15:14:31 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:31.794 15:14:31 -- common/autotest_common.sh@1187 -- # local i=0 00:19:31.794 15:14:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:31.794 15:14:31 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:31.794 15:14:31 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:31.794 15:14:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:33.692 15:14:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:33.692 15:14:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:33.692 15:14:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:33.692 15:14:33 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:33.692 15:14:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:33.692 15:14:33 -- common/autotest_common.sh@1197 -- # return 0 00:19:33.692 15:14:33 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:33.692 [global] 00:19:33.692 thread=1 00:19:33.692 invalidate=1 00:19:33.692 rw=write 00:19:33.692 time_based=1 00:19:33.692 runtime=1 00:19:33.692 ioengine=libaio 00:19:33.692 direct=1 00:19:33.692 bs=4096 00:19:33.692 iodepth=1 00:19:33.692 norandommap=0 00:19:33.692 numjobs=1 00:19:33.692 00:19:33.692 verify_dump=1 00:19:33.692 verify_backlog=512 00:19:33.692 verify_state_save=0 00:19:33.692 do_verify=1 00:19:33.692 verify=crc32c-intel 00:19:33.692 [job0] 00:19:33.692 filename=/dev/nvme0n1 00:19:33.692 [job1] 00:19:33.692 filename=/dev/nvme0n2 00:19:33.692 [job2] 00:19:33.692 filename=/dev/nvme0n3 00:19:33.692 [job3] 00:19:33.692 filename=/dev/nvme0n4 00:19:33.692 Could not set queue depth (nvme0n1) 00:19:33.692 Could not set queue depth (nvme0n2) 00:19:33.692 Could not set queue depth (nvme0n3) 00:19:33.692 Could not set queue depth (nvme0n4) 00:19:33.950 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.950 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.950 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.950 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.950 fio-3.35 00:19:33.950 Starting 4 threads 00:19:35.322 00:19:35.322 job0: (groupid=0, jobs=1): err= 0: pid=725963: Thu Nov 28 15:14:35 2024 00:19:35.322 read: IOPS=649, BW=2599KiB/s (2661kB/s)(2664KiB/1025msec) 00:19:35.322 slat (nsec): min=4686, max=55051, avg=12418.88, stdev=8932.32 00:19:35.322 clat (usec): min=167, max=42172, avg=1232.75, stdev=6162.69 00:19:35.322 lat (usec): min=172, max=42184, avg=1245.17, stdev=6163.34 00:19:35.322 clat percentiles (usec): 00:19:35.322 | 1.00th=[ 182], 5.00th=[ 192], 10.00th=[ 196], 20.00th=[ 206], 00:19:35.322 | 30.00th=[ 215], 40.00th=[ 225], 50.00th=[ 241], 60.00th=[ 260], 00:19:35.322 | 70.00th=[ 322], 80.00th=[ 351], 90.00th=[ 392], 95.00th=[ 433], 00:19:35.322 | 99.00th=[41157], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:35.322 | 99.99th=[42206] 00:19:35.322 write: IOPS=999, BW=3996KiB/s (4092kB/s)(4096KiB/1025msec); 0 zone resets 00:19:35.322 slat (nsec): min=5920, max=46132, avg=12363.71, stdev=5828.21 00:19:35.322 clat (usec): min=127, max=364, avg=172.82, stdev=37.53 00:19:35.322 lat (usec): min=134, max=403, avg=185.18, stdev=40.81 00:19:35.322 clat percentiles (usec): 00:19:35.322 | 1.00th=[ 135], 5.00th=[ 137], 10.00th=[ 141], 20.00th=[ 145], 00:19:35.322 | 30.00th=[ 149], 40.00th=[ 153], 50.00th=[ 155], 60.00th=[ 163], 00:19:35.322 | 70.00th=[ 174], 80.00th=[ 225], 90.00th=[ 239], 95.00th=[ 241], 00:19:35.322 | 99.00th=[ 262], 99.50th=[ 269], 99.90th=[ 343], 99.95th=[ 363], 00:19:35.322 | 99.99th=[ 363] 00:19:35.322 bw ( KiB/s): min= 4096, max= 4096, per=17.46%, avg=4096.00, stdev= 0.00, samples=2 00:19:35.322 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:19:35.322 lat (usec) : 250=81.78%, 500=16.80%, 750=0.41%, 1000=0.06% 00:19:35.322 lat (msec) : 50=0.95% 00:19:35.322 cpu : usr=0.68%, sys=2.44%, ctx=1691, majf=0, minf=1 00:19:35.322 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:35.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.322 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.322 issued rwts: total=666,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.322 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:35.322 job1: (groupid=0, jobs=1): err= 0: pid=725964: Thu Nov 28 15:14:35 2024 00:19:35.322 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:35.322 slat (nsec): min=5566, max=53315, avg=12161.17, stdev=5316.89 00:19:35.322 clat (usec): min=179, max=41971, avg=391.25, stdev=2338.44 00:19:35.322 lat (usec): min=188, max=41988, avg=403.42, stdev=2338.45 00:19:35.322 clat percentiles (usec): 00:19:35.322 | 1.00th=[ 194], 5.00th=[ 202], 10.00th=[ 210], 20.00th=[ 221], 00:19:35.322 | 30.00th=[ 229], 40.00th=[ 237], 50.00th=[ 245], 60.00th=[ 253], 00:19:35.322 | 70.00th=[ 265], 80.00th=[ 293], 90.00th=[ 351], 95.00th=[ 359], 00:19:35.322 | 99.00th=[ 404], 99.50th=[ 498], 99.90th=[41681], 99.95th=[42206], 00:19:35.322 | 99.99th=[42206] 00:19:35.322 write: IOPS=1913, BW=7652KiB/s (7836kB/s)(7660KiB/1001msec); 0 zone resets 00:19:35.322 slat (nsec): min=7427, max=46287, avg=15022.81, stdev=6530.79 00:19:35.322 clat (usec): min=127, max=408, avg=176.26, stdev=20.65 00:19:35.322 lat (usec): min=136, max=417, avg=191.28, stdev=23.22 00:19:35.322 clat percentiles (usec): 00:19:35.322 | 1.00th=[ 135], 5.00th=[ 143], 10.00th=[ 151], 20.00th=[ 161], 00:19:35.322 | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 176], 60.00th=[ 182], 00:19:35.322 | 70.00th=[ 186], 80.00th=[ 190], 90.00th=[ 200], 95.00th=[ 208], 00:19:35.322 | 99.00th=[ 235], 99.50th=[ 247], 99.90th=[ 302], 99.95th=[ 408], 00:19:35.322 | 99.99th=[ 408] 00:19:35.322 bw ( KiB/s): min= 8192, max= 8192, per=34.92%, avg=8192.00, stdev= 0.00, samples=1 00:19:35.322 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:35.322 lat (usec) : 250=80.82%, 500=18.98%, 750=0.06% 00:19:35.322 lat (msec) : 50=0.14% 00:19:35.322 cpu : usr=4.50%, sys=5.60%, ctx=3451, majf=0, minf=2 00:19:35.322 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:35.322 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.322 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.322 issued rwts: total=1536,1915,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.322 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:35.323 job2: (groupid=0, jobs=1): err= 0: pid=725965: Thu Nov 28 15:14:35 2024 00:19:35.323 read: IOPS=582, BW=2331KiB/s (2387kB/s)(2340KiB/1004msec) 00:19:35.323 slat (nsec): min=5171, max=48439, avg=11621.35, stdev=7212.30 00:19:35.323 clat (usec): min=179, max=42015, avg=1333.55, stdev=6469.95 00:19:35.323 lat (usec): min=186, max=42033, avg=1345.17, stdev=6471.66 00:19:35.323 clat percentiles (usec): 00:19:35.323 | 1.00th=[ 188], 5.00th=[ 202], 10.00th=[ 210], 20.00th=[ 221], 00:19:35.323 | 30.00th=[ 229], 40.00th=[ 241], 50.00th=[ 262], 60.00th=[ 281], 00:19:35.323 | 70.00th=[ 318], 80.00th=[ 355], 90.00th=[ 420], 95.00th=[ 537], 00:19:35.323 | 99.00th=[41157], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:19:35.323 | 99.99th=[42206] 00:19:35.323 write: IOPS=1019, BW=4080KiB/s (4178kB/s)(4096KiB/1004msec); 0 zone resets 00:19:35.323 slat (nsec): min=7117, max=42430, avg=10359.28, stdev=4756.50 00:19:35.323 clat (usec): min=154, max=392, avg=196.12, stdev=23.70 00:19:35.323 lat (usec): min=164, max=400, avg=206.48, stdev=25.19 00:19:35.323 clat percentiles (usec): 00:19:35.323 | 1.00th=[ 163], 5.00th=[ 169], 10.00th=[ 172], 20.00th=[ 178], 00:19:35.323 | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 192], 60.00th=[ 198], 00:19:35.323 | 70.00th=[ 204], 80.00th=[ 212], 90.00th=[ 225], 95.00th=[ 243], 00:19:35.323 | 99.00th=[ 253], 99.50th=[ 281], 99.90th=[ 343], 99.95th=[ 392], 00:19:35.323 | 99.99th=[ 392] 00:19:35.323 bw ( KiB/s): min= 8192, max= 8192, per=34.92%, avg=8192.00, stdev= 0.00, samples=1 00:19:35.323 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:35.323 lat (usec) : 250=79.86%, 500=17.96%, 750=1.24% 00:19:35.323 lat (msec) : 50=0.93% 00:19:35.323 cpu : usr=1.50%, sys=1.99%, ctx=1609, majf=0, minf=2 00:19:35.323 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:35.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.323 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.323 issued rwts: total=585,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.323 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:35.323 job3: (groupid=0, jobs=1): err= 0: pid=725966: Thu Nov 28 15:14:35 2024 00:19:35.323 read: IOPS=1689, BW=6756KiB/s (6918kB/s)(6844KiB/1013msec) 00:19:35.323 slat (nsec): min=4608, max=48812, avg=9707.91, stdev=5233.54 00:19:35.323 clat (usec): min=175, max=41006, avg=364.86, stdev=2404.79 00:19:35.323 lat (usec): min=181, max=41039, avg=374.56, stdev=2406.15 00:19:35.323 clat percentiles (usec): 00:19:35.323 | 1.00th=[ 182], 5.00th=[ 188], 10.00th=[ 190], 20.00th=[ 194], 00:19:35.323 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 210], 00:19:35.323 | 70.00th=[ 217], 80.00th=[ 229], 90.00th=[ 289], 95.00th=[ 347], 00:19:35.323 | 99.00th=[ 453], 99.50th=[ 701], 99.90th=[41157], 99.95th=[41157], 00:19:35.323 | 99.99th=[41157] 00:19:35.323 write: IOPS=2021, BW=8087KiB/s (8281kB/s)(8192KiB/1013msec); 0 zone resets 00:19:35.323 slat (nsec): min=6355, max=49294, avg=11348.09, stdev=5105.77 00:19:35.323 clat (usec): min=129, max=405, avg=164.83, stdev=21.01 00:19:35.323 lat (usec): min=137, max=447, avg=176.18, stdev=21.36 00:19:35.323 clat percentiles (usec): 00:19:35.323 | 1.00th=[ 139], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 151], 00:19:35.323 | 30.00th=[ 155], 40.00th=[ 157], 50.00th=[ 159], 60.00th=[ 163], 00:19:35.323 | 70.00th=[ 167], 80.00th=[ 174], 90.00th=[ 196], 95.00th=[ 210], 00:19:35.323 | 99.00th=[ 225], 99.50th=[ 231], 99.90th=[ 359], 99.95th=[ 375], 00:19:35.323 | 99.99th=[ 408] 00:19:35.323 bw ( KiB/s): min= 4768, max=11616, per=34.92%, avg=8192.00, stdev=4842.27, samples=2 00:19:35.323 iops : min= 1192, max= 2904, avg=2048.00, stdev=1210.57, samples=2 00:19:35.323 lat (usec) : 250=93.35%, 500=6.38%, 750=0.05%, 1000=0.03% 00:19:35.323 lat (msec) : 2=0.03%, 50=0.16% 00:19:35.323 cpu : usr=2.08%, sys=4.25%, ctx=3761, majf=0, minf=1 00:19:35.323 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:35.323 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.323 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:35.323 issued rwts: total=1711,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:35.323 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:35.323 00:19:35.323 Run status group 0 (all jobs): 00:19:35.323 READ: bw=17.1MiB/s (18.0MB/s), 2331KiB/s-6756KiB/s (2387kB/s-6918kB/s), io=17.6MiB (18.4MB), run=1001-1025msec 00:19:35.323 WRITE: bw=22.9MiB/s (24.0MB/s), 3996KiB/s-8087KiB/s (4092kB/s-8281kB/s), io=23.5MiB (24.6MB), run=1001-1025msec 00:19:35.323 00:19:35.323 Disk stats (read/write): 00:19:35.323 nvme0n1: ios=561/1019, merge=0/0, ticks=1213/176, in_queue=1389, util=85.87% 00:19:35.323 nvme0n2: ios=1339/1536, merge=0/0, ticks=591/260, in_queue=851, util=91.26% 00:19:35.323 nvme0n3: ios=616/1024, merge=0/0, ticks=675/198, in_queue=873, util=95.10% 00:19:35.323 nvme0n4: ios=1764/2048, merge=0/0, ticks=654/329, in_queue=983, util=94.43% 00:19:35.323 15:14:35 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:35.323 [global] 00:19:35.323 thread=1 00:19:35.323 invalidate=1 00:19:35.323 rw=randwrite 00:19:35.323 time_based=1 00:19:35.323 runtime=1 00:19:35.323 ioengine=libaio 00:19:35.323 direct=1 00:19:35.323 bs=4096 00:19:35.323 iodepth=1 00:19:35.323 norandommap=0 00:19:35.323 numjobs=1 00:19:35.323 00:19:35.323 verify_dump=1 00:19:35.323 verify_backlog=512 00:19:35.323 verify_state_save=0 00:19:35.323 do_verify=1 00:19:35.323 verify=crc32c-intel 00:19:35.323 [job0] 00:19:35.323 filename=/dev/nvme0n1 00:19:35.323 [job1] 00:19:35.323 filename=/dev/nvme0n2 00:19:35.323 [job2] 00:19:35.323 filename=/dev/nvme0n3 00:19:35.323 [job3] 00:19:35.323 filename=/dev/nvme0n4 00:19:35.323 Could not set queue depth (nvme0n1) 00:19:35.323 Could not set queue depth (nvme0n2) 00:19:35.323 Could not set queue depth (nvme0n3) 00:19:35.323 Could not set queue depth (nvme0n4) 00:19:35.323 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.323 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.323 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.323 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:35.323 fio-3.35 00:19:35.323 Starting 4 threads 00:19:36.696 00:19:36.696 job0: (groupid=0, jobs=1): err= 0: pid=726206: Thu Nov 28 15:14:36 2024 00:19:36.696 read: IOPS=228, BW=915KiB/s (937kB/s)(952KiB/1040msec) 00:19:36.696 slat (nsec): min=7857, max=44260, avg=19447.18, stdev=4900.00 00:19:36.696 clat (usec): min=224, max=42206, avg=3823.08, stdev=11378.76 00:19:36.696 lat (usec): min=242, max=42223, avg=3842.53, stdev=11379.40 00:19:36.696 clat percentiles (usec): 00:19:36.696 | 1.00th=[ 273], 5.00th=[ 297], 10.00th=[ 314], 20.00th=[ 330], 00:19:36.696 | 30.00th=[ 379], 40.00th=[ 392], 50.00th=[ 404], 60.00th=[ 412], 00:19:36.696 | 70.00th=[ 420], 80.00th=[ 433], 90.00th=[ 465], 95.00th=[41157], 00:19:36.696 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:36.696 | 99.99th=[42206] 00:19:36.696 write: IOPS=492, BW=1969KiB/s (2016kB/s)(2048KiB/1040msec); 0 zone resets 00:19:36.696 slat (nsec): min=6159, max=72917, avg=9477.18, stdev=5228.90 00:19:36.696 clat (usec): min=143, max=461, avg=229.70, stdev=33.07 00:19:36.696 lat (usec): min=150, max=470, avg=239.18, stdev=32.58 00:19:36.696 clat percentiles (usec): 00:19:36.696 | 1.00th=[ 151], 5.00th=[ 172], 10.00th=[ 204], 20.00th=[ 219], 00:19:36.696 | 30.00th=[ 221], 40.00th=[ 227], 50.00th=[ 231], 60.00th=[ 233], 00:19:36.696 | 70.00th=[ 237], 80.00th=[ 243], 90.00th=[ 249], 95.00th=[ 260], 00:19:36.696 | 99.00th=[ 383], 99.50th=[ 441], 99.90th=[ 461], 99.95th=[ 461], 00:19:36.696 | 99.99th=[ 461] 00:19:36.696 bw ( KiB/s): min= 4096, max= 4096, per=20.80%, avg=4096.00, stdev= 0.00, samples=1 00:19:36.696 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:36.696 lat (usec) : 250=62.00%, 500=35.20%, 750=0.13% 00:19:36.696 lat (msec) : 50=2.67% 00:19:36.696 cpu : usr=0.29%, sys=1.35%, ctx=751, majf=0, minf=1 00:19:36.696 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.696 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.696 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.696 issued rwts: total=238,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.696 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.696 job1: (groupid=0, jobs=1): err= 0: pid=726207: Thu Nov 28 15:14:36 2024 00:19:36.696 read: IOPS=1763, BW=7053KiB/s (7222kB/s)(7060KiB/1001msec) 00:19:36.696 slat (nsec): min=7016, max=49386, avg=14855.16, stdev=5217.20 00:19:36.696 clat (usec): min=176, max=849, avg=261.16, stdev=69.28 00:19:36.696 lat (usec): min=183, max=870, avg=276.01, stdev=71.24 00:19:36.696 clat percentiles (usec): 00:19:36.696 | 1.00th=[ 190], 5.00th=[ 206], 10.00th=[ 215], 20.00th=[ 225], 00:19:36.696 | 30.00th=[ 231], 40.00th=[ 237], 50.00th=[ 243], 60.00th=[ 247], 00:19:36.697 | 70.00th=[ 255], 80.00th=[ 265], 90.00th=[ 338], 95.00th=[ 445], 00:19:36.697 | 99.00th=[ 529], 99.50th=[ 553], 99.90th=[ 848], 99.95th=[ 848], 00:19:36.697 | 99.99th=[ 848] 00:19:36.697 write: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec); 0 zone resets 00:19:36.697 slat (usec): min=7, max=39109, avg=51.76, stdev=1134.86 00:19:36.697 clat (usec): min=125, max=380, avg=190.16, stdev=31.59 00:19:36.697 lat (usec): min=135, max=39339, avg=241.92, stdev=1137.60 00:19:36.697 clat percentiles (usec): 00:19:36.697 | 1.00th=[ 135], 5.00th=[ 145], 10.00th=[ 155], 20.00th=[ 167], 00:19:36.697 | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 184], 60.00th=[ 190], 00:19:36.697 | 70.00th=[ 198], 80.00th=[ 215], 90.00th=[ 243], 95.00th=[ 245], 00:19:36.697 | 99.00th=[ 262], 99.50th=[ 281], 99.90th=[ 322], 99.95th=[ 334], 00:19:36.697 | 99.99th=[ 379] 00:19:36.697 bw ( KiB/s): min= 8192, max= 8192, per=41.60%, avg=8192.00, stdev= 0.00, samples=1 00:19:36.697 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:36.697 lat (usec) : 250=82.17%, 500=16.84%, 750=0.92%, 1000=0.08% 00:19:36.697 cpu : usr=4.10%, sys=8.40%, ctx=3816, majf=0, minf=1 00:19:36.697 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.697 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.697 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.697 issued rwts: total=1765,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.697 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.697 job2: (groupid=0, jobs=1): err= 0: pid=726208: Thu Nov 28 15:14:36 2024 00:19:36.697 read: IOPS=1837, BW=7349KiB/s (7525kB/s)(7540KiB/1026msec) 00:19:36.697 slat (nsec): min=6594, max=49942, avg=16327.26, stdev=5243.03 00:19:36.697 clat (usec): min=200, max=42099, avg=301.12, stdev=1339.18 00:19:36.697 lat (usec): min=209, max=42124, avg=317.44, stdev=1339.38 00:19:36.697 clat percentiles (usec): 00:19:36.697 | 1.00th=[ 208], 5.00th=[ 219], 10.00th=[ 227], 20.00th=[ 239], 00:19:36.697 | 30.00th=[ 245], 40.00th=[ 249], 50.00th=[ 253], 60.00th=[ 258], 00:19:36.697 | 70.00th=[ 265], 80.00th=[ 269], 90.00th=[ 277], 95.00th=[ 293], 00:19:36.697 | 99.00th=[ 457], 99.50th=[ 515], 99.90th=[40633], 99.95th=[42206], 00:19:36.697 | 99.99th=[42206] 00:19:36.697 write: IOPS=1996, BW=7984KiB/s (8176kB/s)(8192KiB/1026msec); 0 zone resets 00:19:36.697 slat (nsec): min=8127, max=48436, avg=16748.27, stdev=6856.97 00:19:36.697 clat (usec): min=146, max=583, avg=182.72, stdev=21.25 00:19:36.697 lat (usec): min=158, max=597, avg=199.47, stdev=24.19 00:19:36.697 clat percentiles (usec): 00:19:36.697 | 1.00th=[ 153], 5.00th=[ 159], 10.00th=[ 163], 20.00th=[ 169], 00:19:36.697 | 30.00th=[ 174], 40.00th=[ 178], 50.00th=[ 182], 60.00th=[ 186], 00:19:36.697 | 70.00th=[ 190], 80.00th=[ 196], 90.00th=[ 202], 95.00th=[ 210], 00:19:36.697 | 99.00th=[ 235], 99.50th=[ 281], 99.90th=[ 404], 99.95th=[ 412], 00:19:36.697 | 99.99th=[ 586] 00:19:36.697 bw ( KiB/s): min= 7400, max= 8984, per=41.60%, avg=8192.00, stdev=1120.06, samples=2 00:19:36.697 iops : min= 1850, max= 2246, avg=2048.00, stdev=280.01, samples=2 00:19:36.697 lat (usec) : 250=71.47%, 500=28.17%, 750=0.28% 00:19:36.697 lat (msec) : 2=0.03%, 50=0.05% 00:19:36.697 cpu : usr=5.37%, sys=7.80%, ctx=3934, majf=0, minf=2 00:19:36.697 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.697 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.697 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.697 issued rwts: total=1885,2048,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.697 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.697 job3: (groupid=0, jobs=1): err= 0: pid=726209: Thu Nov 28 15:14:36 2024 00:19:36.697 read: IOPS=25, BW=104KiB/s (106kB/s)(104KiB/1001msec) 00:19:36.697 slat (nsec): min=12069, max=35414, avg=24412.31, stdev=8792.65 00:19:36.697 clat (usec): min=268, max=42080, avg=33539.49, stdev=15700.55 00:19:36.697 lat (usec): min=280, max=42102, avg=33563.90, stdev=15704.10 00:19:36.697 clat percentiles (usec): 00:19:36.697 | 1.00th=[ 269], 5.00th=[ 310], 10.00th=[ 347], 20.00th=[35390], 00:19:36.697 | 30.00th=[40633], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:36.697 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:19:36.697 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:36.697 | 99.99th=[42206] 00:19:36.697 write: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec); 0 zone resets 00:19:36.697 slat (nsec): min=7096, max=54913, avg=11725.53, stdev=5964.68 00:19:36.697 clat (usec): min=175, max=409, avg=235.35, stdev=33.86 00:19:36.697 lat (usec): min=186, max=424, avg=247.08, stdev=33.79 00:19:36.697 clat percentiles (usec): 00:19:36.697 | 1.00th=[ 190], 5.00th=[ 202], 10.00th=[ 208], 20.00th=[ 217], 00:19:36.697 | 30.00th=[ 223], 40.00th=[ 225], 50.00th=[ 229], 60.00th=[ 233], 00:19:36.697 | 70.00th=[ 239], 80.00th=[ 245], 90.00th=[ 258], 95.00th=[ 302], 00:19:36.697 | 99.00th=[ 392], 99.50th=[ 396], 99.90th=[ 412], 99.95th=[ 412], 00:19:36.697 | 99.99th=[ 412] 00:19:36.697 bw ( KiB/s): min= 4096, max= 4096, per=20.80%, avg=4096.00, stdev= 0.00, samples=1 00:19:36.697 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:36.697 lat (usec) : 250=80.86%, 500=15.06% 00:19:36.697 lat (msec) : 20=0.19%, 50=3.90% 00:19:36.697 cpu : usr=0.50%, sys=0.70%, ctx=539, majf=0, minf=1 00:19:36.697 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:36.697 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.697 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.697 issued rwts: total=26,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.697 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:36.697 00:19:36.697 Run status group 0 (all jobs): 00:19:36.697 READ: bw=14.7MiB/s (15.4MB/s), 104KiB/s-7349KiB/s (106kB/s-7525kB/s), io=15.3MiB (16.0MB), run=1001-1040msec 00:19:36.697 WRITE: bw=19.2MiB/s (20.2MB/s), 1969KiB/s-8184KiB/s (2016kB/s-8380kB/s), io=20.0MiB (21.0MB), run=1001-1040msec 00:19:36.697 00:19:36.697 Disk stats (read/write): 00:19:36.697 nvme0n1: ios=275/512, merge=0/0, ticks=1283/113, in_queue=1396, util=97.80% 00:19:36.697 nvme0n2: ios=1576/1567, merge=0/0, ticks=1265/292, in_queue=1557, util=97.06% 00:19:36.697 nvme0n3: ios=1625/2048, merge=0/0, ticks=935/362, in_queue=1297, util=97.60% 00:19:36.697 nvme0n4: ios=67/512, merge=0/0, ticks=1026/117, in_queue=1143, util=97.59% 00:19:36.697 15:14:36 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:36.697 [global] 00:19:36.697 thread=1 00:19:36.697 invalidate=1 00:19:36.697 rw=write 00:19:36.697 time_based=1 00:19:36.697 runtime=1 00:19:36.697 ioengine=libaio 00:19:36.697 direct=1 00:19:36.697 bs=4096 00:19:36.697 iodepth=128 00:19:36.697 norandommap=0 00:19:36.697 numjobs=1 00:19:36.697 00:19:36.697 verify_dump=1 00:19:36.697 verify_backlog=512 00:19:36.697 verify_state_save=0 00:19:36.697 do_verify=1 00:19:36.697 verify=crc32c-intel 00:19:36.697 [job0] 00:19:36.697 filename=/dev/nvme0n1 00:19:36.697 [job1] 00:19:36.697 filename=/dev/nvme0n2 00:19:36.697 [job2] 00:19:36.697 filename=/dev/nvme0n3 00:19:36.697 [job3] 00:19:36.697 filename=/dev/nvme0n4 00:19:36.697 Could not set queue depth (nvme0n1) 00:19:36.697 Could not set queue depth (nvme0n2) 00:19:36.697 Could not set queue depth (nvme0n3) 00:19:36.697 Could not set queue depth (nvme0n4) 00:19:36.956 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.956 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.956 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.956 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.956 fio-3.35 00:19:36.956 Starting 4 threads 00:19:38.331 00:19:38.331 job0: (groupid=0, jobs=1): err= 0: pid=726438: Thu Nov 28 15:14:38 2024 00:19:38.331 read: IOPS=3677, BW=14.4MiB/s (15.1MB/s)(14.4MiB/1001msec) 00:19:38.331 slat (usec): min=3, max=10644, avg=128.18, stdev=692.47 00:19:38.331 clat (usec): min=380, max=41227, avg=15919.17, stdev=6319.85 00:19:38.331 lat (usec): min=3024, max=41243, avg=16047.35, stdev=6353.35 00:19:38.331 clat percentiles (usec): 00:19:38.331 | 1.00th=[ 6259], 5.00th=[10290], 10.00th=[10814], 20.00th=[11338], 00:19:38.331 | 30.00th=[12387], 40.00th=[12911], 50.00th=[13435], 60.00th=[14615], 00:19:38.331 | 70.00th=[18220], 80.00th=[20055], 90.00th=[25035], 95.00th=[28443], 00:19:38.331 | 99.00th=[35914], 99.50th=[36439], 99.90th=[39060], 99.95th=[41157], 00:19:38.331 | 99.99th=[41157] 00:19:38.331 write: IOPS=4091, BW=16.0MiB/s (16.8MB/s)(16.0MiB/1001msec); 0 zone resets 00:19:38.331 slat (usec): min=4, max=20202, avg=117.39, stdev=671.47 00:19:38.331 clat (usec): min=5315, max=39743, avg=15859.93, stdev=4676.41 00:19:38.331 lat (usec): min=5326, max=39763, avg=15977.32, stdev=4687.58 00:19:38.331 clat percentiles (usec): 00:19:38.331 | 1.00th=[ 9372], 5.00th=[11076], 10.00th=[11600], 20.00th=[12387], 00:19:38.331 | 30.00th=[13042], 40.00th=[13960], 50.00th=[14615], 60.00th=[15270], 00:19:38.331 | 70.00th=[16909], 80.00th=[19530], 90.00th=[20841], 95.00th=[23462], 00:19:38.331 | 99.00th=[34341], 99.50th=[34866], 99.90th=[34866], 99.95th=[34866], 00:19:38.331 | 99.99th=[39584] 00:19:38.331 bw ( KiB/s): min=13992, max=13992, per=20.42%, avg=13992.00, stdev= 0.00, samples=1 00:19:38.331 iops : min= 3498, max= 3498, avg=3498.00, stdev= 0.00, samples=1 00:19:38.331 lat (usec) : 500=0.01% 00:19:38.331 lat (msec) : 4=0.41%, 10=3.34%, 20=77.45%, 50=18.79% 00:19:38.331 cpu : usr=5.70%, sys=8.70%, ctx=356, majf=0, minf=1 00:19:38.331 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:38.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:38.331 issued rwts: total=3681,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.331 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:38.331 job1: (groupid=0, jobs=1): err= 0: pid=726439: Thu Nov 28 15:14:38 2024 00:19:38.331 read: IOPS=4229, BW=16.5MiB/s (17.3MB/s)(16.6MiB/1002msec) 00:19:38.331 slat (usec): min=2, max=45512, avg=113.55, stdev=905.89 00:19:38.331 clat (usec): min=323, max=67723, avg=14909.11, stdev=10196.23 00:19:38.331 lat (usec): min=2452, max=67728, avg=15022.66, stdev=10238.64 00:19:38.331 clat percentiles (usec): 00:19:38.331 | 1.00th=[ 5014], 5.00th=[ 8225], 10.00th=[ 9241], 20.00th=[ 9765], 00:19:38.331 | 30.00th=[10159], 40.00th=[10290], 50.00th=[10814], 60.00th=[11600], 00:19:38.331 | 70.00th=[15401], 80.00th=[19530], 90.00th=[23987], 95.00th=[29492], 00:19:38.331 | 99.00th=[62129], 99.50th=[67634], 99.90th=[67634], 99.95th=[67634], 00:19:38.331 | 99.99th=[67634] 00:19:38.331 write: IOPS=4598, BW=18.0MiB/s (18.8MB/s)(18.0MiB/1002msec); 0 zone resets 00:19:38.331 slat (usec): min=2, max=5933, avg=104.09, stdev=562.91 00:19:38.331 clat (usec): min=5212, max=29370, avg=13715.75, stdev=4403.72 00:19:38.331 lat (usec): min=5252, max=30014, avg=13819.85, stdev=4413.10 00:19:38.331 clat percentiles (usec): 00:19:38.331 | 1.00th=[ 8160], 5.00th=[ 8717], 10.00th=[ 8979], 20.00th=[10290], 00:19:38.331 | 30.00th=[10814], 40.00th=[11207], 50.00th=[11600], 60.00th=[13042], 00:19:38.331 | 70.00th=[16188], 80.00th=[18744], 90.00th=[20055], 95.00th=[20841], 00:19:38.331 | 99.00th=[25297], 99.50th=[27395], 99.90th=[29492], 99.95th=[29492], 00:19:38.331 | 99.99th=[29492] 00:19:38.331 bw ( KiB/s): min=12344, max=24520, per=26.90%, avg=18432.00, stdev=8609.73, samples=2 00:19:38.331 iops : min= 3086, max= 6130, avg=4608.00, stdev=2152.43, samples=2 00:19:38.331 lat (usec) : 500=0.01% 00:19:38.331 lat (msec) : 4=0.36%, 10=21.00%, 20=65.85%, 50=11.25%, 100=1.53% 00:19:38.331 cpu : usr=4.00%, sys=6.69%, ctx=428, majf=0, minf=1 00:19:38.331 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:38.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:38.331 issued rwts: total=4238,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.331 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:38.331 job2: (groupid=0, jobs=1): err= 0: pid=726450: Thu Nov 28 15:14:38 2024 00:19:38.331 read: IOPS=4031, BW=15.7MiB/s (16.5MB/s)(16.0MiB/1016msec) 00:19:38.331 slat (usec): min=2, max=17138, avg=116.62, stdev=892.81 00:19:38.331 clat (usec): min=4132, max=49438, avg=14859.90, stdev=5809.18 00:19:38.331 lat (usec): min=4160, max=49466, avg=14976.53, stdev=5863.75 00:19:38.331 clat percentiles (usec): 00:19:38.331 | 1.00th=[ 5604], 5.00th=[ 9241], 10.00th=[10028], 20.00th=[10945], 00:19:38.331 | 30.00th=[11076], 40.00th=[11338], 50.00th=[12387], 60.00th=[13829], 00:19:38.331 | 70.00th=[16909], 80.00th=[19268], 90.00th=[22414], 95.00th=[26084], 00:19:38.331 | 99.00th=[34866], 99.50th=[35390], 99.90th=[35390], 99.95th=[35390], 00:19:38.331 | 99.99th=[49546] 00:19:38.331 write: IOPS=4533, BW=17.7MiB/s (18.6MB/s)(18.0MiB/1016msec); 0 zone resets 00:19:38.331 slat (usec): min=3, max=15176, avg=102.76, stdev=498.07 00:19:38.331 clat (usec): min=1096, max=51280, avg=14775.03, stdev=7552.92 00:19:38.331 lat (usec): min=1108, max=52428, avg=14877.79, stdev=7601.14 00:19:38.331 clat percentiles (usec): 00:19:38.331 | 1.00th=[ 3163], 5.00th=[ 5145], 10.00th=[ 7177], 20.00th=[11469], 00:19:38.331 | 30.00th=[12256], 40.00th=[12518], 50.00th=[12780], 60.00th=[13042], 00:19:38.331 | 70.00th=[13435], 80.00th=[20841], 90.00th=[23725], 95.00th=[25560], 00:19:38.331 | 99.00th=[45876], 99.50th=[48497], 99.90th=[51119], 99.95th=[51119], 00:19:38.331 | 99.99th=[51119] 00:19:38.331 bw ( KiB/s): min=14600, max=21232, per=26.14%, avg=17916.00, stdev=4689.53, samples=2 00:19:38.331 iops : min= 3650, max= 5308, avg=4479.00, stdev=1172.38, samples=2 00:19:38.331 lat (msec) : 2=0.20%, 4=0.84%, 10=11.31%, 20=68.12%, 50=19.44% 00:19:38.331 lat (msec) : 100=0.09% 00:19:38.331 cpu : usr=7.00%, sys=9.36%, ctx=552, majf=0, minf=1 00:19:38.331 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:38.331 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.331 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:38.331 issued rwts: total=4096,4606,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.331 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:38.331 job3: (groupid=0, jobs=1): err= 0: pid=726457: Thu Nov 28 15:14:38 2024 00:19:38.331 read: IOPS=3557, BW=13.9MiB/s (14.6MB/s)(14.1MiB/1016msec) 00:19:38.331 slat (usec): min=2, max=32979, avg=142.45, stdev=1244.69 00:19:38.332 clat (usec): min=6291, max=68425, avg=17611.24, stdev=12121.21 00:19:38.332 lat (usec): min=6300, max=68437, avg=17753.68, stdev=12222.32 00:19:38.332 clat percentiles (usec): 00:19:38.332 | 1.00th=[ 8586], 5.00th=[10683], 10.00th=[10945], 20.00th=[11207], 00:19:38.332 | 30.00th=[11469], 40.00th=[11731], 50.00th=[11994], 60.00th=[12387], 00:19:38.332 | 70.00th=[13173], 80.00th=[21627], 90.00th=[34866], 95.00th=[44827], 00:19:38.332 | 99.00th=[59507], 99.50th=[68682], 99.90th=[68682], 99.95th=[68682], 00:19:38.332 | 99.99th=[68682] 00:19:38.332 write: IOPS=4031, BW=15.7MiB/s (16.5MB/s)(16.0MiB/1016msec); 0 zone resets 00:19:38.332 slat (usec): min=3, max=13015, avg=109.48, stdev=571.71 00:19:38.332 clat (usec): min=2309, max=58899, avg=15734.07, stdev=6735.77 00:19:38.332 lat (usec): min=2327, max=58906, avg=15843.55, stdev=6765.00 00:19:38.332 clat percentiles (usec): 00:19:38.332 | 1.00th=[ 5080], 5.00th=[ 9765], 10.00th=[10814], 20.00th=[11731], 00:19:38.332 | 30.00th=[11863], 40.00th=[12256], 50.00th=[12518], 60.00th=[12911], 00:19:38.332 | 70.00th=[17171], 80.00th=[22676], 90.00th=[24249], 95.00th=[28967], 00:19:38.332 | 99.00th=[38536], 99.50th=[40633], 99.90th=[42206], 99.95th=[42206], 00:19:38.332 | 99.99th=[58983] 00:19:38.332 bw ( KiB/s): min=11512, max=20480, per=23.34%, avg=15996.00, stdev=6341.33, samples=2 00:19:38.332 iops : min= 2878, max= 5120, avg=3999.00, stdev=1585.33, samples=2 00:19:38.332 lat (msec) : 4=0.25%, 10=3.94%, 20=72.72%, 50=21.00%, 100=2.09% 00:19:38.332 cpu : usr=3.65%, sys=7.09%, ctx=351, majf=0, minf=1 00:19:38.332 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:38.332 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:38.332 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:38.332 issued rwts: total=3614,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:38.332 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:38.332 00:19:38.332 Run status group 0 (all jobs): 00:19:38.332 READ: bw=60.1MiB/s (63.0MB/s), 13.9MiB/s-16.5MiB/s (14.6MB/s-17.3MB/s), io=61.1MiB (64.0MB), run=1001-1016msec 00:19:38.332 WRITE: bw=66.9MiB/s (70.2MB/s), 15.7MiB/s-18.0MiB/s (16.5MB/s-18.8MB/s), io=68.0MiB (71.3MB), run=1001-1016msec 00:19:38.332 00:19:38.332 Disk stats (read/write): 00:19:38.332 nvme0n1: ios=3124/3267, merge=0/0, ticks=17953/15334, in_queue=33287, util=93.89% 00:19:38.332 nvme0n2: ios=3425/3584, merge=0/0, ticks=16379/12753, in_queue=29132, util=95.63% 00:19:38.332 nvme0n3: ios=3633/3860, merge=0/0, ticks=48735/52361, in_queue=101096, util=96.45% 00:19:38.332 nvme0n4: ios=3371/3584, merge=0/0, ticks=30677/28644, in_queue=59321, util=99.68% 00:19:38.332 15:14:38 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:38.332 [global] 00:19:38.332 thread=1 00:19:38.332 invalidate=1 00:19:38.332 rw=randwrite 00:19:38.332 time_based=1 00:19:38.332 runtime=1 00:19:38.332 ioengine=libaio 00:19:38.332 direct=1 00:19:38.332 bs=4096 00:19:38.332 iodepth=128 00:19:38.332 norandommap=0 00:19:38.332 numjobs=1 00:19:38.332 00:19:38.332 verify_dump=1 00:19:38.332 verify_backlog=512 00:19:38.332 verify_state_save=0 00:19:38.332 do_verify=1 00:19:38.332 verify=crc32c-intel 00:19:38.332 [job0] 00:19:38.332 filename=/dev/nvme0n1 00:19:38.332 [job1] 00:19:38.332 filename=/dev/nvme0n2 00:19:38.332 [job2] 00:19:38.332 filename=/dev/nvme0n3 00:19:38.332 [job3] 00:19:38.332 filename=/dev/nvme0n4 00:19:38.332 Could not set queue depth (nvme0n1) 00:19:38.332 Could not set queue depth (nvme0n2) 00:19:38.332 Could not set queue depth (nvme0n3) 00:19:38.332 Could not set queue depth (nvme0n4) 00:19:38.332 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.332 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.332 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.332 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:38.332 fio-3.35 00:19:38.332 Starting 4 threads 00:19:39.708 00:19:39.708 job0: (groupid=0, jobs=1): err= 0: pid=726799: Thu Nov 28 15:14:39 2024 00:19:39.708 read: IOPS=2522, BW=9.85MiB/s (10.3MB/s)(10.0MiB/1015msec) 00:19:39.708 slat (usec): min=2, max=13712, avg=192.68, stdev=1063.02 00:19:39.708 clat (usec): min=2017, max=61603, avg=23339.11, stdev=9584.60 00:19:39.708 lat (usec): min=2152, max=61620, avg=23531.80, stdev=9668.32 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 8094], 5.00th=[11076], 10.00th=[14353], 20.00th=[16057], 00:19:39.708 | 30.00th=[16909], 40.00th=[19006], 50.00th=[21890], 60.00th=[23987], 00:19:39.708 | 70.00th=[26084], 80.00th=[30540], 90.00th=[36439], 95.00th=[44303], 00:19:39.708 | 99.00th=[52691], 99.50th=[52691], 99.90th=[55837], 99.95th=[56886], 00:19:39.708 | 99.99th=[61604] 00:19:39.708 write: IOPS=3024, BW=11.8MiB/s (12.4MB/s)(12.0MiB/1015msec); 0 zone resets 00:19:39.708 slat (usec): min=3, max=12802, avg=156.46, stdev=776.86 00:19:39.708 clat (usec): min=1723, max=51121, avg=22174.28, stdev=8991.24 00:19:39.708 lat (usec): min=1735, max=51134, avg=22330.75, stdev=9050.53 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 3359], 5.00th=[ 9372], 10.00th=[10421], 20.00th=[16450], 00:19:39.708 | 30.00th=[17695], 40.00th=[19268], 50.00th=[20579], 60.00th=[22414], 00:19:39.708 | 70.00th=[24773], 80.00th=[28967], 90.00th=[34866], 95.00th=[39060], 00:19:39.708 | 99.00th=[48497], 99.50th=[50070], 99.90th=[51119], 99.95th=[51119], 00:19:39.708 | 99.99th=[51119] 00:19:39.708 bw ( KiB/s): min=11256, max=12288, per=19.83%, avg=11772.00, stdev=729.73, samples=2 00:19:39.708 iops : min= 2814, max= 3072, avg=2943.00, stdev=182.43, samples=2 00:19:39.708 lat (msec) : 2=0.12%, 4=0.71%, 10=4.72%, 20=41.17%, 50=52.08% 00:19:39.708 lat (msec) : 100=1.19% 00:19:39.708 cpu : usr=1.97%, sys=4.34%, ctx=326, majf=0, minf=1 00:19:39.708 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:39.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.708 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:39.708 issued rwts: total=2560,3070,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.708 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:39.708 job1: (groupid=0, jobs=1): err= 0: pid=726800: Thu Nov 28 15:14:39 2024 00:19:39.708 read: IOPS=3041, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1010msec) 00:19:39.708 slat (usec): min=2, max=17271, avg=154.58, stdev=936.90 00:19:39.708 clat (usec): min=3052, max=55281, avg=19844.75, stdev=10233.95 00:19:39.708 lat (usec): min=3060, max=55284, avg=19999.33, stdev=10278.07 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 6325], 5.00th=[ 9110], 10.00th=[ 9896], 20.00th=[11076], 00:19:39.708 | 30.00th=[11731], 40.00th=[14222], 50.00th=[18482], 60.00th=[20841], 00:19:39.708 | 70.00th=[21890], 80.00th=[28443], 90.00th=[33817], 95.00th=[38536], 00:19:39.708 | 99.00th=[55313], 99.50th=[55313], 99.90th=[55313], 99.95th=[55313], 00:19:39.708 | 99.99th=[55313] 00:19:39.708 write: IOPS=3333, BW=13.0MiB/s (13.7MB/s)(13.2MiB/1010msec); 0 zone resets 00:19:39.708 slat (usec): min=3, max=29536, avg=149.26, stdev=952.90 00:19:39.708 clat (usec): min=6664, max=48399, avg=19597.28, stdev=9134.15 00:19:39.708 lat (usec): min=6676, max=48403, avg=19746.54, stdev=9158.50 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 7177], 5.00th=[ 9241], 10.00th=[10290], 20.00th=[13173], 00:19:39.708 | 30.00th=[14222], 40.00th=[14484], 50.00th=[16909], 60.00th=[18482], 00:19:39.708 | 70.00th=[22152], 80.00th=[27919], 90.00th=[31851], 95.00th=[40109], 00:19:39.708 | 99.00th=[46400], 99.50th=[48497], 99.90th=[48497], 99.95th=[48497], 00:19:39.708 | 99.99th=[48497] 00:19:39.708 bw ( KiB/s): min=12288, max=13624, per=21.82%, avg=12956.00, stdev=944.69, samples=2 00:19:39.708 iops : min= 3072, max= 3406, avg=3239.00, stdev=236.17, samples=2 00:19:39.708 lat (msec) : 4=0.33%, 10=9.35%, 20=52.15%, 50=37.69%, 100=0.48% 00:19:39.708 cpu : usr=2.18%, sys=5.15%, ctx=256, majf=0, minf=1 00:19:39.708 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:19:39.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.708 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:39.708 issued rwts: total=3072,3367,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.708 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:39.708 job2: (groupid=0, jobs=1): err= 0: pid=726801: Thu Nov 28 15:14:39 2024 00:19:39.708 read: IOPS=4055, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1010msec) 00:19:39.708 slat (usec): min=2, max=25909, avg=122.26, stdev=785.46 00:19:39.708 clat (usec): min=7374, max=54863, avg=16208.07, stdev=5639.12 00:19:39.708 lat (usec): min=7384, max=57681, avg=16330.33, stdev=5668.09 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 9634], 5.00th=[10683], 10.00th=[11863], 20.00th=[12780], 00:19:39.708 | 30.00th=[13042], 40.00th=[13435], 50.00th=[14222], 60.00th=[15533], 00:19:39.708 | 70.00th=[16712], 80.00th=[18482], 90.00th=[23200], 95.00th=[26870], 00:19:39.708 | 99.00th=[40109], 99.50th=[40109], 99.90th=[40109], 99.95th=[54789], 00:19:39.708 | 99.99th=[54789] 00:19:39.708 write: IOPS=4181, BW=16.3MiB/s (17.1MB/s)(16.5MiB/1010msec); 0 zone resets 00:19:39.708 slat (usec): min=3, max=13294, avg=110.82, stdev=736.57 00:19:39.708 clat (usec): min=5905, max=30540, avg=14513.69, stdev=3060.20 00:19:39.708 lat (usec): min=5915, max=30564, avg=14624.52, stdev=3109.24 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 8848], 5.00th=[10814], 10.00th=[11338], 20.00th=[11863], 00:19:39.708 | 30.00th=[12780], 40.00th=[13435], 50.00th=[14091], 60.00th=[14746], 00:19:39.708 | 70.00th=[15533], 80.00th=[16188], 90.00th=[18482], 95.00th=[20841], 00:19:39.708 | 99.00th=[24249], 99.50th=[24511], 99.90th=[24773], 99.95th=[25297], 00:19:39.708 | 99.99th=[30540] 00:19:39.708 bw ( KiB/s): min=15960, max=16872, per=27.65%, avg=16416.00, stdev=644.88, samples=2 00:19:39.708 iops : min= 3990, max= 4218, avg=4104.00, stdev=161.22, samples=2 00:19:39.708 lat (msec) : 10=1.98%, 20=85.25%, 50=12.73%, 100=0.04% 00:19:39.708 cpu : usr=2.97%, sys=7.14%, ctx=284, majf=0, minf=1 00:19:39.708 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:39.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.708 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:39.708 issued rwts: total=4096,4223,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.708 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:39.708 job3: (groupid=0, jobs=1): err= 0: pid=726802: Thu Nov 28 15:14:39 2024 00:19:39.708 read: IOPS=4035, BW=15.8MiB/s (16.5MB/s)(16.0MiB/1015msec) 00:19:39.708 slat (usec): min=3, max=17131, avg=120.61, stdev=762.16 00:19:39.708 clat (usec): min=3793, max=58512, avg=16016.49, stdev=9694.38 00:19:39.708 lat (usec): min=3804, max=58519, avg=16137.10, stdev=9747.16 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 7439], 5.00th=[ 9896], 10.00th=[10290], 20.00th=[11469], 00:19:39.708 | 30.00th=[11863], 40.00th=[12125], 50.00th=[12518], 60.00th=[13042], 00:19:39.708 | 70.00th=[14222], 80.00th=[17171], 90.00th=[24773], 95.00th=[41157], 00:19:39.708 | 99.00th=[56361], 99.50th=[58459], 99.90th=[58459], 99.95th=[58459], 00:19:39.708 | 99.99th=[58459] 00:19:39.708 write: IOPS=4340, BW=17.0MiB/s (17.8MB/s)(17.2MiB/1015msec); 0 zone resets 00:19:39.708 slat (usec): min=4, max=7464, avg=103.90, stdev=470.63 00:19:39.708 clat (usec): min=3254, max=42575, avg=14080.22, stdev=5679.92 00:19:39.708 lat (usec): min=3291, max=42602, avg=14184.12, stdev=5707.32 00:19:39.708 clat percentiles (usec): 00:19:39.708 | 1.00th=[ 7701], 5.00th=[ 9372], 10.00th=[ 9896], 20.00th=[10814], 00:19:39.708 | 30.00th=[11338], 40.00th=[11731], 50.00th=[12125], 60.00th=[12780], 00:19:39.708 | 70.00th=[13566], 80.00th=[16057], 90.00th=[22152], 95.00th=[27395], 00:19:39.708 | 99.00th=[36439], 99.50th=[38011], 99.90th=[40633], 99.95th=[40633], 00:19:39.708 | 99.99th=[42730] 00:19:39.708 bw ( KiB/s): min=15832, max=18400, per=28.83%, avg=17116.00, stdev=1815.85, samples=2 00:19:39.708 iops : min= 3958, max= 4600, avg=4279.00, stdev=453.96, samples=2 00:19:39.708 lat (msec) : 4=0.25%, 10=8.32%, 20=77.99%, 50=11.99%, 100=1.46% 00:19:39.708 cpu : usr=5.62%, sys=9.07%, ctx=451, majf=0, minf=1 00:19:39.708 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:39.708 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:39.708 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:39.708 issued rwts: total=4096,4406,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:39.708 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:39.708 00:19:39.708 Run status group 0 (all jobs): 00:19:39.708 READ: bw=53.2MiB/s (55.8MB/s), 9.85MiB/s-15.8MiB/s (10.3MB/s-16.6MB/s), io=54.0MiB (56.6MB), run=1010-1015msec 00:19:39.708 WRITE: bw=58.0MiB/s (60.8MB/s), 11.8MiB/s-17.0MiB/s (12.4MB/s-17.8MB/s), io=58.9MiB (61.7MB), run=1010-1015msec 00:19:39.708 00:19:39.708 Disk stats (read/write): 00:19:39.708 nvme0n1: ios=2087/2532, merge=0/0, ticks=16927/16296, in_queue=33223, util=100.00% 00:19:39.708 nvme0n2: ios=2232/2560, merge=0/0, ticks=16293/12777, in_queue=29070, util=100.00% 00:19:39.708 nvme0n3: ios=3130/3529, merge=0/0, ticks=19413/19589, in_queue=39002, util=97.84% 00:19:39.708 nvme0n4: ios=3547/3584, merge=0/0, ticks=13631/10568, in_queue=24199, util=89.27% 00:19:39.708 15:14:39 -- target/fio.sh@55 -- # sync 00:19:39.708 15:14:39 -- target/fio.sh@59 -- # fio_pid=726938 00:19:39.708 15:14:39 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:39.708 15:14:39 -- target/fio.sh@61 -- # sleep 3 00:19:39.708 [global] 00:19:39.708 thread=1 00:19:39.708 invalidate=1 00:19:39.708 rw=read 00:19:39.708 time_based=1 00:19:39.708 runtime=10 00:19:39.708 ioengine=libaio 00:19:39.708 direct=1 00:19:39.708 bs=4096 00:19:39.708 iodepth=1 00:19:39.708 norandommap=1 00:19:39.708 numjobs=1 00:19:39.708 00:19:39.708 [job0] 00:19:39.708 filename=/dev/nvme0n1 00:19:39.708 [job1] 00:19:39.708 filename=/dev/nvme0n2 00:19:39.708 [job2] 00:19:39.708 filename=/dev/nvme0n3 00:19:39.708 [job3] 00:19:39.708 filename=/dev/nvme0n4 00:19:39.708 Could not set queue depth (nvme0n1) 00:19:39.708 Could not set queue depth (nvme0n2) 00:19:39.708 Could not set queue depth (nvme0n3) 00:19:39.708 Could not set queue depth (nvme0n4) 00:19:39.966 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:39.966 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:39.966 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:39.966 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:39.966 fio-3.35 00:19:39.966 Starting 4 threads 00:19:43.246 15:14:42 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:43.246 15:14:43 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:43.246 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=6230016, buflen=4096 00:19:43.246 fio: pid=727033, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:43.246 15:14:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:43.246 15:14:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:43.246 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=1867776, buflen=4096 00:19:43.246 fio: pid=727032, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:43.504 15:14:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:43.504 15:14:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:43.504 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=335872, buflen=4096 00:19:43.504 fio: pid=727030, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:43.762 15:14:43 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:43.762 15:14:43 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:43.762 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=4395008, buflen=4096 00:19:43.762 fio: pid=727031, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:43.762 00:19:43.762 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=727030: Thu Nov 28 15:14:43 2024 00:19:43.762 read: IOPS=24, BW=96.2KiB/s (98.5kB/s)(328KiB/3410msec) 00:19:43.762 slat (usec): min=8, max=25891, avg=435.39, stdev=2971.60 00:19:43.763 clat (usec): min=298, max=42061, avg=40833.85, stdev=4556.21 00:19:43.763 lat (usec): min=320, max=66955, avg=41172.96, stdev=5391.76 00:19:43.763 clat percentiles (usec): 00:19:43.763 | 1.00th=[ 297], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:43.763 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:43.763 | 70.00th=[41681], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:19:43.763 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:43.763 | 99.99th=[42206] 00:19:43.763 bw ( KiB/s): min= 88, max= 104, per=2.82%, avg=96.00, stdev= 5.06, samples=6 00:19:43.763 iops : min= 22, max= 26, avg=24.00, stdev= 1.26, samples=6 00:19:43.763 lat (usec) : 500=1.20% 00:19:43.763 lat (msec) : 50=97.59% 00:19:43.763 cpu : usr=0.12%, sys=0.00%, ctx=87, majf=0, minf=2 00:19:43.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:43.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 issued rwts: total=83,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:43.763 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=727031: Thu Nov 28 15:14:43 2024 00:19:43.763 read: IOPS=291, BW=1164KiB/s (1192kB/s)(4292KiB/3686msec) 00:19:43.763 slat (usec): min=4, max=11920, avg=26.44, stdev=436.16 00:19:43.763 clat (usec): min=159, max=42053, avg=3384.32, stdev=10886.30 00:19:43.763 lat (usec): min=164, max=52982, avg=3410.76, stdev=10961.93 00:19:43.763 clat percentiles (usec): 00:19:43.763 | 1.00th=[ 163], 5.00th=[ 167], 10.00th=[ 174], 20.00th=[ 184], 00:19:43.763 | 30.00th=[ 196], 40.00th=[ 210], 50.00th=[ 243], 60.00th=[ 253], 00:19:43.763 | 70.00th=[ 262], 80.00th=[ 314], 90.00th=[ 519], 95.00th=[41157], 00:19:43.763 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:43.763 | 99.99th=[42206] 00:19:43.763 bw ( KiB/s): min= 96, max= 5144, per=35.92%, avg=1221.14, stdev=1978.30, samples=7 00:19:43.763 iops : min= 24, max= 1286, avg=305.29, stdev=494.57, samples=7 00:19:43.763 lat (usec) : 250=56.98%, 500=31.19%, 750=3.91%, 1000=0.09% 00:19:43.763 lat (msec) : 10=0.09%, 50=7.64% 00:19:43.763 cpu : usr=0.03%, sys=0.33%, ctx=1077, majf=0, minf=2 00:19:43.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:43.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 issued rwts: total=1074,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:43.763 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=727032: Thu Nov 28 15:14:43 2024 00:19:43.763 read: IOPS=144, BW=576KiB/s (590kB/s)(1824KiB/3166msec) 00:19:43.763 slat (usec): min=4, max=7789, avg=25.91, stdev=364.07 00:19:43.763 clat (usec): min=178, max=42093, avg=6889.36, stdev=15152.75 00:19:43.763 lat (usec): min=183, max=48961, avg=6915.29, stdev=15201.87 00:19:43.763 clat percentiles (usec): 00:19:43.763 | 1.00th=[ 182], 5.00th=[ 190], 10.00th=[ 192], 20.00th=[ 198], 00:19:43.763 | 30.00th=[ 200], 40.00th=[ 204], 50.00th=[ 206], 60.00th=[ 210], 00:19:43.763 | 70.00th=[ 221], 80.00th=[ 265], 90.00th=[41157], 95.00th=[41681], 00:19:43.763 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:43.763 | 99.99th=[42206] 00:19:43.763 bw ( KiB/s): min= 96, max= 3008, per=17.71%, avg=602.67, stdev=1179.32, samples=6 00:19:43.763 iops : min= 24, max= 752, avg=150.67, stdev=294.83, samples=6 00:19:43.763 lat (usec) : 250=78.34%, 500=4.81%, 750=0.22% 00:19:43.763 lat (msec) : 10=0.22%, 50=16.19% 00:19:43.763 cpu : usr=0.06%, sys=0.13%, ctx=459, majf=0, minf=1 00:19:43.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:43.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 complete : 0=0.2%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 issued rwts: total=457,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:43.763 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=727033: Thu Nov 28 15:14:43 2024 00:19:43.763 read: IOPS=520, BW=2081KiB/s (2131kB/s)(6084KiB/2923msec) 00:19:43.763 slat (nsec): min=4059, max=34992, avg=7405.02, stdev=5576.40 00:19:43.763 clat (usec): min=164, max=42406, avg=1896.49, stdev=8070.70 00:19:43.763 lat (usec): min=169, max=42441, avg=1903.89, stdev=8073.70 00:19:43.763 clat percentiles (usec): 00:19:43.763 | 1.00th=[ 169], 5.00th=[ 178], 10.00th=[ 184], 20.00th=[ 192], 00:19:43.763 | 30.00th=[ 206], 40.00th=[ 235], 50.00th=[ 245], 60.00th=[ 251], 00:19:43.763 | 70.00th=[ 255], 80.00th=[ 265], 90.00th=[ 293], 95.00th=[ 457], 00:19:43.763 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:43.763 | 99.99th=[42206] 00:19:43.763 bw ( KiB/s): min= 104, max= 6960, per=44.90%, avg=1526.40, stdev=3037.75, samples=5 00:19:43.763 iops : min= 26, max= 1740, avg=381.60, stdev=759.44, samples=5 00:19:43.763 lat (usec) : 250=59.92%, 500=35.48%, 750=0.46% 00:19:43.763 lat (msec) : 20=0.07%, 50=4.01% 00:19:43.763 cpu : usr=0.10%, sys=0.44%, ctx=1523, majf=0, minf=2 00:19:43.763 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:43.763 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 complete : 0=0.1%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:43.763 issued rwts: total=1522,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:43.763 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:43.763 00:19:43.763 Run status group 0 (all jobs): 00:19:43.763 READ: bw=3399KiB/s (3480kB/s), 96.2KiB/s-2081KiB/s (98.5kB/s-2131kB/s), io=12.2MiB (12.8MB), run=2923-3686msec 00:19:43.763 00:19:43.763 Disk stats (read/write): 00:19:43.763 nvme0n1: ios=124/0, merge=0/0, ticks=3904/0, in_queue=3904, util=98.74% 00:19:43.763 nvme0n2: ios=1071/0, merge=0/0, ticks=3549/0, in_queue=3549, util=96.03% 00:19:43.763 nvme0n3: ios=498/0, merge=0/0, ticks=3995/0, in_queue=3995, util=99.19% 00:19:43.763 nvme0n4: ios=1539/0, merge=0/0, ticks=3550/0, in_queue=3550, util=99.29% 00:19:44.022 15:14:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:44.022 15:14:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:44.280 15:14:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:44.280 15:14:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:44.538 15:14:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:44.538 15:14:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:44.796 15:14:44 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:44.796 15:14:44 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:45.061 15:14:45 -- target/fio.sh@69 -- # fio_status=0 00:19:45.061 15:14:45 -- target/fio.sh@70 -- # wait 726938 00:19:45.061 15:14:45 -- target/fio.sh@70 -- # fio_status=4 00:19:45.061 15:14:45 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:45.061 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:45.061 15:14:45 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:45.062 15:14:45 -- common/autotest_common.sh@1208 -- # local i=0 00:19:45.062 15:14:45 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:45.062 15:14:45 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:45.062 15:14:45 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:45.062 15:14:45 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:45.062 15:14:45 -- common/autotest_common.sh@1220 -- # return 0 00:19:45.062 15:14:45 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:45.062 15:14:45 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:45.062 nvmf hotplug test: fio failed as expected 00:19:45.062 15:14:45 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:45.322 15:14:45 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:45.322 15:14:45 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:45.322 15:14:45 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:45.322 15:14:45 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:45.322 15:14:45 -- target/fio.sh@91 -- # nvmftestfini 00:19:45.322 15:14:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:45.322 15:14:45 -- nvmf/common.sh@116 -- # sync 00:19:45.322 15:14:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:45.322 15:14:45 -- nvmf/common.sh@119 -- # set +e 00:19:45.322 15:14:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:45.322 15:14:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:45.322 rmmod nvme_tcp 00:19:45.322 rmmod nvme_fabrics 00:19:45.580 rmmod nvme_keyring 00:19:45.580 15:14:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:45.580 15:14:45 -- nvmf/common.sh@123 -- # set -e 00:19:45.580 15:14:45 -- nvmf/common.sh@124 -- # return 0 00:19:45.580 15:14:45 -- nvmf/common.sh@477 -- # '[' -n 724855 ']' 00:19:45.580 15:14:45 -- nvmf/common.sh@478 -- # killprocess 724855 00:19:45.580 15:14:45 -- common/autotest_common.sh@936 -- # '[' -z 724855 ']' 00:19:45.580 15:14:45 -- common/autotest_common.sh@940 -- # kill -0 724855 00:19:45.580 15:14:45 -- common/autotest_common.sh@941 -- # uname 00:19:45.580 15:14:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:45.580 15:14:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 724855 00:19:45.580 15:14:45 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:45.580 15:14:45 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:45.580 15:14:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 724855' 00:19:45.580 killing process with pid 724855 00:19:45.580 15:14:45 -- common/autotest_common.sh@955 -- # kill 724855 00:19:45.580 15:14:45 -- common/autotest_common.sh@960 -- # wait 724855 00:19:45.839 15:14:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:45.839 15:14:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:45.839 15:14:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:45.839 15:14:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:45.839 15:14:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:45.839 15:14:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:45.839 15:14:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:45.839 15:14:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:47.774 15:14:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:47.774 00:19:47.774 real 0m24.345s 00:19:47.774 user 1m25.739s 00:19:47.774 sys 0m6.515s 00:19:47.774 15:14:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:47.774 15:14:47 -- common/autotest_common.sh@10 -- # set +x 00:19:47.774 ************************************ 00:19:47.774 END TEST nvmf_fio_target 00:19:47.774 ************************************ 00:19:47.774 15:14:47 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:47.774 15:14:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:47.774 15:14:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:47.774 15:14:47 -- common/autotest_common.sh@10 -- # set +x 00:19:47.774 ************************************ 00:19:47.774 START TEST nvmf_bdevio 00:19:47.774 ************************************ 00:19:47.774 15:14:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:47.774 * Looking for test storage... 00:19:47.774 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:47.774 15:14:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:47.774 15:14:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:47.774 15:14:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:48.034 15:14:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:48.034 15:14:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:48.034 15:14:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:48.034 15:14:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:48.034 15:14:48 -- scripts/common.sh@335 -- # IFS=.-: 00:19:48.034 15:14:48 -- scripts/common.sh@335 -- # read -ra ver1 00:19:48.034 15:14:48 -- scripts/common.sh@336 -- # IFS=.-: 00:19:48.034 15:14:48 -- scripts/common.sh@336 -- # read -ra ver2 00:19:48.034 15:14:48 -- scripts/common.sh@337 -- # local 'op=<' 00:19:48.034 15:14:48 -- scripts/common.sh@339 -- # ver1_l=2 00:19:48.034 15:14:48 -- scripts/common.sh@340 -- # ver2_l=1 00:19:48.034 15:14:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:48.034 15:14:48 -- scripts/common.sh@343 -- # case "$op" in 00:19:48.034 15:14:48 -- scripts/common.sh@344 -- # : 1 00:19:48.034 15:14:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:48.034 15:14:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:48.034 15:14:48 -- scripts/common.sh@364 -- # decimal 1 00:19:48.034 15:14:48 -- scripts/common.sh@352 -- # local d=1 00:19:48.034 15:14:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:48.034 15:14:48 -- scripts/common.sh@354 -- # echo 1 00:19:48.034 15:14:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:48.034 15:14:48 -- scripts/common.sh@365 -- # decimal 2 00:19:48.034 15:14:48 -- scripts/common.sh@352 -- # local d=2 00:19:48.034 15:14:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:48.034 15:14:48 -- scripts/common.sh@354 -- # echo 2 00:19:48.034 15:14:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:48.034 15:14:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:48.034 15:14:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:48.034 15:14:48 -- scripts/common.sh@367 -- # return 0 00:19:48.034 15:14:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:48.034 15:14:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.034 --rc genhtml_branch_coverage=1 00:19:48.034 --rc genhtml_function_coverage=1 00:19:48.034 --rc genhtml_legend=1 00:19:48.034 --rc geninfo_all_blocks=1 00:19:48.034 --rc geninfo_unexecuted_blocks=1 00:19:48.034 00:19:48.034 ' 00:19:48.034 15:14:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.034 --rc genhtml_branch_coverage=1 00:19:48.034 --rc genhtml_function_coverage=1 00:19:48.034 --rc genhtml_legend=1 00:19:48.034 --rc geninfo_all_blocks=1 00:19:48.034 --rc geninfo_unexecuted_blocks=1 00:19:48.034 00:19:48.034 ' 00:19:48.034 15:14:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.034 --rc genhtml_branch_coverage=1 00:19:48.034 --rc genhtml_function_coverage=1 00:19:48.034 --rc genhtml_legend=1 00:19:48.034 --rc geninfo_all_blocks=1 00:19:48.034 --rc geninfo_unexecuted_blocks=1 00:19:48.034 00:19:48.034 ' 00:19:48.034 15:14:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:48.034 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:48.034 --rc genhtml_branch_coverage=1 00:19:48.034 --rc genhtml_function_coverage=1 00:19:48.034 --rc genhtml_legend=1 00:19:48.034 --rc geninfo_all_blocks=1 00:19:48.034 --rc geninfo_unexecuted_blocks=1 00:19:48.034 00:19:48.034 ' 00:19:48.034 15:14:48 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:48.034 15:14:48 -- nvmf/common.sh@7 -- # uname -s 00:19:48.034 15:14:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:48.034 15:14:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:48.034 15:14:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:48.034 15:14:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:48.034 15:14:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:48.034 15:14:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:48.034 15:14:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:48.034 15:14:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:48.034 15:14:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:48.034 15:14:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:48.034 15:14:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:48.034 15:14:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:48.034 15:14:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:48.034 15:14:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:48.034 15:14:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:48.034 15:14:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:48.034 15:14:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:48.034 15:14:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:48.034 15:14:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:48.034 15:14:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.034 15:14:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.034 15:14:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.034 15:14:48 -- paths/export.sh@5 -- # export PATH 00:19:48.034 15:14:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:48.034 15:14:48 -- nvmf/common.sh@46 -- # : 0 00:19:48.034 15:14:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:48.034 15:14:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:48.034 15:14:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:48.034 15:14:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:48.034 15:14:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:48.034 15:14:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:48.034 15:14:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:48.034 15:14:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:48.034 15:14:48 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:48.034 15:14:48 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:48.034 15:14:48 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:48.034 15:14:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:48.034 15:14:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:48.034 15:14:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:48.034 15:14:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:48.034 15:14:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:48.034 15:14:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:48.034 15:14:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:48.034 15:14:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:48.034 15:14:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:48.034 15:14:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:48.035 15:14:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:48.035 15:14:48 -- common/autotest_common.sh@10 -- # set +x 00:19:50.568 15:14:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:50.568 15:14:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:50.568 15:14:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:50.568 15:14:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:50.568 15:14:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:50.568 15:14:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:50.568 15:14:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:50.568 15:14:50 -- nvmf/common.sh@294 -- # net_devs=() 00:19:50.568 15:14:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:50.568 15:14:50 -- nvmf/common.sh@295 -- # e810=() 00:19:50.569 15:14:50 -- nvmf/common.sh@295 -- # local -ga e810 00:19:50.569 15:14:50 -- nvmf/common.sh@296 -- # x722=() 00:19:50.569 15:14:50 -- nvmf/common.sh@296 -- # local -ga x722 00:19:50.569 15:14:50 -- nvmf/common.sh@297 -- # mlx=() 00:19:50.569 15:14:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:50.569 15:14:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:50.569 15:14:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:50.569 15:14:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:50.569 15:14:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:50.569 15:14:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:50.569 15:14:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:50.569 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:50.569 15:14:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:50.569 15:14:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:50.569 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:50.569 15:14:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:50.569 15:14:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:50.569 15:14:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:50.569 15:14:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:50.569 15:14:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:50.569 15:14:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:50.569 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:50.569 15:14:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:50.569 15:14:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:50.569 15:14:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:50.569 15:14:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:50.569 15:14:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:50.569 15:14:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:50.569 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:50.569 15:14:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:50.569 15:14:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:50.569 15:14:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:50.569 15:14:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:50.569 15:14:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:50.569 15:14:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:50.569 15:14:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:50.569 15:14:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:50.569 15:14:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:50.569 15:14:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:50.569 15:14:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:50.569 15:14:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:50.569 15:14:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:50.569 15:14:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:50.569 15:14:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:50.569 15:14:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:50.569 15:14:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:50.569 15:14:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:50.569 15:14:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:50.569 15:14:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:50.569 15:14:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:50.569 15:14:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:50.569 15:14:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:50.569 15:14:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:50.569 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:50.569 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.414 ms 00:19:50.569 00:19:50.569 --- 10.0.0.2 ping statistics --- 00:19:50.569 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:50.569 rtt min/avg/max/mdev = 0.414/0.414/0.414/0.000 ms 00:19:50.569 15:14:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:50.569 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:50.569 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:19:50.569 00:19:50.569 --- 10.0.0.1 ping statistics --- 00:19:50.569 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:50.569 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:19:50.569 15:14:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:50.569 15:14:50 -- nvmf/common.sh@410 -- # return 0 00:19:50.569 15:14:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:50.569 15:14:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:50.569 15:14:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:50.569 15:14:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:50.569 15:14:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:50.570 15:14:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:50.570 15:14:50 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:50.570 15:14:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:50.570 15:14:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:50.570 15:14:50 -- common/autotest_common.sh@10 -- # set +x 00:19:50.570 15:14:50 -- nvmf/common.sh@469 -- # nvmfpid=729694 00:19:50.570 15:14:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:50.570 15:14:50 -- nvmf/common.sh@470 -- # waitforlisten 729694 00:19:50.570 15:14:50 -- common/autotest_common.sh@829 -- # '[' -z 729694 ']' 00:19:50.570 15:14:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:50.570 15:14:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:50.570 15:14:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:50.570 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:50.570 15:14:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:50.570 15:14:50 -- common/autotest_common.sh@10 -- # set +x 00:19:50.570 [2024-11-28 15:14:50.432650] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:50.570 [2024-11-28 15:14:50.432719] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:50.570 EAL: No free 2048 kB hugepages reported on node 1 00:19:50.570 [2024-11-28 15:14:50.499640] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:50.570 [2024-11-28 15:14:50.596995] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:50.570 [2024-11-28 15:14:50.597154] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:50.570 [2024-11-28 15:14:50.597177] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:50.570 [2024-11-28 15:14:50.597192] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:50.570 [2024-11-28 15:14:50.597248] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:50.570 [2024-11-28 15:14:50.597307] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:50.570 [2024-11-28 15:14:50.597380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:50.570 [2024-11-28 15:14:50.597383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:51.503 15:14:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:51.503 15:14:51 -- common/autotest_common.sh@862 -- # return 0 00:19:51.503 15:14:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:51.503 15:14:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:51.503 15:14:51 -- common/autotest_common.sh@10 -- # set +x 00:19:51.503 15:14:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:51.503 15:14:51 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:51.503 15:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.503 15:14:51 -- common/autotest_common.sh@10 -- # set +x 00:19:51.503 [2024-11-28 15:14:51.431717] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:51.503 15:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.503 15:14:51 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:51.503 15:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.503 15:14:51 -- common/autotest_common.sh@10 -- # set +x 00:19:51.503 Malloc0 00:19:51.503 15:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.503 15:14:51 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:51.503 15:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.503 15:14:51 -- common/autotest_common.sh@10 -- # set +x 00:19:51.503 15:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.503 15:14:51 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:51.503 15:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.503 15:14:51 -- common/autotest_common.sh@10 -- # set +x 00:19:51.503 15:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.504 15:14:51 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:51.504 15:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:51.504 15:14:51 -- common/autotest_common.sh@10 -- # set +x 00:19:51.504 [2024-11-28 15:14:51.483485] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:51.504 15:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:51.504 15:14:51 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:51.504 15:14:51 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:51.504 15:14:51 -- nvmf/common.sh@520 -- # config=() 00:19:51.504 15:14:51 -- nvmf/common.sh@520 -- # local subsystem config 00:19:51.504 15:14:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:51.504 15:14:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:51.504 { 00:19:51.504 "params": { 00:19:51.504 "name": "Nvme$subsystem", 00:19:51.504 "trtype": "$TEST_TRANSPORT", 00:19:51.504 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:51.504 "adrfam": "ipv4", 00:19:51.504 "trsvcid": "$NVMF_PORT", 00:19:51.504 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:51.504 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:51.504 "hdgst": ${hdgst:-false}, 00:19:51.504 "ddgst": ${ddgst:-false} 00:19:51.504 }, 00:19:51.504 "method": "bdev_nvme_attach_controller" 00:19:51.504 } 00:19:51.504 EOF 00:19:51.504 )") 00:19:51.504 15:14:51 -- nvmf/common.sh@542 -- # cat 00:19:51.504 15:14:51 -- nvmf/common.sh@544 -- # jq . 00:19:51.504 15:14:51 -- nvmf/common.sh@545 -- # IFS=, 00:19:51.504 15:14:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:51.504 "params": { 00:19:51.504 "name": "Nvme1", 00:19:51.504 "trtype": "tcp", 00:19:51.504 "traddr": "10.0.0.2", 00:19:51.504 "adrfam": "ipv4", 00:19:51.504 "trsvcid": "4420", 00:19:51.504 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:51.504 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:51.504 "hdgst": false, 00:19:51.504 "ddgst": false 00:19:51.504 }, 00:19:51.504 "method": "bdev_nvme_attach_controller" 00:19:51.504 }' 00:19:51.504 [2024-11-28 15:14:51.527561] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:51.504 [2024-11-28 15:14:51.527629] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid729852 ] 00:19:51.504 EAL: No free 2048 kB hugepages reported on node 1 00:19:51.504 [2024-11-28 15:14:51.589286] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:51.504 [2024-11-28 15:14:51.679360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:51.504 [2024-11-28 15:14:51.679421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:51.504 [2024-11-28 15:14:51.679424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:51.762 [2024-11-28 15:14:51.854625] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:51.762 [2024-11-28 15:14:51.854675] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:51.762 I/O targets: 00:19:51.762 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:51.762 00:19:51.762 00:19:51.762 CUnit - A unit testing framework for C - Version 2.1-3 00:19:51.762 http://cunit.sourceforge.net/ 00:19:51.762 00:19:51.762 00:19:51.762 Suite: bdevio tests on: Nvme1n1 00:19:51.762 Test: blockdev write read block ...passed 00:19:51.762 Test: blockdev write zeroes read block ...passed 00:19:51.762 Test: blockdev write zeroes read no split ...passed 00:19:52.020 Test: blockdev write zeroes read split ...passed 00:19:52.020 Test: blockdev write zeroes read split partial ...passed 00:19:52.020 Test: blockdev reset ...[2024-11-28 15:14:52.053889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:52.020 [2024-11-28 15:14:52.054000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f6e40 (9): Bad file descriptor 00:19:52.020 [2024-11-28 15:14:52.105309] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:52.020 passed 00:19:52.020 Test: blockdev write read 8 blocks ...passed 00:19:52.020 Test: blockdev write read size > 128k ...passed 00:19:52.020 Test: blockdev write read invalid size ...passed 00:19:52.020 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:52.020 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:52.020 Test: blockdev write read max offset ...passed 00:19:52.278 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:52.278 Test: blockdev writev readv 8 blocks ...passed 00:19:52.278 Test: blockdev writev readv 30 x 1block ...passed 00:19:52.278 Test: blockdev writev readv block ...passed 00:19:52.278 Test: blockdev writev readv size > 128k ...passed 00:19:52.278 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:52.278 Test: blockdev comparev and writev ...[2024-11-28 15:14:52.357012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.357049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.357074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.357104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.357456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.357481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.357504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.357520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.357844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.357876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.357898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.357915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.358258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.358284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.358307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:52.278 [2024-11-28 15:14:52.358324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:52.278 passed 00:19:52.278 Test: blockdev nvme passthru rw ...passed 00:19:52.278 Test: blockdev nvme passthru vendor specific ...[2024-11-28 15:14:52.441335] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:52.278 [2024-11-28 15:14:52.441362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.441502] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:52.278 [2024-11-28 15:14:52.441525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.441656] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:52.278 [2024-11-28 15:14:52.441678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:52.278 [2024-11-28 15:14:52.441814] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:52.278 [2024-11-28 15:14:52.441837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:52.278 passed 00:19:52.278 Test: blockdev nvme admin passthru ...passed 00:19:52.278 Test: blockdev copy ...passed 00:19:52.278 00:19:52.278 Run Summary: Type Total Ran Passed Failed Inactive 00:19:52.278 suites 1 1 n/a 0 0 00:19:52.278 tests 23 23 23 0 0 00:19:52.278 asserts 152 152 152 0 n/a 00:19:52.278 00:19:52.278 Elapsed time = 1.281 seconds 00:19:52.536 15:14:52 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:52.536 15:14:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:52.536 15:14:52 -- common/autotest_common.sh@10 -- # set +x 00:19:52.536 15:14:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:52.537 15:14:52 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:52.537 15:14:52 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:52.537 15:14:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:52.537 15:14:52 -- nvmf/common.sh@116 -- # sync 00:19:52.537 15:14:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:52.537 15:14:52 -- nvmf/common.sh@119 -- # set +e 00:19:52.537 15:14:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:52.537 15:14:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:52.537 rmmod nvme_tcp 00:19:52.537 rmmod nvme_fabrics 00:19:52.537 rmmod nvme_keyring 00:19:52.537 15:14:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:52.537 15:14:52 -- nvmf/common.sh@123 -- # set -e 00:19:52.537 15:14:52 -- nvmf/common.sh@124 -- # return 0 00:19:52.537 15:14:52 -- nvmf/common.sh@477 -- # '[' -n 729694 ']' 00:19:52.537 15:14:52 -- nvmf/common.sh@478 -- # killprocess 729694 00:19:52.537 15:14:52 -- common/autotest_common.sh@936 -- # '[' -z 729694 ']' 00:19:52.537 15:14:52 -- common/autotest_common.sh@940 -- # kill -0 729694 00:19:52.537 15:14:52 -- common/autotest_common.sh@941 -- # uname 00:19:52.537 15:14:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:52.537 15:14:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 729694 00:19:52.795 15:14:52 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:52.795 15:14:52 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:52.795 15:14:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 729694' 00:19:52.795 killing process with pid 729694 00:19:52.795 15:14:52 -- common/autotest_common.sh@955 -- # kill 729694 00:19:52.795 15:14:52 -- common/autotest_common.sh@960 -- # wait 729694 00:19:52.795 15:14:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:52.796 15:14:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:52.796 15:14:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:52.796 15:14:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:52.796 15:14:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:52.796 15:14:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:52.796 15:14:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:52.796 15:14:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:55.334 15:14:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:55.334 00:19:55.334 real 0m7.135s 00:19:55.334 user 0m12.781s 00:19:55.334 sys 0m2.222s 00:19:55.334 15:14:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:55.334 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:19:55.334 ************************************ 00:19:55.334 END TEST nvmf_bdevio 00:19:55.334 ************************************ 00:19:55.334 15:14:55 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:55.334 15:14:55 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:55.334 15:14:55 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:55.334 15:14:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:55.334 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:19:55.334 ************************************ 00:19:55.334 START TEST nvmf_bdevio_no_huge 00:19:55.334 ************************************ 00:19:55.334 15:14:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:55.334 * Looking for test storage... 00:19:55.334 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:55.334 15:14:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:55.334 15:14:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:55.334 15:14:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:55.334 15:14:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:55.334 15:14:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:55.334 15:14:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:55.334 15:14:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:55.334 15:14:55 -- scripts/common.sh@335 -- # IFS=.-: 00:19:55.334 15:14:55 -- scripts/common.sh@335 -- # read -ra ver1 00:19:55.334 15:14:55 -- scripts/common.sh@336 -- # IFS=.-: 00:19:55.334 15:14:55 -- scripts/common.sh@336 -- # read -ra ver2 00:19:55.334 15:14:55 -- scripts/common.sh@337 -- # local 'op=<' 00:19:55.334 15:14:55 -- scripts/common.sh@339 -- # ver1_l=2 00:19:55.334 15:14:55 -- scripts/common.sh@340 -- # ver2_l=1 00:19:55.334 15:14:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:55.334 15:14:55 -- scripts/common.sh@343 -- # case "$op" in 00:19:55.334 15:14:55 -- scripts/common.sh@344 -- # : 1 00:19:55.334 15:14:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:55.334 15:14:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:55.334 15:14:55 -- scripts/common.sh@364 -- # decimal 1 00:19:55.334 15:14:55 -- scripts/common.sh@352 -- # local d=1 00:19:55.334 15:14:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:55.334 15:14:55 -- scripts/common.sh@354 -- # echo 1 00:19:55.334 15:14:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:55.334 15:14:55 -- scripts/common.sh@365 -- # decimal 2 00:19:55.334 15:14:55 -- scripts/common.sh@352 -- # local d=2 00:19:55.334 15:14:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:55.334 15:14:55 -- scripts/common.sh@354 -- # echo 2 00:19:55.334 15:14:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:55.334 15:14:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:55.334 15:14:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:55.334 15:14:55 -- scripts/common.sh@367 -- # return 0 00:19:55.334 15:14:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:55.334 15:14:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:55.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:55.334 --rc genhtml_branch_coverage=1 00:19:55.334 --rc genhtml_function_coverage=1 00:19:55.334 --rc genhtml_legend=1 00:19:55.334 --rc geninfo_all_blocks=1 00:19:55.334 --rc geninfo_unexecuted_blocks=1 00:19:55.334 00:19:55.334 ' 00:19:55.334 15:14:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:55.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:55.334 --rc genhtml_branch_coverage=1 00:19:55.334 --rc genhtml_function_coverage=1 00:19:55.334 --rc genhtml_legend=1 00:19:55.334 --rc geninfo_all_blocks=1 00:19:55.334 --rc geninfo_unexecuted_blocks=1 00:19:55.334 00:19:55.334 ' 00:19:55.334 15:14:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:55.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:55.334 --rc genhtml_branch_coverage=1 00:19:55.334 --rc genhtml_function_coverage=1 00:19:55.334 --rc genhtml_legend=1 00:19:55.334 --rc geninfo_all_blocks=1 00:19:55.334 --rc geninfo_unexecuted_blocks=1 00:19:55.334 00:19:55.334 ' 00:19:55.334 15:14:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:55.334 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:55.334 --rc genhtml_branch_coverage=1 00:19:55.334 --rc genhtml_function_coverage=1 00:19:55.334 --rc genhtml_legend=1 00:19:55.334 --rc geninfo_all_blocks=1 00:19:55.334 --rc geninfo_unexecuted_blocks=1 00:19:55.334 00:19:55.334 ' 00:19:55.334 15:14:55 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:55.334 15:14:55 -- nvmf/common.sh@7 -- # uname -s 00:19:55.334 15:14:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:55.334 15:14:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:55.334 15:14:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:55.334 15:14:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:55.334 15:14:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:55.334 15:14:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:55.334 15:14:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:55.334 15:14:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:55.334 15:14:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:55.334 15:14:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:55.334 15:14:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:55.334 15:14:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:55.334 15:14:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:55.334 15:14:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:55.334 15:14:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:55.334 15:14:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:55.334 15:14:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:55.334 15:14:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:55.334 15:14:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:55.334 15:14:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.335 15:14:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.335 15:14:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.335 15:14:55 -- paths/export.sh@5 -- # export PATH 00:19:55.335 15:14:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:55.335 15:14:55 -- nvmf/common.sh@46 -- # : 0 00:19:55.335 15:14:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:55.335 15:14:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:55.335 15:14:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:55.335 15:14:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:55.335 15:14:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:55.335 15:14:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:55.335 15:14:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:55.335 15:14:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:55.335 15:14:55 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:55.335 15:14:55 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:55.335 15:14:55 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:55.335 15:14:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:55.335 15:14:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:55.335 15:14:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:55.335 15:14:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:55.335 15:14:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:55.335 15:14:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:55.335 15:14:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:55.335 15:14:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:55.335 15:14:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:55.335 15:14:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:55.335 15:14:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:55.335 15:14:55 -- common/autotest_common.sh@10 -- # set +x 00:19:57.238 15:14:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:57.238 15:14:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:57.238 15:14:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:57.238 15:14:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:57.238 15:14:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:57.238 15:14:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:57.238 15:14:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:57.238 15:14:57 -- nvmf/common.sh@294 -- # net_devs=() 00:19:57.238 15:14:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:57.238 15:14:57 -- nvmf/common.sh@295 -- # e810=() 00:19:57.238 15:14:57 -- nvmf/common.sh@295 -- # local -ga e810 00:19:57.238 15:14:57 -- nvmf/common.sh@296 -- # x722=() 00:19:57.238 15:14:57 -- nvmf/common.sh@296 -- # local -ga x722 00:19:57.238 15:14:57 -- nvmf/common.sh@297 -- # mlx=() 00:19:57.238 15:14:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:57.238 15:14:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:57.238 15:14:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:57.238 15:14:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:57.238 15:14:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:57.238 15:14:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:57.238 15:14:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:57.238 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:57.238 15:14:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:57.238 15:14:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:57.238 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:57.238 15:14:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:57.238 15:14:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:57.239 15:14:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:57.239 15:14:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:57.239 15:14:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:57.239 15:14:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:57.239 15:14:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:57.239 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:57.239 15:14:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:57.239 15:14:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:57.239 15:14:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:57.239 15:14:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:57.239 15:14:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:57.239 15:14:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:57.239 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:57.239 15:14:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:57.239 15:14:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:57.239 15:14:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:57.239 15:14:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:57.239 15:14:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:57.239 15:14:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:57.239 15:14:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:57.239 15:14:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:57.239 15:14:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:57.239 15:14:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:57.239 15:14:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:57.239 15:14:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:57.239 15:14:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:57.239 15:14:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:57.239 15:14:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:57.239 15:14:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:57.239 15:14:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:57.239 15:14:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:57.239 15:14:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:57.239 15:14:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:57.239 15:14:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:57.239 15:14:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:57.239 15:14:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:57.239 15:14:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:57.239 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:57.239 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:19:57.239 00:19:57.239 --- 10.0.0.2 ping statistics --- 00:19:57.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:57.239 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:19:57.239 15:14:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:57.239 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:57.239 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:19:57.239 00:19:57.239 --- 10.0.0.1 ping statistics --- 00:19:57.239 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:57.239 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:19:57.239 15:14:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:57.239 15:14:57 -- nvmf/common.sh@410 -- # return 0 00:19:57.239 15:14:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:57.239 15:14:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:57.239 15:14:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:57.239 15:14:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:57.239 15:14:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:57.239 15:14:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:57.239 15:14:57 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:57.239 15:14:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:57.239 15:14:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:57.239 15:14:57 -- common/autotest_common.sh@10 -- # set +x 00:19:57.239 15:14:57 -- nvmf/common.sh@469 -- # nvmfpid=731958 00:19:57.239 15:14:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:57.239 15:14:57 -- nvmf/common.sh@470 -- # waitforlisten 731958 00:19:57.239 15:14:57 -- common/autotest_common.sh@829 -- # '[' -z 731958 ']' 00:19:57.239 15:14:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:57.239 15:14:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:57.239 15:14:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:57.239 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:57.239 15:14:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:57.239 15:14:57 -- common/autotest_common.sh@10 -- # set +x 00:19:57.239 [2024-11-28 15:14:57.460181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:57.239 [2024-11-28 15:14:57.460276] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:57.498 [2024-11-28 15:14:57.530063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:57.498 [2024-11-28 15:14:57.607835] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:57.498 [2024-11-28 15:14:57.607996] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:57.498 [2024-11-28 15:14:57.608016] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:57.498 [2024-11-28 15:14:57.608029] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:57.498 [2024-11-28 15:14:57.608129] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:57.498 [2024-11-28 15:14:57.608311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:57.498 [2024-11-28 15:14:57.608378] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:57.498 [2024-11-28 15:14:57.608380] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:58.434 15:14:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:58.434 15:14:58 -- common/autotest_common.sh@862 -- # return 0 00:19:58.434 15:14:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:58.434 15:14:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:58.434 15:14:58 -- common/autotest_common.sh@10 -- # set +x 00:19:58.434 15:14:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:58.434 15:14:58 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:58.434 15:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.434 15:14:58 -- common/autotest_common.sh@10 -- # set +x 00:19:58.434 [2024-11-28 15:14:58.489765] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:58.434 15:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.434 15:14:58 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:58.434 15:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.434 15:14:58 -- common/autotest_common.sh@10 -- # set +x 00:19:58.434 Malloc0 00:19:58.434 15:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.434 15:14:58 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:58.434 15:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.434 15:14:58 -- common/autotest_common.sh@10 -- # set +x 00:19:58.434 15:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.434 15:14:58 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:58.434 15:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.434 15:14:58 -- common/autotest_common.sh@10 -- # set +x 00:19:58.434 15:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.434 15:14:58 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:58.434 15:14:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:58.434 15:14:58 -- common/autotest_common.sh@10 -- # set +x 00:19:58.434 [2024-11-28 15:14:58.527913] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:58.434 15:14:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:58.434 15:14:58 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:58.434 15:14:58 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:58.434 15:14:58 -- nvmf/common.sh@520 -- # config=() 00:19:58.434 15:14:58 -- nvmf/common.sh@520 -- # local subsystem config 00:19:58.434 15:14:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:58.434 15:14:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:58.434 { 00:19:58.434 "params": { 00:19:58.434 "name": "Nvme$subsystem", 00:19:58.434 "trtype": "$TEST_TRANSPORT", 00:19:58.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:58.434 "adrfam": "ipv4", 00:19:58.434 "trsvcid": "$NVMF_PORT", 00:19:58.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:58.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:58.434 "hdgst": ${hdgst:-false}, 00:19:58.434 "ddgst": ${ddgst:-false} 00:19:58.434 }, 00:19:58.434 "method": "bdev_nvme_attach_controller" 00:19:58.434 } 00:19:58.434 EOF 00:19:58.434 )") 00:19:58.434 15:14:58 -- nvmf/common.sh@542 -- # cat 00:19:58.434 15:14:58 -- nvmf/common.sh@544 -- # jq . 00:19:58.434 15:14:58 -- nvmf/common.sh@545 -- # IFS=, 00:19:58.434 15:14:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:58.434 "params": { 00:19:58.434 "name": "Nvme1", 00:19:58.434 "trtype": "tcp", 00:19:58.434 "traddr": "10.0.0.2", 00:19:58.434 "adrfam": "ipv4", 00:19:58.434 "trsvcid": "4420", 00:19:58.434 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:58.434 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:58.434 "hdgst": false, 00:19:58.434 "ddgst": false 00:19:58.434 }, 00:19:58.434 "method": "bdev_nvme_attach_controller" 00:19:58.434 }' 00:19:58.434 [2024-11-28 15:14:58.571828] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:19:58.434 [2024-11-28 15:14:58.571924] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid732115 ] 00:19:58.434 [2024-11-28 15:14:58.638209] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:58.692 [2024-11-28 15:14:58.726421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:58.692 [2024-11-28 15:14:58.726471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:58.692 [2024-11-28 15:14:58.726475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:58.950 [2024-11-28 15:14:59.002392] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:58.950 [2024-11-28 15:14:59.002438] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:58.950 I/O targets: 00:19:58.950 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:58.950 00:19:58.950 00:19:58.950 CUnit - A unit testing framework for C - Version 2.1-3 00:19:58.950 http://cunit.sourceforge.net/ 00:19:58.950 00:19:58.950 00:19:58.950 Suite: bdevio tests on: Nvme1n1 00:19:58.950 Test: blockdev write read block ...passed 00:19:58.950 Test: blockdev write zeroes read block ...passed 00:19:58.950 Test: blockdev write zeroes read no split ...passed 00:19:58.950 Test: blockdev write zeroes read split ...passed 00:19:58.950 Test: blockdev write zeroes read split partial ...passed 00:19:58.950 Test: blockdev reset ...[2024-11-28 15:14:59.165454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:58.950 [2024-11-28 15:14:59.165557] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c527c0 (9): Bad file descriptor 00:19:58.950 [2024-11-28 15:14:59.182199] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:58.950 passed 00:19:58.950 Test: blockdev write read 8 blocks ...passed 00:19:59.208 Test: blockdev write read size > 128k ...passed 00:19:59.208 Test: blockdev write read invalid size ...passed 00:19:59.208 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:59.208 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:59.208 Test: blockdev write read max offset ...passed 00:19:59.208 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:59.208 Test: blockdev writev readv 8 blocks ...passed 00:19:59.208 Test: blockdev writev readv 30 x 1block ...passed 00:19:59.208 Test: blockdev writev readv block ...passed 00:19:59.208 Test: blockdev writev readv size > 128k ...passed 00:19:59.208 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:59.208 Test: blockdev comparev and writev ...[2024-11-28 15:14:59.436273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.436314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.436340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.436357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.436668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.436693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.436716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.436732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.437028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.437052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.437073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.437089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.437379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.437403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:59.208 [2024-11-28 15:14:59.437424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:59.208 [2024-11-28 15:14:59.437440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:59.466 passed 00:19:59.466 Test: blockdev nvme passthru rw ...passed 00:19:59.466 Test: blockdev nvme passthru vendor specific ...[2024-11-28 15:14:59.520316] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:59.466 [2024-11-28 15:14:59.520343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:59.466 [2024-11-28 15:14:59.520484] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:59.466 [2024-11-28 15:14:59.520507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:59.466 [2024-11-28 15:14:59.520646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:59.466 [2024-11-28 15:14:59.520670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:59.466 [2024-11-28 15:14:59.520806] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:59.466 [2024-11-28 15:14:59.520829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:59.466 passed 00:19:59.466 Test: blockdev nvme admin passthru ...passed 00:19:59.466 Test: blockdev copy ...passed 00:19:59.466 00:19:59.466 Run Summary: Type Total Ran Passed Failed Inactive 00:19:59.466 suites 1 1 n/a 0 0 00:19:59.466 tests 23 23 23 0 0 00:19:59.466 asserts 152 152 152 0 n/a 00:19:59.466 00:19:59.466 Elapsed time = 1.149 seconds 00:19:59.724 15:14:59 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:59.724 15:14:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:59.724 15:14:59 -- common/autotest_common.sh@10 -- # set +x 00:19:59.724 15:14:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:59.724 15:14:59 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:59.724 15:14:59 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:59.724 15:14:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:59.724 15:14:59 -- nvmf/common.sh@116 -- # sync 00:19:59.724 15:14:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:59.724 15:14:59 -- nvmf/common.sh@119 -- # set +e 00:19:59.724 15:14:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:59.724 15:14:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:59.724 rmmod nvme_tcp 00:19:59.724 rmmod nvme_fabrics 00:19:59.724 rmmod nvme_keyring 00:19:59.982 15:14:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:59.982 15:14:59 -- nvmf/common.sh@123 -- # set -e 00:19:59.982 15:14:59 -- nvmf/common.sh@124 -- # return 0 00:19:59.982 15:14:59 -- nvmf/common.sh@477 -- # '[' -n 731958 ']' 00:19:59.982 15:14:59 -- nvmf/common.sh@478 -- # killprocess 731958 00:19:59.982 15:14:59 -- common/autotest_common.sh@936 -- # '[' -z 731958 ']' 00:19:59.982 15:14:59 -- common/autotest_common.sh@940 -- # kill -0 731958 00:19:59.982 15:14:59 -- common/autotest_common.sh@941 -- # uname 00:19:59.982 15:14:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:59.982 15:14:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 731958 00:19:59.982 15:15:00 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:59.982 15:15:00 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:59.982 15:15:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 731958' 00:19:59.982 killing process with pid 731958 00:19:59.982 15:15:00 -- common/autotest_common.sh@955 -- # kill 731958 00:19:59.982 15:15:00 -- common/autotest_common.sh@960 -- # wait 731958 00:20:00.241 15:15:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:00.241 15:15:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:00.241 15:15:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:00.241 15:15:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:00.241 15:15:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:00.241 15:15:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:00.241 15:15:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:00.241 15:15:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:02.772 15:15:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:02.772 00:20:02.772 real 0m7.375s 00:20:02.772 user 0m14.249s 00:20:02.772 sys 0m2.553s 00:20:02.772 15:15:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:02.772 15:15:02 -- common/autotest_common.sh@10 -- # set +x 00:20:02.772 ************************************ 00:20:02.772 END TEST nvmf_bdevio_no_huge 00:20:02.772 ************************************ 00:20:02.772 15:15:02 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:02.772 15:15:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:02.773 15:15:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:02.773 15:15:02 -- common/autotest_common.sh@10 -- # set +x 00:20:02.773 ************************************ 00:20:02.773 START TEST nvmf_tls 00:20:02.773 ************************************ 00:20:02.773 15:15:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:02.773 * Looking for test storage... 00:20:02.773 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:02.773 15:15:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:02.773 15:15:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:02.773 15:15:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:02.773 15:15:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:02.773 15:15:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:02.773 15:15:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:02.773 15:15:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:02.773 15:15:02 -- scripts/common.sh@335 -- # IFS=.-: 00:20:02.773 15:15:02 -- scripts/common.sh@335 -- # read -ra ver1 00:20:02.773 15:15:02 -- scripts/common.sh@336 -- # IFS=.-: 00:20:02.773 15:15:02 -- scripts/common.sh@336 -- # read -ra ver2 00:20:02.773 15:15:02 -- scripts/common.sh@337 -- # local 'op=<' 00:20:02.773 15:15:02 -- scripts/common.sh@339 -- # ver1_l=2 00:20:02.773 15:15:02 -- scripts/common.sh@340 -- # ver2_l=1 00:20:02.773 15:15:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:02.773 15:15:02 -- scripts/common.sh@343 -- # case "$op" in 00:20:02.773 15:15:02 -- scripts/common.sh@344 -- # : 1 00:20:02.773 15:15:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:02.773 15:15:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:02.773 15:15:02 -- scripts/common.sh@364 -- # decimal 1 00:20:02.773 15:15:02 -- scripts/common.sh@352 -- # local d=1 00:20:02.773 15:15:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:02.773 15:15:02 -- scripts/common.sh@354 -- # echo 1 00:20:02.773 15:15:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:02.773 15:15:02 -- scripts/common.sh@365 -- # decimal 2 00:20:02.773 15:15:02 -- scripts/common.sh@352 -- # local d=2 00:20:02.773 15:15:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:02.773 15:15:02 -- scripts/common.sh@354 -- # echo 2 00:20:02.773 15:15:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:02.773 15:15:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:02.773 15:15:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:02.773 15:15:02 -- scripts/common.sh@367 -- # return 0 00:20:02.773 15:15:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:02.773 15:15:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:02.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:02.773 --rc genhtml_branch_coverage=1 00:20:02.773 --rc genhtml_function_coverage=1 00:20:02.773 --rc genhtml_legend=1 00:20:02.773 --rc geninfo_all_blocks=1 00:20:02.773 --rc geninfo_unexecuted_blocks=1 00:20:02.773 00:20:02.773 ' 00:20:02.773 15:15:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:02.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:02.773 --rc genhtml_branch_coverage=1 00:20:02.773 --rc genhtml_function_coverage=1 00:20:02.773 --rc genhtml_legend=1 00:20:02.773 --rc geninfo_all_blocks=1 00:20:02.773 --rc geninfo_unexecuted_blocks=1 00:20:02.773 00:20:02.773 ' 00:20:02.773 15:15:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:02.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:02.773 --rc genhtml_branch_coverage=1 00:20:02.773 --rc genhtml_function_coverage=1 00:20:02.773 --rc genhtml_legend=1 00:20:02.773 --rc geninfo_all_blocks=1 00:20:02.773 --rc geninfo_unexecuted_blocks=1 00:20:02.773 00:20:02.773 ' 00:20:02.773 15:15:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:02.773 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:02.773 --rc genhtml_branch_coverage=1 00:20:02.773 --rc genhtml_function_coverage=1 00:20:02.773 --rc genhtml_legend=1 00:20:02.773 --rc geninfo_all_blocks=1 00:20:02.773 --rc geninfo_unexecuted_blocks=1 00:20:02.773 00:20:02.773 ' 00:20:02.773 15:15:02 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:02.773 15:15:02 -- nvmf/common.sh@7 -- # uname -s 00:20:02.773 15:15:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:02.773 15:15:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:02.773 15:15:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:02.773 15:15:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:02.773 15:15:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:02.773 15:15:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:02.773 15:15:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:02.773 15:15:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:02.773 15:15:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:02.773 15:15:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:02.773 15:15:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:02.773 15:15:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:02.773 15:15:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:02.773 15:15:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:02.773 15:15:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:02.773 15:15:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:02.773 15:15:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:02.773 15:15:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:02.773 15:15:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:02.773 15:15:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:02.773 15:15:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:02.773 15:15:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:02.773 15:15:02 -- paths/export.sh@5 -- # export PATH 00:20:02.773 15:15:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:02.773 15:15:02 -- nvmf/common.sh@46 -- # : 0 00:20:02.774 15:15:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:02.774 15:15:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:02.774 15:15:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:02.774 15:15:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:02.774 15:15:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:02.774 15:15:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:02.774 15:15:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:02.774 15:15:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:02.774 15:15:02 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:02.774 15:15:02 -- target/tls.sh@71 -- # nvmftestinit 00:20:02.774 15:15:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:02.774 15:15:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:02.774 15:15:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:02.774 15:15:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:02.774 15:15:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:02.774 15:15:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:02.774 15:15:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:02.774 15:15:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:02.774 15:15:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:02.774 15:15:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:02.774 15:15:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:02.774 15:15:02 -- common/autotest_common.sh@10 -- # set +x 00:20:04.678 15:15:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:04.678 15:15:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:04.678 15:15:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:04.678 15:15:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:04.678 15:15:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:04.678 15:15:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:04.678 15:15:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:04.678 15:15:04 -- nvmf/common.sh@294 -- # net_devs=() 00:20:04.678 15:15:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:04.678 15:15:04 -- nvmf/common.sh@295 -- # e810=() 00:20:04.678 15:15:04 -- nvmf/common.sh@295 -- # local -ga e810 00:20:04.678 15:15:04 -- nvmf/common.sh@296 -- # x722=() 00:20:04.678 15:15:04 -- nvmf/common.sh@296 -- # local -ga x722 00:20:04.678 15:15:04 -- nvmf/common.sh@297 -- # mlx=() 00:20:04.678 15:15:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:04.678 15:15:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:04.678 15:15:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:04.678 15:15:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:04.678 15:15:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:04.678 15:15:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:04.678 15:15:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:04.678 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:04.678 15:15:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:04.678 15:15:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:04.678 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:04.678 15:15:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:04.678 15:15:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:04.679 15:15:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:04.679 15:15:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:04.679 15:15:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:04.679 15:15:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:04.679 15:15:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:04.679 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:04.679 15:15:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:04.679 15:15:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:04.679 15:15:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:04.679 15:15:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:04.679 15:15:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:04.679 15:15:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:04.679 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:04.679 15:15:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:04.679 15:15:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:04.679 15:15:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:04.679 15:15:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:04.679 15:15:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:04.679 15:15:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:04.679 15:15:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:04.679 15:15:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:04.679 15:15:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:04.679 15:15:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:04.679 15:15:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:04.679 15:15:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:04.679 15:15:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:04.679 15:15:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:04.679 15:15:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:04.679 15:15:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:04.679 15:15:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:04.679 15:15:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:04.679 15:15:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:04.679 15:15:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:04.679 15:15:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:04.679 15:15:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:04.679 15:15:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:04.679 15:15:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:04.679 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:04.679 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:20:04.679 00:20:04.679 --- 10.0.0.2 ping statistics --- 00:20:04.679 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:04.679 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:20:04.679 15:15:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:04.679 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:04.679 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.116 ms 00:20:04.679 00:20:04.679 --- 10.0.0.1 ping statistics --- 00:20:04.679 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:04.679 rtt min/avg/max/mdev = 0.116/0.116/0.116/0.000 ms 00:20:04.679 15:15:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:04.679 15:15:04 -- nvmf/common.sh@410 -- # return 0 00:20:04.679 15:15:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:04.679 15:15:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:04.679 15:15:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:04.679 15:15:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:04.679 15:15:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:04.679 15:15:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:04.679 15:15:04 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:04.679 15:15:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:04.679 15:15:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:04.679 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:20:04.679 15:15:04 -- nvmf/common.sh@469 -- # nvmfpid=734434 00:20:04.679 15:15:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:04.679 15:15:04 -- nvmf/common.sh@470 -- # waitforlisten 734434 00:20:04.679 15:15:04 -- common/autotest_common.sh@829 -- # '[' -z 734434 ']' 00:20:04.679 15:15:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:04.679 15:15:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:04.679 15:15:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:04.679 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:04.679 15:15:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:04.679 15:15:04 -- common/autotest_common.sh@10 -- # set +x 00:20:04.679 [2024-11-28 15:15:04.846269] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:04.679 [2024-11-28 15:15:04.846342] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:04.679 EAL: No free 2048 kB hugepages reported on node 1 00:20:04.679 [2024-11-28 15:15:04.911718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:04.938 [2024-11-28 15:15:05.000378] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:04.938 [2024-11-28 15:15:05.000518] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:04.938 [2024-11-28 15:15:05.000534] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:04.939 [2024-11-28 15:15:05.000546] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:04.939 [2024-11-28 15:15:05.000574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:04.939 15:15:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:04.939 15:15:05 -- common/autotest_common.sh@862 -- # return 0 00:20:04.939 15:15:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:04.939 15:15:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:04.939 15:15:05 -- common/autotest_common.sh@10 -- # set +x 00:20:04.939 15:15:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:04.939 15:15:05 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:04.939 15:15:05 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:05.196 true 00:20:05.196 15:15:05 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:05.196 15:15:05 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:05.454 15:15:05 -- target/tls.sh@82 -- # version=0 00:20:05.454 15:15:05 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:05.454 15:15:05 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:05.712 15:15:05 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:05.712 15:15:05 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:05.971 15:15:06 -- target/tls.sh@90 -- # version=13 00:20:05.971 15:15:06 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:05.971 15:15:06 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:06.229 15:15:06 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:06.229 15:15:06 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:06.487 15:15:06 -- target/tls.sh@98 -- # version=7 00:20:06.487 15:15:06 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:06.487 15:15:06 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:06.487 15:15:06 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:06.745 15:15:06 -- target/tls.sh@105 -- # ktls=false 00:20:06.745 15:15:06 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:06.745 15:15:06 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:07.004 15:15:07 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.004 15:15:07 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:07.263 15:15:07 -- target/tls.sh@113 -- # ktls=true 00:20:07.263 15:15:07 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:07.263 15:15:07 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:07.522 15:15:07 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:07.522 15:15:07 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:07.783 15:15:07 -- target/tls.sh@121 -- # ktls=false 00:20:07.783 15:15:07 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:07.783 15:15:07 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:07.783 15:15:07 -- target/tls.sh@49 -- # local key hash crc 00:20:07.783 15:15:07 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:07.783 15:15:07 -- target/tls.sh@51 -- # hash=01 00:20:07.783 15:15:07 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:07.783 15:15:07 -- target/tls.sh@52 -- # gzip -1 -c 00:20:07.783 15:15:07 -- target/tls.sh@52 -- # tail -c8 00:20:07.783 15:15:07 -- target/tls.sh@52 -- # head -c 4 00:20:07.783 15:15:07 -- target/tls.sh@52 -- # crc='p$H�' 00:20:07.783 15:15:07 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:07.783 15:15:07 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:07.783 15:15:08 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:07.783 15:15:08 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:07.783 15:15:08 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:07.783 15:15:08 -- target/tls.sh@49 -- # local key hash crc 00:20:07.783 15:15:08 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:07.783 15:15:08 -- target/tls.sh@51 -- # hash=01 00:20:07.783 15:15:08 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:07.783 15:15:08 -- target/tls.sh@52 -- # gzip -1 -c 00:20:07.783 15:15:08 -- target/tls.sh@52 -- # tail -c8 00:20:07.783 15:15:08 -- target/tls.sh@52 -- # head -c 4 00:20:07.783 15:15:08 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:07.783 15:15:08 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:07.783 15:15:08 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:08.041 15:15:08 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:08.041 15:15:08 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:08.041 15:15:08 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.041 15:15:08 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:08.041 15:15:08 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:08.041 15:15:08 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:08.041 15:15:08 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.041 15:15:08 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:08.041 15:15:08 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:08.299 15:15:08 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:08.558 15:15:08 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.558 15:15:08 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.558 15:15:08 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:08.817 [2024-11-28 15:15:08.917821] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:08.817 15:15:08 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:09.075 15:15:09 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:09.332 [2024-11-28 15:15:09.471308] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:09.332 [2024-11-28 15:15:09.471568] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:09.332 15:15:09 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:09.592 malloc0 00:20:09.592 15:15:09 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:09.850 15:15:09 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.108 15:15:10 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:10.108 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.295 Initializing NVMe Controllers 00:20:22.295 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:22.295 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:22.295 Initialization complete. Launching workers. 00:20:22.295 ======================================================== 00:20:22.295 Latency(us) 00:20:22.295 Device Information : IOPS MiB/s Average min max 00:20:22.295 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7742.06 30.24 8269.26 1241.89 9234.86 00:20:22.295 ======================================================== 00:20:22.295 Total : 7742.06 30.24 8269.26 1241.89 9234.86 00:20:22.295 00:20:22.295 15:15:20 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:22.295 15:15:20 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:22.295 15:15:20 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:22.295 15:15:20 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:22.295 15:15:20 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:22.295 15:15:20 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:22.295 15:15:20 -- target/tls.sh@28 -- # bdevperf_pid=736895 00:20:22.295 15:15:20 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:22.295 15:15:20 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:22.295 15:15:20 -- target/tls.sh@31 -- # waitforlisten 736895 /var/tmp/bdevperf.sock 00:20:22.295 15:15:20 -- common/autotest_common.sh@829 -- # '[' -z 736895 ']' 00:20:22.295 15:15:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:22.295 15:15:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:22.295 15:15:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:22.295 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:22.295 15:15:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:22.295 15:15:20 -- common/autotest_common.sh@10 -- # set +x 00:20:22.295 [2024-11-28 15:15:20.438665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:22.295 [2024-11-28 15:15:20.438761] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid736895 ] 00:20:22.295 EAL: No free 2048 kB hugepages reported on node 1 00:20:22.295 [2024-11-28 15:15:20.497390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:22.295 [2024-11-28 15:15:20.580903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:22.295 15:15:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:22.295 15:15:21 -- common/autotest_common.sh@862 -- # return 0 00:20:22.295 15:15:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:22.295 [2024-11-28 15:15:21.700407] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:22.295 TLSTESTn1 00:20:22.295 15:15:21 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:22.296 Running I/O for 10 seconds... 00:20:32.299 00:20:32.299 Latency(us) 00:20:32.299 [2024-11-28T14:15:32.533Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.299 [2024-11-28T14:15:32.533Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:32.299 Verification LBA range: start 0x0 length 0x2000 00:20:32.299 TLSTESTn1 : 10.01 4135.62 16.15 0.00 0.00 30910.45 4174.89 39030.33 00:20:32.299 [2024-11-28T14:15:32.533Z] =================================================================================================================== 00:20:32.299 [2024-11-28T14:15:32.533Z] Total : 4135.62 16.15 0.00 0.00 30910.45 4174.89 39030.33 00:20:32.299 0 00:20:32.299 15:15:31 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:32.299 15:15:31 -- target/tls.sh@45 -- # killprocess 736895 00:20:32.299 15:15:31 -- common/autotest_common.sh@936 -- # '[' -z 736895 ']' 00:20:32.299 15:15:31 -- common/autotest_common.sh@940 -- # kill -0 736895 00:20:32.299 15:15:31 -- common/autotest_common.sh@941 -- # uname 00:20:32.299 15:15:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:32.299 15:15:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 736895 00:20:32.299 15:15:31 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:32.299 15:15:31 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:32.299 15:15:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 736895' 00:20:32.299 killing process with pid 736895 00:20:32.299 15:15:31 -- common/autotest_common.sh@955 -- # kill 736895 00:20:32.299 Received shutdown signal, test time was about 10.000000 seconds 00:20:32.299 00:20:32.299 Latency(us) 00:20:32.299 [2024-11-28T14:15:32.533Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.299 [2024-11-28T14:15:32.533Z] =================================================================================================================== 00:20:32.299 [2024-11-28T14:15:32.533Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:32.299 15:15:31 -- common/autotest_common.sh@960 -- # wait 736895 00:20:32.299 15:15:32 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:32.299 15:15:32 -- common/autotest_common.sh@650 -- # local es=0 00:20:32.299 15:15:32 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:32.299 15:15:32 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:32.299 15:15:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:32.299 15:15:32 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:32.299 15:15:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:32.299 15:15:32 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:32.299 15:15:32 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:32.299 15:15:32 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:32.299 15:15:32 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:32.299 15:15:32 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:32.299 15:15:32 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:32.299 15:15:32 -- target/tls.sh@28 -- # bdevperf_pid=738270 00:20:32.299 15:15:32 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:32.299 15:15:32 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:32.299 15:15:32 -- target/tls.sh@31 -- # waitforlisten 738270 /var/tmp/bdevperf.sock 00:20:32.299 15:15:32 -- common/autotest_common.sh@829 -- # '[' -z 738270 ']' 00:20:32.299 15:15:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:32.299 15:15:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:32.299 15:15:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:32.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:32.299 15:15:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:32.299 15:15:32 -- common/autotest_common.sh@10 -- # set +x 00:20:32.299 [2024-11-28 15:15:32.250201] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:32.300 [2024-11-28 15:15:32.250296] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid738270 ] 00:20:32.300 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.300 [2024-11-28 15:15:32.307012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.300 [2024-11-28 15:15:32.393963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:33.233 15:15:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:33.233 15:15:33 -- common/autotest_common.sh@862 -- # return 0 00:20:33.233 15:15:33 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:33.234 [2024-11-28 15:15:33.462150] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:33.234 [2024-11-28 15:15:33.467478] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:33.492 [2024-11-28 15:15:33.467970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x103d840 (107): Transport endpoint is not connected 00:20:33.492 [2024-11-28 15:15:33.468954] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x103d840 (9): Bad file descriptor 00:20:33.492 [2024-11-28 15:15:33.469953] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:33.492 [2024-11-28 15:15:33.469990] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:33.492 [2024-11-28 15:15:33.470004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:33.492 request: 00:20:33.492 { 00:20:33.492 "name": "TLSTEST", 00:20:33.492 "trtype": "tcp", 00:20:33.492 "traddr": "10.0.0.2", 00:20:33.492 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:33.492 "adrfam": "ipv4", 00:20:33.492 "trsvcid": "4420", 00:20:33.492 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:33.492 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:33.492 "method": "bdev_nvme_attach_controller", 00:20:33.492 "req_id": 1 00:20:33.492 } 00:20:33.492 Got JSON-RPC error response 00:20:33.492 response: 00:20:33.492 { 00:20:33.492 "code": -32602, 00:20:33.492 "message": "Invalid parameters" 00:20:33.492 } 00:20:33.492 15:15:33 -- target/tls.sh@36 -- # killprocess 738270 00:20:33.492 15:15:33 -- common/autotest_common.sh@936 -- # '[' -z 738270 ']' 00:20:33.492 15:15:33 -- common/autotest_common.sh@940 -- # kill -0 738270 00:20:33.492 15:15:33 -- common/autotest_common.sh@941 -- # uname 00:20:33.492 15:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:33.492 15:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738270 00:20:33.492 15:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:33.492 15:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:33.492 15:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738270' 00:20:33.492 killing process with pid 738270 00:20:33.492 15:15:33 -- common/autotest_common.sh@955 -- # kill 738270 00:20:33.492 Received shutdown signal, test time was about 10.000000 seconds 00:20:33.492 00:20:33.492 Latency(us) 00:20:33.492 [2024-11-28T14:15:33.726Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.492 [2024-11-28T14:15:33.726Z] =================================================================================================================== 00:20:33.492 [2024-11-28T14:15:33.726Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:33.492 15:15:33 -- common/autotest_common.sh@960 -- # wait 738270 00:20:33.751 15:15:33 -- target/tls.sh@37 -- # return 1 00:20:33.751 15:15:33 -- common/autotest_common.sh@653 -- # es=1 00:20:33.751 15:15:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:33.751 15:15:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:33.751 15:15:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:33.751 15:15:33 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.751 15:15:33 -- common/autotest_common.sh@650 -- # local es=0 00:20:33.751 15:15:33 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.751 15:15:33 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:33.751 15:15:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.751 15:15:33 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:33.751 15:15:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.751 15:15:33 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.751 15:15:33 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.751 15:15:33 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:33.751 15:15:33 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:33.751 15:15:33 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:33.751 15:15:33 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.751 15:15:33 -- target/tls.sh@28 -- # bdevperf_pid=738478 00:20:33.751 15:15:33 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.751 15:15:33 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.751 15:15:33 -- target/tls.sh@31 -- # waitforlisten 738478 /var/tmp/bdevperf.sock 00:20:33.751 15:15:33 -- common/autotest_common.sh@829 -- # '[' -z 738478 ']' 00:20:33.751 15:15:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.751 15:15:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.751 15:15:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.751 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.751 15:15:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.751 15:15:33 -- common/autotest_common.sh@10 -- # set +x 00:20:33.751 [2024-11-28 15:15:33.785293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:33.751 [2024-11-28 15:15:33.785385] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid738478 ] 00:20:33.751 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.751 [2024-11-28 15:15:33.844040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.751 [2024-11-28 15:15:33.924589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.685 15:15:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.685 15:15:34 -- common/autotest_common.sh@862 -- # return 0 00:20:34.685 15:15:34 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:34.955 [2024-11-28 15:15:34.984712] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:34.955 [2024-11-28 15:15:34.989917] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:34.955 [2024-11-28 15:15:34.989948] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:34.955 [2024-11-28 15:15:34.989986] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:34.955 [2024-11-28 15:15:34.990483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fec840 (107): Transport endpoint is not connected 00:20:34.955 [2024-11-28 15:15:34.991471] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fec840 (9): Bad file descriptor 00:20:34.955 [2024-11-28 15:15:34.992470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:34.955 [2024-11-28 15:15:34.992491] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:34.955 [2024-11-28 15:15:34.992504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:34.955 request: 00:20:34.955 { 00:20:34.955 "name": "TLSTEST", 00:20:34.955 "trtype": "tcp", 00:20:34.955 "traddr": "10.0.0.2", 00:20:34.955 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:34.955 "adrfam": "ipv4", 00:20:34.955 "trsvcid": "4420", 00:20:34.955 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:34.955 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:34.956 "method": "bdev_nvme_attach_controller", 00:20:34.956 "req_id": 1 00:20:34.956 } 00:20:34.956 Got JSON-RPC error response 00:20:34.956 response: 00:20:34.956 { 00:20:34.956 "code": -32602, 00:20:34.956 "message": "Invalid parameters" 00:20:34.956 } 00:20:34.956 15:15:35 -- target/tls.sh@36 -- # killprocess 738478 00:20:34.956 15:15:35 -- common/autotest_common.sh@936 -- # '[' -z 738478 ']' 00:20:34.956 15:15:35 -- common/autotest_common.sh@940 -- # kill -0 738478 00:20:34.956 15:15:35 -- common/autotest_common.sh@941 -- # uname 00:20:34.956 15:15:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.956 15:15:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738478 00:20:34.956 15:15:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:34.956 15:15:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:34.956 15:15:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738478' 00:20:34.956 killing process with pid 738478 00:20:34.956 15:15:35 -- common/autotest_common.sh@955 -- # kill 738478 00:20:34.956 Received shutdown signal, test time was about 10.000000 seconds 00:20:34.956 00:20:34.956 Latency(us) 00:20:34.956 [2024-11-28T14:15:35.190Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:34.956 [2024-11-28T14:15:35.190Z] =================================================================================================================== 00:20:34.956 [2024-11-28T14:15:35.190Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:34.956 15:15:35 -- common/autotest_common.sh@960 -- # wait 738478 00:20:35.219 15:15:35 -- target/tls.sh@37 -- # return 1 00:20:35.219 15:15:35 -- common/autotest_common.sh@653 -- # es=1 00:20:35.219 15:15:35 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:35.219 15:15:35 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:35.219 15:15:35 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:35.219 15:15:35 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.219 15:15:35 -- common/autotest_common.sh@650 -- # local es=0 00:20:35.219 15:15:35 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.219 15:15:35 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:35.219 15:15:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.219 15:15:35 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:35.219 15:15:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.219 15:15:35 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:35.219 15:15:35 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:35.219 15:15:35 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:35.219 15:15:35 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:35.219 15:15:35 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:35.219 15:15:35 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:35.219 15:15:35 -- target/tls.sh@28 -- # bdevperf_pid=738691 00:20:35.219 15:15:35 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:35.219 15:15:35 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:35.219 15:15:35 -- target/tls.sh@31 -- # waitforlisten 738691 /var/tmp/bdevperf.sock 00:20:35.219 15:15:35 -- common/autotest_common.sh@829 -- # '[' -z 738691 ']' 00:20:35.219 15:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:35.219 15:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:35.219 15:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:35.219 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:35.219 15:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:35.219 15:15:35 -- common/autotest_common.sh@10 -- # set +x 00:20:35.219 [2024-11-28 15:15:35.307375] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:35.219 [2024-11-28 15:15:35.307459] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid738691 ] 00:20:35.219 EAL: No free 2048 kB hugepages reported on node 1 00:20:35.219 [2024-11-28 15:15:35.363739] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:35.219 [2024-11-28 15:15:35.442128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:36.153 15:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:36.153 15:15:36 -- common/autotest_common.sh@862 -- # return 0 00:20:36.153 15:15:36 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:36.410 [2024-11-28 15:15:36.481358] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:36.410 [2024-11-28 15:15:36.492594] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:36.410 [2024-11-28 15:15:36.492624] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:36.410 [2024-11-28 15:15:36.492674] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:36.410 [2024-11-28 15:15:36.493045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2046840 (107): Transport endpoint is not connected 00:20:36.410 [2024-11-28 15:15:36.494035] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2046840 (9): Bad file descriptor 00:20:36.410 [2024-11-28 15:15:36.495035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:36.410 [2024-11-28 15:15:36.495056] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:36.410 [2024-11-28 15:15:36.495070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:36.410 request: 00:20:36.410 { 00:20:36.410 "name": "TLSTEST", 00:20:36.410 "trtype": "tcp", 00:20:36.410 "traddr": "10.0.0.2", 00:20:36.410 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:36.410 "adrfam": "ipv4", 00:20:36.410 "trsvcid": "4420", 00:20:36.411 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:36.411 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:36.411 "method": "bdev_nvme_attach_controller", 00:20:36.411 "req_id": 1 00:20:36.411 } 00:20:36.411 Got JSON-RPC error response 00:20:36.411 response: 00:20:36.411 { 00:20:36.411 "code": -32602, 00:20:36.411 "message": "Invalid parameters" 00:20:36.411 } 00:20:36.411 15:15:36 -- target/tls.sh@36 -- # killprocess 738691 00:20:36.411 15:15:36 -- common/autotest_common.sh@936 -- # '[' -z 738691 ']' 00:20:36.411 15:15:36 -- common/autotest_common.sh@940 -- # kill -0 738691 00:20:36.411 15:15:36 -- common/autotest_common.sh@941 -- # uname 00:20:36.411 15:15:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:36.411 15:15:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738691 00:20:36.411 15:15:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:36.411 15:15:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:36.411 15:15:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738691' 00:20:36.411 killing process with pid 738691 00:20:36.411 15:15:36 -- common/autotest_common.sh@955 -- # kill 738691 00:20:36.411 Received shutdown signal, test time was about 10.000000 seconds 00:20:36.411 00:20:36.411 Latency(us) 00:20:36.411 [2024-11-28T14:15:36.645Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:36.411 [2024-11-28T14:15:36.645Z] =================================================================================================================== 00:20:36.411 [2024-11-28T14:15:36.645Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:36.411 15:15:36 -- common/autotest_common.sh@960 -- # wait 738691 00:20:36.668 15:15:36 -- target/tls.sh@37 -- # return 1 00:20:36.668 15:15:36 -- common/autotest_common.sh@653 -- # es=1 00:20:36.669 15:15:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:36.669 15:15:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:36.669 15:15:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:36.669 15:15:36 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:36.669 15:15:36 -- common/autotest_common.sh@650 -- # local es=0 00:20:36.669 15:15:36 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:36.669 15:15:36 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:36.669 15:15:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:36.669 15:15:36 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:36.669 15:15:36 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:36.669 15:15:36 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:36.669 15:15:36 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:36.669 15:15:36 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:36.669 15:15:36 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:36.669 15:15:36 -- target/tls.sh@23 -- # psk= 00:20:36.669 15:15:36 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:36.669 15:15:36 -- target/tls.sh@28 -- # bdevperf_pid=738842 00:20:36.669 15:15:36 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:36.669 15:15:36 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:36.669 15:15:36 -- target/tls.sh@31 -- # waitforlisten 738842 /var/tmp/bdevperf.sock 00:20:36.669 15:15:36 -- common/autotest_common.sh@829 -- # '[' -z 738842 ']' 00:20:36.669 15:15:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:36.669 15:15:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.669 15:15:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:36.669 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:36.669 15:15:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.669 15:15:36 -- common/autotest_common.sh@10 -- # set +x 00:20:36.669 [2024-11-28 15:15:36.804641] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:36.669 [2024-11-28 15:15:36.804738] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid738842 ] 00:20:36.669 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.669 [2024-11-28 15:15:36.863794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.927 [2024-11-28 15:15:36.954255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.859 15:15:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.859 15:15:37 -- common/autotest_common.sh@862 -- # return 0 00:20:37.859 15:15:37 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:37.860 [2024-11-28 15:15:38.027057] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:37.860 [2024-11-28 15:15:38.028974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x144ddd0 (9): Bad file descriptor 00:20:37.860 [2024-11-28 15:15:38.029970] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:37.860 [2024-11-28 15:15:38.029993] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:37.860 [2024-11-28 15:15:38.030006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:37.860 request: 00:20:37.860 { 00:20:37.860 "name": "TLSTEST", 00:20:37.860 "trtype": "tcp", 00:20:37.860 "traddr": "10.0.0.2", 00:20:37.860 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:37.860 "adrfam": "ipv4", 00:20:37.860 "trsvcid": "4420", 00:20:37.860 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.860 "method": "bdev_nvme_attach_controller", 00:20:37.860 "req_id": 1 00:20:37.860 } 00:20:37.860 Got JSON-RPC error response 00:20:37.860 response: 00:20:37.860 { 00:20:37.860 "code": -32602, 00:20:37.860 "message": "Invalid parameters" 00:20:37.860 } 00:20:37.860 15:15:38 -- target/tls.sh@36 -- # killprocess 738842 00:20:37.860 15:15:38 -- common/autotest_common.sh@936 -- # '[' -z 738842 ']' 00:20:37.860 15:15:38 -- common/autotest_common.sh@940 -- # kill -0 738842 00:20:37.860 15:15:38 -- common/autotest_common.sh@941 -- # uname 00:20:37.860 15:15:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.860 15:15:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 738842 00:20:37.860 15:15:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:37.860 15:15:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:37.860 15:15:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 738842' 00:20:37.860 killing process with pid 738842 00:20:37.860 15:15:38 -- common/autotest_common.sh@955 -- # kill 738842 00:20:37.860 Received shutdown signal, test time was about 10.000000 seconds 00:20:37.860 00:20:37.860 Latency(us) 00:20:37.860 [2024-11-28T14:15:38.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:37.860 [2024-11-28T14:15:38.094Z] =================================================================================================================== 00:20:37.860 [2024-11-28T14:15:38.094Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:37.860 15:15:38 -- common/autotest_common.sh@960 -- # wait 738842 00:20:38.118 15:15:38 -- target/tls.sh@37 -- # return 1 00:20:38.118 15:15:38 -- common/autotest_common.sh@653 -- # es=1 00:20:38.118 15:15:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:38.118 15:15:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:38.118 15:15:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:38.118 15:15:38 -- target/tls.sh@167 -- # killprocess 734434 00:20:38.118 15:15:38 -- common/autotest_common.sh@936 -- # '[' -z 734434 ']' 00:20:38.118 15:15:38 -- common/autotest_common.sh@940 -- # kill -0 734434 00:20:38.118 15:15:38 -- common/autotest_common.sh@941 -- # uname 00:20:38.118 15:15:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:38.118 15:15:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 734434 00:20:38.118 15:15:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:38.118 15:15:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:38.118 15:15:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 734434' 00:20:38.118 killing process with pid 734434 00:20:38.118 15:15:38 -- common/autotest_common.sh@955 -- # kill 734434 00:20:38.118 15:15:38 -- common/autotest_common.sh@960 -- # wait 734434 00:20:38.376 15:15:38 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:38.377 15:15:38 -- target/tls.sh@49 -- # local key hash crc 00:20:38.377 15:15:38 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:38.377 15:15:38 -- target/tls.sh@51 -- # hash=02 00:20:38.377 15:15:38 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:38.377 15:15:38 -- target/tls.sh@52 -- # gzip -1 -c 00:20:38.377 15:15:38 -- target/tls.sh@52 -- # tail -c8 00:20:38.377 15:15:38 -- target/tls.sh@52 -- # head -c 4 00:20:38.377 15:15:38 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:38.377 15:15:38 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:38.377 15:15:38 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:38.377 15:15:38 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:38.377 15:15:38 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:38.377 15:15:38 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.377 15:15:38 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:38.377 15:15:38 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.377 15:15:38 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:38.377 15:15:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:38.377 15:15:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:38.377 15:15:38 -- common/autotest_common.sh@10 -- # set +x 00:20:38.377 15:15:38 -- nvmf/common.sh@469 -- # nvmfpid=739131 00:20:38.377 15:15:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:38.377 15:15:38 -- nvmf/common.sh@470 -- # waitforlisten 739131 00:20:38.377 15:15:38 -- common/autotest_common.sh@829 -- # '[' -z 739131 ']' 00:20:38.377 15:15:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:38.377 15:15:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:38.377 15:15:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:38.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:38.377 15:15:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:38.377 15:15:38 -- common/autotest_common.sh@10 -- # set +x 00:20:38.635 [2024-11-28 15:15:38.651002] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:38.635 [2024-11-28 15:15:38.651100] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:38.635 EAL: No free 2048 kB hugepages reported on node 1 00:20:38.635 [2024-11-28 15:15:38.711353] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:38.635 [2024-11-28 15:15:38.797114] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:38.635 [2024-11-28 15:15:38.797250] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:38.635 [2024-11-28 15:15:38.797266] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:38.635 [2024-11-28 15:15:38.797277] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:38.635 [2024-11-28 15:15:38.797320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:39.569 15:15:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:39.569 15:15:39 -- common/autotest_common.sh@862 -- # return 0 00:20:39.569 15:15:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:39.569 15:15:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:39.569 15:15:39 -- common/autotest_common.sh@10 -- # set +x 00:20:39.569 15:15:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:39.569 15:15:39 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:39.569 15:15:39 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:39.569 15:15:39 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:39.827 [2024-11-28 15:15:39.861904] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:39.827 15:15:39 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:40.086 15:15:40 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:40.344 [2024-11-28 15:15:40.367250] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:40.344 [2024-11-28 15:15:40.367511] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:40.344 15:15:40 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:40.602 malloc0 00:20:40.602 15:15:40 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:40.860 15:15:40 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.119 15:15:41 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.119 15:15:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:41.119 15:15:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:41.119 15:15:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:41.119 15:15:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:41.119 15:15:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:41.119 15:15:41 -- target/tls.sh@28 -- # bdevperf_pid=739430 00:20:41.119 15:15:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:41.119 15:15:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:41.119 15:15:41 -- target/tls.sh@31 -- # waitforlisten 739430 /var/tmp/bdevperf.sock 00:20:41.119 15:15:41 -- common/autotest_common.sh@829 -- # '[' -z 739430 ']' 00:20:41.119 15:15:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:41.119 15:15:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:41.119 15:15:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:41.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:41.119 15:15:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:41.119 15:15:41 -- common/autotest_common.sh@10 -- # set +x 00:20:41.119 [2024-11-28 15:15:41.181894] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:41.119 [2024-11-28 15:15:41.181992] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid739430 ] 00:20:41.119 EAL: No free 2048 kB hugepages reported on node 1 00:20:41.119 [2024-11-28 15:15:41.239539] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:41.119 [2024-11-28 15:15:41.323028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:42.053 15:15:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:42.053 15:15:42 -- common/autotest_common.sh@862 -- # return 0 00:20:42.053 15:15:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:42.311 [2024-11-28 15:15:42.375265] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:42.311 TLSTESTn1 00:20:42.311 15:15:42 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:42.569 Running I/O for 10 seconds... 00:20:52.532 00:20:52.532 Latency(us) 00:20:52.532 [2024-11-28T14:15:52.766Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:52.532 [2024-11-28T14:15:52.766Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:52.532 Verification LBA range: start 0x0 length 0x2000 00:20:52.532 TLSTESTn1 : 10.03 4401.69 17.19 0.00 0.00 29023.58 4660.34 47574.28 00:20:52.532 [2024-11-28T14:15:52.766Z] =================================================================================================================== 00:20:52.532 [2024-11-28T14:15:52.766Z] Total : 4401.69 17.19 0.00 0.00 29023.58 4660.34 47574.28 00:20:52.532 0 00:20:52.532 15:15:52 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:52.532 15:15:52 -- target/tls.sh@45 -- # killprocess 739430 00:20:52.532 15:15:52 -- common/autotest_common.sh@936 -- # '[' -z 739430 ']' 00:20:52.532 15:15:52 -- common/autotest_common.sh@940 -- # kill -0 739430 00:20:52.532 15:15:52 -- common/autotest_common.sh@941 -- # uname 00:20:52.532 15:15:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:52.532 15:15:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 739430 00:20:52.532 15:15:52 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:52.532 15:15:52 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:52.533 15:15:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 739430' 00:20:52.533 killing process with pid 739430 00:20:52.533 15:15:52 -- common/autotest_common.sh@955 -- # kill 739430 00:20:52.533 Received shutdown signal, test time was about 10.000000 seconds 00:20:52.533 00:20:52.533 Latency(us) 00:20:52.533 [2024-11-28T14:15:52.767Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:52.533 [2024-11-28T14:15:52.767Z] =================================================================================================================== 00:20:52.533 [2024-11-28T14:15:52.767Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:52.533 15:15:52 -- common/autotest_common.sh@960 -- # wait 739430 00:20:52.791 15:15:52 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.791 15:15:52 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.791 15:15:52 -- common/autotest_common.sh@650 -- # local es=0 00:20:52.791 15:15:52 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.791 15:15:52 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:52.791 15:15:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:52.791 15:15:52 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:52.791 15:15:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:52.791 15:15:52 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.791 15:15:52 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:52.791 15:15:52 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:52.791 15:15:52 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:52.791 15:15:52 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:52.791 15:15:52 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:52.791 15:15:52 -- target/tls.sh@28 -- # bdevperf_pid=740817 00:20:52.791 15:15:52 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:52.791 15:15:52 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:52.791 15:15:52 -- target/tls.sh@31 -- # waitforlisten 740817 /var/tmp/bdevperf.sock 00:20:52.791 15:15:52 -- common/autotest_common.sh@829 -- # '[' -z 740817 ']' 00:20:52.791 15:15:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:52.791 15:15:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:52.791 15:15:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:52.791 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:52.791 15:15:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:52.791 15:15:52 -- common/autotest_common.sh@10 -- # set +x 00:20:52.791 [2024-11-28 15:15:52.934397] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:52.791 [2024-11-28 15:15:52.934493] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid740817 ] 00:20:52.791 EAL: No free 2048 kB hugepages reported on node 1 00:20:52.791 [2024-11-28 15:15:52.994755] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.049 [2024-11-28 15:15:53.078362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:53.983 15:15:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:53.983 15:15:53 -- common/autotest_common.sh@862 -- # return 0 00:20:53.983 15:15:53 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.983 [2024-11-28 15:15:54.148174] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:53.983 [2024-11-28 15:15:54.148221] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:53.983 request: 00:20:53.983 { 00:20:53.983 "name": "TLSTEST", 00:20:53.983 "trtype": "tcp", 00:20:53.983 "traddr": "10.0.0.2", 00:20:53.983 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:53.983 "adrfam": "ipv4", 00:20:53.983 "trsvcid": "4420", 00:20:53.983 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:53.983 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:53.983 "method": "bdev_nvme_attach_controller", 00:20:53.983 "req_id": 1 00:20:53.983 } 00:20:53.983 Got JSON-RPC error response 00:20:53.983 response: 00:20:53.983 { 00:20:53.983 "code": -22, 00:20:53.983 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:53.983 } 00:20:53.983 15:15:54 -- target/tls.sh@36 -- # killprocess 740817 00:20:53.983 15:15:54 -- common/autotest_common.sh@936 -- # '[' -z 740817 ']' 00:20:53.983 15:15:54 -- common/autotest_common.sh@940 -- # kill -0 740817 00:20:53.983 15:15:54 -- common/autotest_common.sh@941 -- # uname 00:20:53.983 15:15:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:53.983 15:15:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 740817 00:20:53.983 15:15:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:53.983 15:15:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:53.983 15:15:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 740817' 00:20:53.983 killing process with pid 740817 00:20:53.983 15:15:54 -- common/autotest_common.sh@955 -- # kill 740817 00:20:53.983 Received shutdown signal, test time was about 10.000000 seconds 00:20:53.983 00:20:53.983 Latency(us) 00:20:53.983 [2024-11-28T14:15:54.217Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:53.983 [2024-11-28T14:15:54.217Z] =================================================================================================================== 00:20:53.983 [2024-11-28T14:15:54.217Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:53.983 15:15:54 -- common/autotest_common.sh@960 -- # wait 740817 00:20:54.241 15:15:54 -- target/tls.sh@37 -- # return 1 00:20:54.241 15:15:54 -- common/autotest_common.sh@653 -- # es=1 00:20:54.241 15:15:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:54.241 15:15:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:54.241 15:15:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:54.241 15:15:54 -- target/tls.sh@183 -- # killprocess 739131 00:20:54.241 15:15:54 -- common/autotest_common.sh@936 -- # '[' -z 739131 ']' 00:20:54.241 15:15:54 -- common/autotest_common.sh@940 -- # kill -0 739131 00:20:54.241 15:15:54 -- common/autotest_common.sh@941 -- # uname 00:20:54.241 15:15:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:54.241 15:15:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 739131 00:20:54.241 15:15:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:54.241 15:15:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:54.241 15:15:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 739131' 00:20:54.241 killing process with pid 739131 00:20:54.241 15:15:54 -- common/autotest_common.sh@955 -- # kill 739131 00:20:54.241 15:15:54 -- common/autotest_common.sh@960 -- # wait 739131 00:20:54.500 15:15:54 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:54.500 15:15:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:54.500 15:15:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:54.500 15:15:54 -- common/autotest_common.sh@10 -- # set +x 00:20:54.500 15:15:54 -- nvmf/common.sh@469 -- # nvmfpid=741093 00:20:54.500 15:15:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:54.500 15:15:54 -- nvmf/common.sh@470 -- # waitforlisten 741093 00:20:54.500 15:15:54 -- common/autotest_common.sh@829 -- # '[' -z 741093 ']' 00:20:54.500 15:15:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:54.500 15:15:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:54.500 15:15:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:54.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:54.500 15:15:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:54.500 15:15:54 -- common/autotest_common.sh@10 -- # set +x 00:20:54.758 [2024-11-28 15:15:54.767326] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:54.758 [2024-11-28 15:15:54.767403] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:54.758 EAL: No free 2048 kB hugepages reported on node 1 00:20:54.758 [2024-11-28 15:15:54.838291] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:54.758 [2024-11-28 15:15:54.927199] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:54.758 [2024-11-28 15:15:54.927344] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:54.758 [2024-11-28 15:15:54.927364] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:54.758 [2024-11-28 15:15:54.927380] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:54.758 [2024-11-28 15:15:54.927412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:55.699 15:15:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:55.699 15:15:55 -- common/autotest_common.sh@862 -- # return 0 00:20:55.699 15:15:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:55.699 15:15:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:55.699 15:15:55 -- common/autotest_common.sh@10 -- # set +x 00:20:55.699 15:15:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:55.699 15:15:55 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.699 15:15:55 -- common/autotest_common.sh@650 -- # local es=0 00:20:55.699 15:15:55 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.699 15:15:55 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:55.699 15:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:55.699 15:15:55 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:55.699 15:15:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:55.700 15:15:55 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.700 15:15:55 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.700 15:15:55 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:55.959 [2024-11-28 15:15:56.109255] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:55.959 15:15:56 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:56.217 15:15:56 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:56.476 [2024-11-28 15:15:56.690883] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:56.476 [2024-11-28 15:15:56.691159] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:56.476 15:15:56 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:56.734 malloc0 00:20:56.734 15:15:56 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:56.992 15:15:57 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.249 [2024-11-28 15:15:57.444231] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:57.249 [2024-11-28 15:15:57.444272] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:57.249 [2024-11-28 15:15:57.444305] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:57.249 request: 00:20:57.249 { 00:20:57.249 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:57.249 "host": "nqn.2016-06.io.spdk:host1", 00:20:57.249 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:57.249 "method": "nvmf_subsystem_add_host", 00:20:57.249 "req_id": 1 00:20:57.249 } 00:20:57.249 Got JSON-RPC error response 00:20:57.249 response: 00:20:57.249 { 00:20:57.249 "code": -32603, 00:20:57.249 "message": "Internal error" 00:20:57.249 } 00:20:57.249 15:15:57 -- common/autotest_common.sh@653 -- # es=1 00:20:57.249 15:15:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:57.249 15:15:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:57.249 15:15:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:57.249 15:15:57 -- target/tls.sh@189 -- # killprocess 741093 00:20:57.249 15:15:57 -- common/autotest_common.sh@936 -- # '[' -z 741093 ']' 00:20:57.249 15:15:57 -- common/autotest_common.sh@940 -- # kill -0 741093 00:20:57.249 15:15:57 -- common/autotest_common.sh@941 -- # uname 00:20:57.249 15:15:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:57.249 15:15:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 741093 00:20:57.507 15:15:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:57.507 15:15:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:57.507 15:15:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 741093' 00:20:57.507 killing process with pid 741093 00:20:57.507 15:15:57 -- common/autotest_common.sh@955 -- # kill 741093 00:20:57.507 15:15:57 -- common/autotest_common.sh@960 -- # wait 741093 00:20:57.766 15:15:57 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.766 15:15:57 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:57.766 15:15:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:57.766 15:15:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:57.766 15:15:57 -- common/autotest_common.sh@10 -- # set +x 00:20:57.766 15:15:57 -- nvmf/common.sh@469 -- # nvmfpid=741530 00:20:57.766 15:15:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:57.766 15:15:57 -- nvmf/common.sh@470 -- # waitforlisten 741530 00:20:57.766 15:15:57 -- common/autotest_common.sh@829 -- # '[' -z 741530 ']' 00:20:57.766 15:15:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:57.766 15:15:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:57.766 15:15:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:57.766 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:57.766 15:15:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:57.766 15:15:57 -- common/autotest_common.sh@10 -- # set +x 00:20:57.766 [2024-11-28 15:15:57.803320] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:20:57.766 [2024-11-28 15:15:57.803418] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:57.766 EAL: No free 2048 kB hugepages reported on node 1 00:20:57.766 [2024-11-28 15:15:57.871361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:57.766 [2024-11-28 15:15:57.957180] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:57.766 [2024-11-28 15:15:57.957358] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:57.766 [2024-11-28 15:15:57.957379] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:57.766 [2024-11-28 15:15:57.957394] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:57.766 [2024-11-28 15:15:57.957435] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:58.700 15:15:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:58.701 15:15:58 -- common/autotest_common.sh@862 -- # return 0 00:20:58.701 15:15:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:58.701 15:15:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:58.701 15:15:58 -- common/autotest_common.sh@10 -- # set +x 00:20:58.701 15:15:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:58.701 15:15:58 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.701 15:15:58 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.701 15:15:58 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:58.958 [2024-11-28 15:15:59.009939] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:58.958 15:15:59 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:59.216 15:15:59 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:59.475 [2024-11-28 15:15:59.491227] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:59.475 [2024-11-28 15:15:59.491493] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:59.475 15:15:59 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:59.734 malloc0 00:20:59.734 15:15:59 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:59.992 15:16:00 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:00.250 15:16:00 -- target/tls.sh@197 -- # bdevperf_pid=741831 00:21:00.251 15:16:00 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:00.251 15:16:00 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:21:00.251 15:16:00 -- target/tls.sh@200 -- # waitforlisten 741831 /var/tmp/bdevperf.sock 00:21:00.251 15:16:00 -- common/autotest_common.sh@829 -- # '[' -z 741831 ']' 00:21:00.251 15:16:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:00.251 15:16:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:00.251 15:16:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:00.251 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:00.251 15:16:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:00.251 15:16:00 -- common/autotest_common.sh@10 -- # set +x 00:21:00.251 [2024-11-28 15:16:00.317853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:00.251 [2024-11-28 15:16:00.317942] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid741831 ] 00:21:00.251 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.251 [2024-11-28 15:16:00.376832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.251 [2024-11-28 15:16:00.460602] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:01.208 15:16:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.208 15:16:01 -- common/autotest_common.sh@862 -- # return 0 00:21:01.208 15:16:01 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:01.515 [2024-11-28 15:16:01.494614] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:01.515 TLSTESTn1 00:21:01.515 15:16:01 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:21:01.773 15:16:01 -- target/tls.sh@205 -- # tgtconf='{ 00:21:01.773 "subsystems": [ 00:21:01.773 { 00:21:01.773 "subsystem": "iobuf", 00:21:01.773 "config": [ 00:21:01.773 { 00:21:01.773 "method": "iobuf_set_options", 00:21:01.773 "params": { 00:21:01.773 "small_pool_count": 8192, 00:21:01.773 "large_pool_count": 1024, 00:21:01.773 "small_bufsize": 8192, 00:21:01.773 "large_bufsize": 135168 00:21:01.773 } 00:21:01.773 } 00:21:01.773 ] 00:21:01.773 }, 00:21:01.773 { 00:21:01.773 "subsystem": "sock", 00:21:01.773 "config": [ 00:21:01.773 { 00:21:01.773 "method": "sock_impl_set_options", 00:21:01.773 "params": { 00:21:01.773 "impl_name": "posix", 00:21:01.774 "recv_buf_size": 2097152, 00:21:01.774 "send_buf_size": 2097152, 00:21:01.774 "enable_recv_pipe": true, 00:21:01.774 "enable_quickack": false, 00:21:01.774 "enable_placement_id": 0, 00:21:01.774 "enable_zerocopy_send_server": true, 00:21:01.774 "enable_zerocopy_send_client": false, 00:21:01.774 "zerocopy_threshold": 0, 00:21:01.774 "tls_version": 0, 00:21:01.774 "enable_ktls": false 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "sock_impl_set_options", 00:21:01.774 "params": { 00:21:01.774 "impl_name": "ssl", 00:21:01.774 "recv_buf_size": 4096, 00:21:01.774 "send_buf_size": 4096, 00:21:01.774 "enable_recv_pipe": true, 00:21:01.774 "enable_quickack": false, 00:21:01.774 "enable_placement_id": 0, 00:21:01.774 "enable_zerocopy_send_server": true, 00:21:01.774 "enable_zerocopy_send_client": false, 00:21:01.774 "zerocopy_threshold": 0, 00:21:01.774 "tls_version": 0, 00:21:01.774 "enable_ktls": false 00:21:01.774 } 00:21:01.774 } 00:21:01.774 ] 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "subsystem": "vmd", 00:21:01.774 "config": [] 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "subsystem": "accel", 00:21:01.774 "config": [ 00:21:01.774 { 00:21:01.774 "method": "accel_set_options", 00:21:01.774 "params": { 00:21:01.774 "small_cache_size": 128, 00:21:01.774 "large_cache_size": 16, 00:21:01.774 "task_count": 2048, 00:21:01.774 "sequence_count": 2048, 00:21:01.774 "buf_count": 2048 00:21:01.774 } 00:21:01.774 } 00:21:01.774 ] 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "subsystem": "bdev", 00:21:01.774 "config": [ 00:21:01.774 { 00:21:01.774 "method": "bdev_set_options", 00:21:01.774 "params": { 00:21:01.774 "bdev_io_pool_size": 65535, 00:21:01.774 "bdev_io_cache_size": 256, 00:21:01.774 "bdev_auto_examine": true, 00:21:01.774 "iobuf_small_cache_size": 128, 00:21:01.774 "iobuf_large_cache_size": 16 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "bdev_raid_set_options", 00:21:01.774 "params": { 00:21:01.774 "process_window_size_kb": 1024 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "bdev_iscsi_set_options", 00:21:01.774 "params": { 00:21:01.774 "timeout_sec": 30 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "bdev_nvme_set_options", 00:21:01.774 "params": { 00:21:01.774 "action_on_timeout": "none", 00:21:01.774 "timeout_us": 0, 00:21:01.774 "timeout_admin_us": 0, 00:21:01.774 "keep_alive_timeout_ms": 10000, 00:21:01.774 "transport_retry_count": 4, 00:21:01.774 "arbitration_burst": 0, 00:21:01.774 "low_priority_weight": 0, 00:21:01.774 "medium_priority_weight": 0, 00:21:01.774 "high_priority_weight": 0, 00:21:01.774 "nvme_adminq_poll_period_us": 10000, 00:21:01.774 "nvme_ioq_poll_period_us": 0, 00:21:01.774 "io_queue_requests": 0, 00:21:01.774 "delay_cmd_submit": true, 00:21:01.774 "bdev_retry_count": 3, 00:21:01.774 "transport_ack_timeout": 0, 00:21:01.774 "ctrlr_loss_timeout_sec": 0, 00:21:01.774 "reconnect_delay_sec": 0, 00:21:01.774 "fast_io_fail_timeout_sec": 0, 00:21:01.774 "generate_uuids": false, 00:21:01.774 "transport_tos": 0, 00:21:01.774 "io_path_stat": false, 00:21:01.774 "allow_accel_sequence": false 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "bdev_nvme_set_hotplug", 00:21:01.774 "params": { 00:21:01.774 "period_us": 100000, 00:21:01.774 "enable": false 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "bdev_malloc_create", 00:21:01.774 "params": { 00:21:01.774 "name": "malloc0", 00:21:01.774 "num_blocks": 8192, 00:21:01.774 "block_size": 4096, 00:21:01.774 "physical_block_size": 4096, 00:21:01.774 "uuid": "d8de59c4-e010-4cfe-9e38-6fa13b82a9e0", 00:21:01.774 "optimal_io_boundary": 0 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "bdev_wait_for_examine" 00:21:01.774 } 00:21:01.774 ] 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "subsystem": "nbd", 00:21:01.774 "config": [] 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "subsystem": "scheduler", 00:21:01.774 "config": [ 00:21:01.774 { 00:21:01.774 "method": "framework_set_scheduler", 00:21:01.774 "params": { 00:21:01.774 "name": "static" 00:21:01.774 } 00:21:01.774 } 00:21:01.774 ] 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "subsystem": "nvmf", 00:21:01.774 "config": [ 00:21:01.774 { 00:21:01.774 "method": "nvmf_set_config", 00:21:01.774 "params": { 00:21:01.774 "discovery_filter": "match_any", 00:21:01.774 "admin_cmd_passthru": { 00:21:01.774 "identify_ctrlr": false 00:21:01.774 } 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "nvmf_set_max_subsystems", 00:21:01.774 "params": { 00:21:01.774 "max_subsystems": 1024 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "nvmf_set_crdt", 00:21:01.774 "params": { 00:21:01.774 "crdt1": 0, 00:21:01.774 "crdt2": 0, 00:21:01.774 "crdt3": 0 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "nvmf_create_transport", 00:21:01.774 "params": { 00:21:01.774 "trtype": "TCP", 00:21:01.774 "max_queue_depth": 128, 00:21:01.774 "max_io_qpairs_per_ctrlr": 127, 00:21:01.774 "in_capsule_data_size": 4096, 00:21:01.774 "max_io_size": 131072, 00:21:01.774 "io_unit_size": 131072, 00:21:01.774 "max_aq_depth": 128, 00:21:01.774 "num_shared_buffers": 511, 00:21:01.774 "buf_cache_size": 4294967295, 00:21:01.774 "dif_insert_or_strip": false, 00:21:01.774 "zcopy": false, 00:21:01.774 "c2h_success": false, 00:21:01.774 "sock_priority": 0, 00:21:01.774 "abort_timeout_sec": 1 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "nvmf_create_subsystem", 00:21:01.774 "params": { 00:21:01.774 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:01.774 "allow_any_host": false, 00:21:01.774 "serial_number": "SPDK00000000000001", 00:21:01.774 "model_number": "SPDK bdev Controller", 00:21:01.774 "max_namespaces": 10, 00:21:01.774 "min_cntlid": 1, 00:21:01.774 "max_cntlid": 65519, 00:21:01.774 "ana_reporting": false 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "nvmf_subsystem_add_host", 00:21:01.774 "params": { 00:21:01.774 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:01.774 "host": "nqn.2016-06.io.spdk:host1", 00:21:01.774 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:01.774 } 00:21:01.774 }, 00:21:01.774 { 00:21:01.774 "method": "nvmf_subsystem_add_ns", 00:21:01.774 "params": { 00:21:01.774 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:01.774 "namespace": { 00:21:01.774 "nsid": 1, 00:21:01.774 "bdev_name": "malloc0", 00:21:01.774 "nguid": "D8DE59C4E0104CFE9E386FA13B82A9E0", 00:21:01.774 "uuid": "d8de59c4-e010-4cfe-9e38-6fa13b82a9e0" 00:21:01.774 } 00:21:01.774 } 00:21:01.774 }, 00:21:01.775 { 00:21:01.775 "method": "nvmf_subsystem_add_listener", 00:21:01.775 "params": { 00:21:01.775 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:01.775 "listen_address": { 00:21:01.775 "trtype": "TCP", 00:21:01.775 "adrfam": "IPv4", 00:21:01.775 "traddr": "10.0.0.2", 00:21:01.775 "trsvcid": "4420" 00:21:01.775 }, 00:21:01.775 "secure_channel": true 00:21:01.775 } 00:21:01.775 } 00:21:01.775 ] 00:21:01.775 } 00:21:01.775 ] 00:21:01.775 }' 00:21:01.775 15:16:01 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:21:02.033 15:16:02 -- target/tls.sh@206 -- # bdevperfconf='{ 00:21:02.033 "subsystems": [ 00:21:02.033 { 00:21:02.033 "subsystem": "iobuf", 00:21:02.033 "config": [ 00:21:02.033 { 00:21:02.033 "method": "iobuf_set_options", 00:21:02.033 "params": { 00:21:02.033 "small_pool_count": 8192, 00:21:02.033 "large_pool_count": 1024, 00:21:02.033 "small_bufsize": 8192, 00:21:02.033 "large_bufsize": 135168 00:21:02.033 } 00:21:02.033 } 00:21:02.033 ] 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "subsystem": "sock", 00:21:02.033 "config": [ 00:21:02.033 { 00:21:02.033 "method": "sock_impl_set_options", 00:21:02.033 "params": { 00:21:02.033 "impl_name": "posix", 00:21:02.033 "recv_buf_size": 2097152, 00:21:02.033 "send_buf_size": 2097152, 00:21:02.033 "enable_recv_pipe": true, 00:21:02.033 "enable_quickack": false, 00:21:02.033 "enable_placement_id": 0, 00:21:02.033 "enable_zerocopy_send_server": true, 00:21:02.033 "enable_zerocopy_send_client": false, 00:21:02.033 "zerocopy_threshold": 0, 00:21:02.033 "tls_version": 0, 00:21:02.033 "enable_ktls": false 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "sock_impl_set_options", 00:21:02.033 "params": { 00:21:02.033 "impl_name": "ssl", 00:21:02.033 "recv_buf_size": 4096, 00:21:02.033 "send_buf_size": 4096, 00:21:02.033 "enable_recv_pipe": true, 00:21:02.033 "enable_quickack": false, 00:21:02.033 "enable_placement_id": 0, 00:21:02.033 "enable_zerocopy_send_server": true, 00:21:02.033 "enable_zerocopy_send_client": false, 00:21:02.033 "zerocopy_threshold": 0, 00:21:02.033 "tls_version": 0, 00:21:02.033 "enable_ktls": false 00:21:02.033 } 00:21:02.033 } 00:21:02.033 ] 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "subsystem": "vmd", 00:21:02.033 "config": [] 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "subsystem": "accel", 00:21:02.033 "config": [ 00:21:02.033 { 00:21:02.033 "method": "accel_set_options", 00:21:02.033 "params": { 00:21:02.033 "small_cache_size": 128, 00:21:02.033 "large_cache_size": 16, 00:21:02.033 "task_count": 2048, 00:21:02.033 "sequence_count": 2048, 00:21:02.033 "buf_count": 2048 00:21:02.033 } 00:21:02.033 } 00:21:02.033 ] 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "subsystem": "bdev", 00:21:02.033 "config": [ 00:21:02.033 { 00:21:02.033 "method": "bdev_set_options", 00:21:02.033 "params": { 00:21:02.033 "bdev_io_pool_size": 65535, 00:21:02.033 "bdev_io_cache_size": 256, 00:21:02.033 "bdev_auto_examine": true, 00:21:02.033 "iobuf_small_cache_size": 128, 00:21:02.033 "iobuf_large_cache_size": 16 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "bdev_raid_set_options", 00:21:02.033 "params": { 00:21:02.033 "process_window_size_kb": 1024 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "bdev_iscsi_set_options", 00:21:02.033 "params": { 00:21:02.033 "timeout_sec": 30 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "bdev_nvme_set_options", 00:21:02.033 "params": { 00:21:02.033 "action_on_timeout": "none", 00:21:02.033 "timeout_us": 0, 00:21:02.033 "timeout_admin_us": 0, 00:21:02.033 "keep_alive_timeout_ms": 10000, 00:21:02.033 "transport_retry_count": 4, 00:21:02.033 "arbitration_burst": 0, 00:21:02.033 "low_priority_weight": 0, 00:21:02.033 "medium_priority_weight": 0, 00:21:02.033 "high_priority_weight": 0, 00:21:02.033 "nvme_adminq_poll_period_us": 10000, 00:21:02.033 "nvme_ioq_poll_period_us": 0, 00:21:02.033 "io_queue_requests": 512, 00:21:02.033 "delay_cmd_submit": true, 00:21:02.033 "bdev_retry_count": 3, 00:21:02.033 "transport_ack_timeout": 0, 00:21:02.033 "ctrlr_loss_timeout_sec": 0, 00:21:02.033 "reconnect_delay_sec": 0, 00:21:02.033 "fast_io_fail_timeout_sec": 0, 00:21:02.033 "generate_uuids": false, 00:21:02.033 "transport_tos": 0, 00:21:02.033 "io_path_stat": false, 00:21:02.033 "allow_accel_sequence": false 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "bdev_nvme_attach_controller", 00:21:02.033 "params": { 00:21:02.033 "name": "TLSTEST", 00:21:02.033 "trtype": "TCP", 00:21:02.033 "adrfam": "IPv4", 00:21:02.033 "traddr": "10.0.0.2", 00:21:02.033 "trsvcid": "4420", 00:21:02.033 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:02.033 "prchk_reftag": false, 00:21:02.033 "prchk_guard": false, 00:21:02.033 "ctrlr_loss_timeout_sec": 0, 00:21:02.033 "reconnect_delay_sec": 0, 00:21:02.033 "fast_io_fail_timeout_sec": 0, 00:21:02.033 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:02.033 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:02.033 "hdgst": false, 00:21:02.033 "ddgst": false 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "bdev_nvme_set_hotplug", 00:21:02.033 "params": { 00:21:02.033 "period_us": 100000, 00:21:02.033 "enable": false 00:21:02.033 } 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "method": "bdev_wait_for_examine" 00:21:02.033 } 00:21:02.033 ] 00:21:02.033 }, 00:21:02.033 { 00:21:02.033 "subsystem": "nbd", 00:21:02.033 "config": [] 00:21:02.033 } 00:21:02.033 ] 00:21:02.033 }' 00:21:02.033 15:16:02 -- target/tls.sh@208 -- # killprocess 741831 00:21:02.033 15:16:02 -- common/autotest_common.sh@936 -- # '[' -z 741831 ']' 00:21:02.033 15:16:02 -- common/autotest_common.sh@940 -- # kill -0 741831 00:21:02.033 15:16:02 -- common/autotest_common.sh@941 -- # uname 00:21:02.033 15:16:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.033 15:16:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 741831 00:21:02.033 15:16:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:02.034 15:16:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:02.034 15:16:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 741831' 00:21:02.034 killing process with pid 741831 00:21:02.034 15:16:02 -- common/autotest_common.sh@955 -- # kill 741831 00:21:02.034 Received shutdown signal, test time was about 10.000000 seconds 00:21:02.034 00:21:02.034 Latency(us) 00:21:02.034 [2024-11-28T14:16:02.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:02.034 [2024-11-28T14:16:02.268Z] =================================================================================================================== 00:21:02.034 [2024-11-28T14:16:02.268Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:21:02.034 15:16:02 -- common/autotest_common.sh@960 -- # wait 741831 00:21:02.292 15:16:02 -- target/tls.sh@209 -- # killprocess 741530 00:21:02.292 15:16:02 -- common/autotest_common.sh@936 -- # '[' -z 741530 ']' 00:21:02.292 15:16:02 -- common/autotest_common.sh@940 -- # kill -0 741530 00:21:02.292 15:16:02 -- common/autotest_common.sh@941 -- # uname 00:21:02.292 15:16:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:02.292 15:16:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 741530 00:21:02.292 15:16:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:02.292 15:16:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:02.292 15:16:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 741530' 00:21:02.292 killing process with pid 741530 00:21:02.292 15:16:02 -- common/autotest_common.sh@955 -- # kill 741530 00:21:02.292 15:16:02 -- common/autotest_common.sh@960 -- # wait 741530 00:21:02.552 15:16:02 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:02.552 15:16:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:02.552 15:16:02 -- target/tls.sh@212 -- # echo '{ 00:21:02.552 "subsystems": [ 00:21:02.552 { 00:21:02.552 "subsystem": "iobuf", 00:21:02.552 "config": [ 00:21:02.552 { 00:21:02.552 "method": "iobuf_set_options", 00:21:02.552 "params": { 00:21:02.552 "small_pool_count": 8192, 00:21:02.552 "large_pool_count": 1024, 00:21:02.552 "small_bufsize": 8192, 00:21:02.552 "large_bufsize": 135168 00:21:02.552 } 00:21:02.552 } 00:21:02.552 ] 00:21:02.552 }, 00:21:02.552 { 00:21:02.552 "subsystem": "sock", 00:21:02.552 "config": [ 00:21:02.552 { 00:21:02.552 "method": "sock_impl_set_options", 00:21:02.552 "params": { 00:21:02.552 "impl_name": "posix", 00:21:02.552 "recv_buf_size": 2097152, 00:21:02.552 "send_buf_size": 2097152, 00:21:02.552 "enable_recv_pipe": true, 00:21:02.552 "enable_quickack": false, 00:21:02.552 "enable_placement_id": 0, 00:21:02.552 "enable_zerocopy_send_server": true, 00:21:02.552 "enable_zerocopy_send_client": false, 00:21:02.552 "zerocopy_threshold": 0, 00:21:02.552 "tls_version": 0, 00:21:02.552 "enable_ktls": false 00:21:02.552 } 00:21:02.552 }, 00:21:02.552 { 00:21:02.552 "method": "sock_impl_set_options", 00:21:02.552 "params": { 00:21:02.552 "impl_name": "ssl", 00:21:02.552 "recv_buf_size": 4096, 00:21:02.552 "send_buf_size": 4096, 00:21:02.552 "enable_recv_pipe": true, 00:21:02.552 "enable_quickack": false, 00:21:02.552 "enable_placement_id": 0, 00:21:02.552 "enable_zerocopy_send_server": true, 00:21:02.552 "enable_zerocopy_send_client": false, 00:21:02.552 "zerocopy_threshold": 0, 00:21:02.552 "tls_version": 0, 00:21:02.552 "enable_ktls": false 00:21:02.552 } 00:21:02.552 } 00:21:02.552 ] 00:21:02.552 }, 00:21:02.552 { 00:21:02.552 "subsystem": "vmd", 00:21:02.552 "config": [] 00:21:02.552 }, 00:21:02.552 { 00:21:02.552 "subsystem": "accel", 00:21:02.552 "config": [ 00:21:02.552 { 00:21:02.552 "method": "accel_set_options", 00:21:02.552 "params": { 00:21:02.552 "small_cache_size": 128, 00:21:02.552 "large_cache_size": 16, 00:21:02.552 "task_count": 2048, 00:21:02.552 "sequence_count": 2048, 00:21:02.552 "buf_count": 2048 00:21:02.552 } 00:21:02.552 } 00:21:02.552 ] 00:21:02.552 }, 00:21:02.552 { 00:21:02.552 "subsystem": "bdev", 00:21:02.552 "config": [ 00:21:02.552 { 00:21:02.552 "method": "bdev_set_options", 00:21:02.552 "params": { 00:21:02.552 "bdev_io_pool_size": 65535, 00:21:02.552 "bdev_io_cache_size": 256, 00:21:02.552 "bdev_auto_examine": true, 00:21:02.552 "iobuf_small_cache_size": 128, 00:21:02.552 "iobuf_large_cache_size": 16 00:21:02.552 } 00:21:02.552 }, 00:21:02.552 { 00:21:02.552 "method": "bdev_raid_set_options", 00:21:02.552 "params": { 00:21:02.552 "process_window_size_kb": 1024 00:21:02.552 } 00:21:02.552 }, 00:21:02.553 { 00:21:02.553 "method": "bdev_iscsi_set_options", 00:21:02.553 "params": { 00:21:02.553 "timeout_sec": 30 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "bdev_nvme_set_options", 00:21:02.553 "params": { 00:21:02.553 "action_on_timeout": "none", 00:21:02.553 "timeout_us": 0, 00:21:02.553 "timeout_admin_us": 0, 00:21:02.553 "keep_alive_timeout_ms": 10000, 00:21:02.553 "transport_retry_count": 4, 00:21:02.553 "arbitration_burst": 0, 00:21:02.553 "low_priority_weight": 0, 00:21:02.553 "medium_priority_weight": 0, 00:21:02.553 "high_priority_weight": 0, 00:21:02.553 "nvme_adminq_poll_period_us": 10000, 00:21:02.553 "nvme_ioq_poll_period_us": 0, 00:21:02.553 "io_queue_requests": 0, 00:21:02.553 "delay_cmd_submit": true, 00:21:02.553 "bdev_retry_count": 3, 00:21:02.553 "transport_ack_timeout": 0, 00:21:02.553 "ctrlr_loss_timeout_sec": 0, 00:21:02.553 "reconnect_delay_sec": 0, 00:21:02.553 "fast_io_fail_timeout_sec": 0, 00:21:02.553 "generate_uuids": false, 00:21:02.553 "transport_tos": 0, 00:21:02.553 "io_path_stat": false, 00:21:02.553 "allow_accel_sequence": false 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "bdev_nvme_set_hotplug", 00:21:02.553 "params": { 00:21:02.553 "period_us": 100000, 00:21:02.553 "enable": false 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "bdev_malloc_create", 00:21:02.553 "params": { 00:21:02.553 "name": "malloc0", 00:21:02.553 "num_blocks": 8192, 00:21:02.553 "block_size": 4096, 00:21:02.553 "physical_block_size": 4096, 00:21:02.553 "uuid": "d8de59c4-e010-4cfe-9e38-6fa13b82a9e0", 00:21:02.553 "optimal_io_boundary": 0 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "bdev_wait_for_examine" 00:21:02.553 } 00:21:02.553 ] 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "subsystem": "nbd", 00:21:02.553 "config": [] 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "subsystem": "scheduler", 00:21:02.553 "config": [ 00:21:02.553 { 00:21:02.553 "method": "framework_set_scheduler", 00:21:02.553 "params": { 00:21:02.553 "name": "static" 00:21:02.553 } 00:21:02.553 } 00:21:02.553 ] 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "subsystem": "nvmf", 00:21:02.553 "config": [ 00:21:02.553 { 00:21:02.553 "method": "nvmf_set_config", 00:21:02.553 "params": { 00:21:02.553 "discovery_filter": "match_any", 00:21:02.553 "admin_cmd_passthru": { 00:21:02.553 "identify_ctrlr": false 00:21:02.553 } 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_set_max_subsystems", 00:21:02.553 "params": { 00:21:02.553 "max_subsystems": 1024 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_set_crdt", 00:21:02.553 "params": { 00:21:02.553 "crdt1": 0, 00:21:02.553 "crdt2": 0, 00:21:02.553 "crdt3": 0 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_create_transport", 00:21:02.553 "params": { 00:21:02.553 "trtype": "TCP", 00:21:02.553 "max_queue_depth": 128, 00:21:02.553 "max_io_qpairs_per_ctrlr": 127, 00:21:02.553 "in_capsule_data_size": 4096, 00:21:02.553 "max_io_size": 131072, 00:21:02.553 "io_unit_size": 131072, 00:21:02.553 "max_aq_depth": 128, 00:21:02.553 "num_shared_buffers": 511, 00:21:02.553 "buf_cache_size": 4294967295, 00:21:02.553 "dif_insert_or_strip": false, 00:21:02.553 "zcopy": false, 00:21:02.553 "c2h_success": false, 00:21:02.553 "sock_priority": 0, 00:21:02.553 "abort_timeout_sec": 1 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_create_subsystem", 00:21:02.553 "params": { 00:21:02.553 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:02.553 "allow_any_host": false, 00:21:02.553 "serial_number": "SPDK00000000000001", 00:21:02.553 "model_number": "SPDK bdev Controller", 00:21:02.553 "max_namespaces": 10, 00:21:02.553 "min_cntlid": 1, 00:21:02.553 "max_cntlid": 65519, 00:21:02.553 "ana_reporting": false 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_subsystem_add_host", 00:21:02.553 "params": { 00:21:02.553 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:02.553 "host": "nqn.2016-06.io.spdk:host1", 00:21:02.553 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_subsystem_add_ns", 00:21:02.553 "params": { 00:21:02.553 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:02.553 "namespace": { 00:21:02.553 "nsid": 1, 00:21:02.553 "bdev_name": "malloc0", 00:21:02.553 "nguid": "D8DE59C4E0104CFE9E386FA13B82A9E0", 00:21:02.553 "uuid": "d8de59c4-e010-4cfe-9e38-6fa13b82a9e0" 00:21:02.553 } 00:21:02.553 } 00:21:02.553 }, 00:21:02.553 { 00:21:02.553 "method": "nvmf_subsystem_add_listener", 00:21:02.553 "params": { 00:21:02.553 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:02.553 "listen_address": { 00:21:02.553 "trtype": "TCP", 00:21:02.553 "adrfam": "IPv4", 00:21:02.553 "traddr": "10.0.0.2", 00:21:02.553 "trsvcid": "4420" 00:21:02.553 }, 00:21:02.553 "secure_channel": true 00:21:02.553 } 00:21:02.553 } 00:21:02.553 ] 00:21:02.553 } 00:21:02.553 ] 00:21:02.553 }' 00:21:02.553 15:16:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:02.553 15:16:02 -- common/autotest_common.sh@10 -- # set +x 00:21:02.553 15:16:02 -- nvmf/common.sh@469 -- # nvmfpid=742128 00:21:02.553 15:16:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:02.553 15:16:02 -- nvmf/common.sh@470 -- # waitforlisten 742128 00:21:02.553 15:16:02 -- common/autotest_common.sh@829 -- # '[' -z 742128 ']' 00:21:02.553 15:16:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:02.553 15:16:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:02.553 15:16:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:02.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:02.553 15:16:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:02.553 15:16:02 -- common/autotest_common.sh@10 -- # set +x 00:21:02.812 [2024-11-28 15:16:02.823264] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:02.812 [2024-11-28 15:16:02.823351] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:02.812 EAL: No free 2048 kB hugepages reported on node 1 00:21:02.812 [2024-11-28 15:16:02.891123] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:02.812 [2024-11-28 15:16:02.979432] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:02.812 [2024-11-28 15:16:02.979612] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:02.812 [2024-11-28 15:16:02.979635] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:02.812 [2024-11-28 15:16:02.979650] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:02.812 [2024-11-28 15:16:02.979681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:03.070 [2024-11-28 15:16:03.202033] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:03.070 [2024-11-28 15:16:03.234054] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:03.070 [2024-11-28 15:16:03.234331] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:03.635 15:16:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:03.636 15:16:03 -- common/autotest_common.sh@862 -- # return 0 00:21:03.636 15:16:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:03.636 15:16:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:03.636 15:16:03 -- common/autotest_common.sh@10 -- # set +x 00:21:03.636 15:16:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:03.636 15:16:03 -- target/tls.sh@216 -- # bdevperf_pid=742284 00:21:03.636 15:16:03 -- target/tls.sh@217 -- # waitforlisten 742284 /var/tmp/bdevperf.sock 00:21:03.636 15:16:03 -- common/autotest_common.sh@829 -- # '[' -z 742284 ']' 00:21:03.636 15:16:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:03.636 15:16:03 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:03.636 15:16:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:03.636 15:16:03 -- target/tls.sh@213 -- # echo '{ 00:21:03.636 "subsystems": [ 00:21:03.636 { 00:21:03.636 "subsystem": "iobuf", 00:21:03.636 "config": [ 00:21:03.636 { 00:21:03.636 "method": "iobuf_set_options", 00:21:03.636 "params": { 00:21:03.636 "small_pool_count": 8192, 00:21:03.636 "large_pool_count": 1024, 00:21:03.636 "small_bufsize": 8192, 00:21:03.636 "large_bufsize": 135168 00:21:03.636 } 00:21:03.636 } 00:21:03.636 ] 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "subsystem": "sock", 00:21:03.636 "config": [ 00:21:03.636 { 00:21:03.636 "method": "sock_impl_set_options", 00:21:03.636 "params": { 00:21:03.636 "impl_name": "posix", 00:21:03.636 "recv_buf_size": 2097152, 00:21:03.636 "send_buf_size": 2097152, 00:21:03.636 "enable_recv_pipe": true, 00:21:03.636 "enable_quickack": false, 00:21:03.636 "enable_placement_id": 0, 00:21:03.636 "enable_zerocopy_send_server": true, 00:21:03.636 "enable_zerocopy_send_client": false, 00:21:03.636 "zerocopy_threshold": 0, 00:21:03.636 "tls_version": 0, 00:21:03.636 "enable_ktls": false 00:21:03.636 } 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "method": "sock_impl_set_options", 00:21:03.636 "params": { 00:21:03.636 "impl_name": "ssl", 00:21:03.636 "recv_buf_size": 4096, 00:21:03.636 "send_buf_size": 4096, 00:21:03.636 "enable_recv_pipe": true, 00:21:03.636 "enable_quickack": false, 00:21:03.636 "enable_placement_id": 0, 00:21:03.636 "enable_zerocopy_send_server": true, 00:21:03.636 "enable_zerocopy_send_client": false, 00:21:03.636 "zerocopy_threshold": 0, 00:21:03.636 "tls_version": 0, 00:21:03.636 "enable_ktls": false 00:21:03.636 } 00:21:03.636 } 00:21:03.636 ] 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "subsystem": "vmd", 00:21:03.636 "config": [] 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "subsystem": "accel", 00:21:03.636 "config": [ 00:21:03.636 { 00:21:03.636 "method": "accel_set_options", 00:21:03.636 "params": { 00:21:03.636 "small_cache_size": 128, 00:21:03.636 "large_cache_size": 16, 00:21:03.636 "task_count": 2048, 00:21:03.636 "sequence_count": 2048, 00:21:03.636 "buf_count": 2048 00:21:03.636 } 00:21:03.636 } 00:21:03.636 ] 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "subsystem": "bdev", 00:21:03.636 "config": [ 00:21:03.636 { 00:21:03.636 "method": "bdev_set_options", 00:21:03.636 "params": { 00:21:03.636 "bdev_io_pool_size": 65535, 00:21:03.636 "bdev_io_cache_size": 256, 00:21:03.636 "bdev_auto_examine": true, 00:21:03.636 "iobuf_small_cache_size": 128, 00:21:03.636 "iobuf_large_cache_size": 16 00:21:03.636 } 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "method": "bdev_raid_set_options", 00:21:03.636 "params": { 00:21:03.636 "process_window_size_kb": 1024 00:21:03.636 } 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "method": "bdev_iscsi_set_options", 00:21:03.636 "params": { 00:21:03.636 "timeout_sec": 30 00:21:03.636 } 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "method": "bdev_nvme_set_options", 00:21:03.636 "params": { 00:21:03.636 "action_on_timeout": "none", 00:21:03.636 "timeout_us": 0, 00:21:03.636 "timeout_admin_us": 0, 00:21:03.636 "keep_alive_timeout_ms": 10000, 00:21:03.636 "transport_retry_count": 4, 00:21:03.636 "arbitration_burst": 0, 00:21:03.636 "low_priority_weight": 0, 00:21:03.636 "medium_priority_weight": 0, 00:21:03.636 "high_priority_weight": 0, 00:21:03.636 "nvme_adminq_poll_period_us": 10000, 00:21:03.636 "nvme_ioq_poll_period_us": 0, 00:21:03.636 "io_queue_requests": 512, 00:21:03.636 "delay_cmd_submit": true, 00:21:03.636 "bdev_retry_count": 3, 00:21:03.636 "transport_ack_timeout": 0, 00:21:03.636 "ctrlr_loss_timeout_sec": 0, 00:21:03.636 "reconnect_delay_sec": 0, 00:21:03.636 "fast_io_fail_timeout_sec": 0, 00:21:03.636 "generate_uuids": false, 00:21:03.636 "transport_tos": 0, 00:21:03.636 "io_path_stat": false, 00:21:03.636 "allow_accel_sequence": false 00:21:03.636 } 00:21:03.636 }, 00:21:03.636 { 00:21:03.636 "method": "bdev_nvme_attach_controller", 00:21:03.636 "params": { 00:21:03.636 "name": "TLSTEST", 00:21:03.636 "trtype": "TCP", 00:21:03.636 "adrfam": "IPv4", 00:21:03.636 "traddr": "10.0.0.2", 00:21:03.636 "trsvcid": "4420", 00:21:03.636 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:03.636 "prchk_reftag": false, 00:21:03.637 "prchk_guard": false, 00:21:03.637 "ctrlr_loss_timeout_sec": 0, 00:21:03.637 "reconnect_delay_sec": 0, 00:21:03.637 "fast_io_fail_timeout_sec": 0, 00:21:03.637 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:03.637 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:03.637 "hdgst": false, 00:21:03.637 "ddgst": false 00:21:03.637 } 00:21:03.637 }, 00:21:03.637 { 00:21:03.637 "method": "bdev_nvme_set_hotplug", 00:21:03.637 "params": { 00:21:03.637 "period_us": 100000, 00:21:03.637 "enable": false 00:21:03.637 } 00:21:03.637 }, 00:21:03.637 { 00:21:03.637 "method": "bdev_wait_for_examine" 00:21:03.637 } 00:21:03.637 ] 00:21:03.637 }, 00:21:03.637 { 00:21:03.637 "subsystem": "nbd", 00:21:03.637 "config": [] 00:21:03.637 } 00:21:03.637 ] 00:21:03.637 }' 00:21:03.637 15:16:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:03.637 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:03.637 15:16:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:03.637 15:16:03 -- common/autotest_common.sh@10 -- # set +x 00:21:03.637 [2024-11-28 15:16:03.835019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:03.637 [2024-11-28 15:16:03.835120] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid742284 ] 00:21:03.637 EAL: No free 2048 kB hugepages reported on node 1 00:21:03.895 [2024-11-28 15:16:03.892537] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:03.895 [2024-11-28 15:16:03.973642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:04.153 [2024-11-28 15:16:04.134349] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:04.721 15:16:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:04.721 15:16:04 -- common/autotest_common.sh@862 -- # return 0 00:21:04.721 15:16:04 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:04.721 Running I/O for 10 seconds... 00:21:16.917 00:21:16.917 Latency(us) 00:21:16.917 [2024-11-28T14:16:17.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:16.917 [2024-11-28T14:16:17.151Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:16.917 Verification LBA range: start 0x0 length 0x2000 00:21:16.917 TLSTESTn1 : 10.03 4645.40 18.15 0.00 0.00 27511.19 7184.69 46215.02 00:21:16.917 [2024-11-28T14:16:17.151Z] =================================================================================================================== 00:21:16.917 [2024-11-28T14:16:17.151Z] Total : 4645.40 18.15 0.00 0.00 27511.19 7184.69 46215.02 00:21:16.917 0 00:21:16.917 15:16:14 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:16.917 15:16:14 -- target/tls.sh@223 -- # killprocess 742284 00:21:16.917 15:16:14 -- common/autotest_common.sh@936 -- # '[' -z 742284 ']' 00:21:16.917 15:16:14 -- common/autotest_common.sh@940 -- # kill -0 742284 00:21:16.917 15:16:14 -- common/autotest_common.sh@941 -- # uname 00:21:16.917 15:16:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:16.917 15:16:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 742284 00:21:16.917 15:16:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:16.917 15:16:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:16.917 15:16:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 742284' 00:21:16.917 killing process with pid 742284 00:21:16.917 15:16:14 -- common/autotest_common.sh@955 -- # kill 742284 00:21:16.917 Received shutdown signal, test time was about 10.000000 seconds 00:21:16.917 00:21:16.917 Latency(us) 00:21:16.917 [2024-11-28T14:16:17.151Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:16.917 [2024-11-28T14:16:17.151Z] =================================================================================================================== 00:21:16.917 [2024-11-28T14:16:17.151Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:16.917 15:16:14 -- common/autotest_common.sh@960 -- # wait 742284 00:21:16.917 15:16:15 -- target/tls.sh@224 -- # killprocess 742128 00:21:16.917 15:16:15 -- common/autotest_common.sh@936 -- # '[' -z 742128 ']' 00:21:16.917 15:16:15 -- common/autotest_common.sh@940 -- # kill -0 742128 00:21:16.917 15:16:15 -- common/autotest_common.sh@941 -- # uname 00:21:16.917 15:16:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:16.917 15:16:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 742128 00:21:16.917 15:16:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:16.917 15:16:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:16.917 15:16:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 742128' 00:21:16.917 killing process with pid 742128 00:21:16.917 15:16:15 -- common/autotest_common.sh@955 -- # kill 742128 00:21:16.917 15:16:15 -- common/autotest_common.sh@960 -- # wait 742128 00:21:16.917 15:16:15 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:16.917 15:16:15 -- target/tls.sh@227 -- # cleanup 00:21:16.917 15:16:15 -- target/tls.sh@15 -- # process_shm --id 0 00:21:16.917 15:16:15 -- common/autotest_common.sh@806 -- # type=--id 00:21:16.917 15:16:15 -- common/autotest_common.sh@807 -- # id=0 00:21:16.917 15:16:15 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:16.917 15:16:15 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:16.917 15:16:15 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:16.917 15:16:15 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:16.917 15:16:15 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:16.917 15:16:15 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:16.917 nvmf_trace.0 00:21:16.917 15:16:15 -- common/autotest_common.sh@821 -- # return 0 00:21:16.917 15:16:15 -- target/tls.sh@16 -- # killprocess 742284 00:21:16.917 15:16:15 -- common/autotest_common.sh@936 -- # '[' -z 742284 ']' 00:21:16.917 15:16:15 -- common/autotest_common.sh@940 -- # kill -0 742284 00:21:16.917 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (742284) - No such process 00:21:16.917 15:16:15 -- common/autotest_common.sh@963 -- # echo 'Process with pid 742284 is not found' 00:21:16.917 Process with pid 742284 is not found 00:21:16.917 15:16:15 -- target/tls.sh@17 -- # nvmftestfini 00:21:16.917 15:16:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:16.917 15:16:15 -- nvmf/common.sh@116 -- # sync 00:21:16.917 15:16:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:16.917 15:16:15 -- nvmf/common.sh@119 -- # set +e 00:21:16.917 15:16:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:16.917 15:16:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:16.917 rmmod nvme_tcp 00:21:16.917 rmmod nvme_fabrics 00:21:16.917 rmmod nvme_keyring 00:21:16.917 15:16:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:16.917 15:16:15 -- nvmf/common.sh@123 -- # set -e 00:21:16.917 15:16:15 -- nvmf/common.sh@124 -- # return 0 00:21:16.917 15:16:15 -- nvmf/common.sh@477 -- # '[' -n 742128 ']' 00:21:16.917 15:16:15 -- nvmf/common.sh@478 -- # killprocess 742128 00:21:16.917 15:16:15 -- common/autotest_common.sh@936 -- # '[' -z 742128 ']' 00:21:16.917 15:16:15 -- common/autotest_common.sh@940 -- # kill -0 742128 00:21:16.917 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (742128) - No such process 00:21:16.917 15:16:15 -- common/autotest_common.sh@963 -- # echo 'Process with pid 742128 is not found' 00:21:16.917 Process with pid 742128 is not found 00:21:16.917 15:16:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:16.917 15:16:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:16.917 15:16:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:16.917 15:16:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:16.917 15:16:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:16.917 15:16:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:16.917 15:16:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:16.917 15:16:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:17.485 15:16:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:17.485 15:16:17 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:17.485 00:21:17.485 real 1m15.176s 00:21:17.485 user 1m59.315s 00:21:17.485 sys 0m23.828s 00:21:17.485 15:16:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:17.485 15:16:17 -- common/autotest_common.sh@10 -- # set +x 00:21:17.485 ************************************ 00:21:17.485 END TEST nvmf_tls 00:21:17.485 ************************************ 00:21:17.485 15:16:17 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:17.485 15:16:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:17.485 15:16:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:17.485 15:16:17 -- common/autotest_common.sh@10 -- # set +x 00:21:17.485 ************************************ 00:21:17.485 START TEST nvmf_fips 00:21:17.485 ************************************ 00:21:17.485 15:16:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:17.744 * Looking for test storage... 00:21:17.744 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:17.744 15:16:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:17.744 15:16:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:17.744 15:16:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:17.744 15:16:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:17.745 15:16:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:17.745 15:16:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:17.745 15:16:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:17.745 15:16:17 -- scripts/common.sh@335 -- # IFS=.-: 00:21:17.745 15:16:17 -- scripts/common.sh@335 -- # read -ra ver1 00:21:17.745 15:16:17 -- scripts/common.sh@336 -- # IFS=.-: 00:21:17.745 15:16:17 -- scripts/common.sh@336 -- # read -ra ver2 00:21:17.745 15:16:17 -- scripts/common.sh@337 -- # local 'op=<' 00:21:17.745 15:16:17 -- scripts/common.sh@339 -- # ver1_l=2 00:21:17.745 15:16:17 -- scripts/common.sh@340 -- # ver2_l=1 00:21:17.745 15:16:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:17.745 15:16:17 -- scripts/common.sh@343 -- # case "$op" in 00:21:17.745 15:16:17 -- scripts/common.sh@344 -- # : 1 00:21:17.745 15:16:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:17.745 15:16:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:17.745 15:16:17 -- scripts/common.sh@364 -- # decimal 1 00:21:17.745 15:16:17 -- scripts/common.sh@352 -- # local d=1 00:21:17.745 15:16:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:17.745 15:16:17 -- scripts/common.sh@354 -- # echo 1 00:21:17.745 15:16:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:17.745 15:16:17 -- scripts/common.sh@365 -- # decimal 2 00:21:17.745 15:16:17 -- scripts/common.sh@352 -- # local d=2 00:21:17.745 15:16:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:17.745 15:16:17 -- scripts/common.sh@354 -- # echo 2 00:21:17.745 15:16:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:17.745 15:16:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:17.745 15:16:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:17.745 15:16:17 -- scripts/common.sh@367 -- # return 0 00:21:17.745 15:16:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:17.745 15:16:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:17.745 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:17.745 --rc genhtml_branch_coverage=1 00:21:17.745 --rc genhtml_function_coverage=1 00:21:17.745 --rc genhtml_legend=1 00:21:17.745 --rc geninfo_all_blocks=1 00:21:17.745 --rc geninfo_unexecuted_blocks=1 00:21:17.745 00:21:17.745 ' 00:21:17.745 15:16:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:17.745 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:17.745 --rc genhtml_branch_coverage=1 00:21:17.745 --rc genhtml_function_coverage=1 00:21:17.745 --rc genhtml_legend=1 00:21:17.745 --rc geninfo_all_blocks=1 00:21:17.745 --rc geninfo_unexecuted_blocks=1 00:21:17.745 00:21:17.745 ' 00:21:17.745 15:16:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:17.745 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:17.745 --rc genhtml_branch_coverage=1 00:21:17.745 --rc genhtml_function_coverage=1 00:21:17.745 --rc genhtml_legend=1 00:21:17.745 --rc geninfo_all_blocks=1 00:21:17.745 --rc geninfo_unexecuted_blocks=1 00:21:17.745 00:21:17.745 ' 00:21:17.745 15:16:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:17.745 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:17.745 --rc genhtml_branch_coverage=1 00:21:17.745 --rc genhtml_function_coverage=1 00:21:17.745 --rc genhtml_legend=1 00:21:17.745 --rc geninfo_all_blocks=1 00:21:17.745 --rc geninfo_unexecuted_blocks=1 00:21:17.745 00:21:17.745 ' 00:21:17.745 15:16:17 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:17.745 15:16:17 -- nvmf/common.sh@7 -- # uname -s 00:21:17.745 15:16:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:17.745 15:16:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:17.745 15:16:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:17.745 15:16:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:17.745 15:16:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:17.745 15:16:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:17.745 15:16:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:17.745 15:16:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:17.745 15:16:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:17.745 15:16:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:17.745 15:16:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:17.745 15:16:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:17.745 15:16:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:17.745 15:16:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:17.745 15:16:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:17.745 15:16:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:17.745 15:16:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:17.745 15:16:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:17.745 15:16:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:17.745 15:16:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:17.745 15:16:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:17.745 15:16:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:17.745 15:16:17 -- paths/export.sh@5 -- # export PATH 00:21:17.745 15:16:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:17.745 15:16:17 -- nvmf/common.sh@46 -- # : 0 00:21:17.745 15:16:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:17.745 15:16:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:17.745 15:16:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:17.745 15:16:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:17.745 15:16:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:17.745 15:16:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:17.745 15:16:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:17.745 15:16:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:17.745 15:16:17 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:17.745 15:16:17 -- fips/fips.sh@89 -- # check_openssl_version 00:21:17.745 15:16:17 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:17.745 15:16:17 -- fips/fips.sh@85 -- # openssl version 00:21:17.745 15:16:17 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:17.745 15:16:17 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:17.745 15:16:17 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:17.745 15:16:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:17.745 15:16:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:17.745 15:16:17 -- scripts/common.sh@335 -- # IFS=.-: 00:21:17.745 15:16:17 -- scripts/common.sh@335 -- # read -ra ver1 00:21:17.745 15:16:17 -- scripts/common.sh@336 -- # IFS=.-: 00:21:17.745 15:16:17 -- scripts/common.sh@336 -- # read -ra ver2 00:21:17.745 15:16:17 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:17.745 15:16:17 -- scripts/common.sh@339 -- # ver1_l=3 00:21:17.745 15:16:17 -- scripts/common.sh@340 -- # ver2_l=3 00:21:17.746 15:16:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:17.746 15:16:17 -- scripts/common.sh@343 -- # case "$op" in 00:21:17.746 15:16:17 -- scripts/common.sh@347 -- # : 1 00:21:17.746 15:16:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:17.746 15:16:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:17.746 15:16:17 -- scripts/common.sh@364 -- # decimal 3 00:21:17.746 15:16:17 -- scripts/common.sh@352 -- # local d=3 00:21:17.746 15:16:17 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:17.746 15:16:17 -- scripts/common.sh@354 -- # echo 3 00:21:17.746 15:16:17 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:17.746 15:16:17 -- scripts/common.sh@365 -- # decimal 3 00:21:17.746 15:16:17 -- scripts/common.sh@352 -- # local d=3 00:21:17.746 15:16:17 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:17.746 15:16:17 -- scripts/common.sh@354 -- # echo 3 00:21:17.746 15:16:17 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:17.746 15:16:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:17.746 15:16:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:17.746 15:16:17 -- scripts/common.sh@363 -- # (( v++ )) 00:21:17.746 15:16:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:17.746 15:16:17 -- scripts/common.sh@364 -- # decimal 1 00:21:17.746 15:16:17 -- scripts/common.sh@352 -- # local d=1 00:21:17.746 15:16:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:17.746 15:16:17 -- scripts/common.sh@354 -- # echo 1 00:21:17.746 15:16:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:17.746 15:16:17 -- scripts/common.sh@365 -- # decimal 0 00:21:17.746 15:16:17 -- scripts/common.sh@352 -- # local d=0 00:21:17.746 15:16:17 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:17.746 15:16:17 -- scripts/common.sh@354 -- # echo 0 00:21:17.746 15:16:17 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:17.746 15:16:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:17.746 15:16:17 -- scripts/common.sh@366 -- # return 0 00:21:17.746 15:16:17 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:17.746 15:16:17 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:17.746 15:16:17 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:17.746 15:16:17 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:17.746 15:16:17 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:17.746 15:16:17 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:17.746 15:16:17 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:17.746 15:16:17 -- fips/fips.sh@113 -- # build_openssl_config 00:21:17.746 15:16:17 -- fips/fips.sh@37 -- # cat 00:21:17.746 15:16:17 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:17.746 15:16:17 -- fips/fips.sh@58 -- # cat - 00:21:17.746 15:16:17 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:17.746 15:16:17 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:17.746 15:16:17 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:17.746 15:16:17 -- fips/fips.sh@116 -- # openssl list -providers 00:21:17.746 15:16:17 -- fips/fips.sh@116 -- # grep name 00:21:17.746 15:16:17 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:17.746 15:16:17 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:17.746 15:16:17 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:17.746 15:16:17 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:17.746 15:16:17 -- fips/fips.sh@127 -- # : 00:21:17.746 15:16:17 -- common/autotest_common.sh@650 -- # local es=0 00:21:17.746 15:16:17 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:17.746 15:16:17 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:17.746 15:16:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:17.746 15:16:17 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:17.746 15:16:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:17.746 15:16:17 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:17.746 15:16:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:17.746 15:16:17 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:17.746 15:16:17 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:17.746 15:16:17 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:17.746 Error setting digest 00:21:17.746 40821A701C7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:17.746 40821A701C7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:17.746 15:16:17 -- common/autotest_common.sh@653 -- # es=1 00:21:17.746 15:16:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:17.746 15:16:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:17.746 15:16:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:17.746 15:16:17 -- fips/fips.sh@130 -- # nvmftestinit 00:21:17.746 15:16:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:17.746 15:16:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:17.746 15:16:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:17.746 15:16:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:17.746 15:16:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:17.746 15:16:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:17.746 15:16:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:17.746 15:16:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:17.746 15:16:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:17.746 15:16:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:17.746 15:16:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:17.746 15:16:17 -- common/autotest_common.sh@10 -- # set +x 00:21:20.277 15:16:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:20.277 15:16:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:20.277 15:16:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:20.277 15:16:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:20.277 15:16:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:20.277 15:16:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:20.277 15:16:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:20.277 15:16:19 -- nvmf/common.sh@294 -- # net_devs=() 00:21:20.277 15:16:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:20.277 15:16:19 -- nvmf/common.sh@295 -- # e810=() 00:21:20.277 15:16:19 -- nvmf/common.sh@295 -- # local -ga e810 00:21:20.277 15:16:19 -- nvmf/common.sh@296 -- # x722=() 00:21:20.277 15:16:19 -- nvmf/common.sh@296 -- # local -ga x722 00:21:20.277 15:16:19 -- nvmf/common.sh@297 -- # mlx=() 00:21:20.277 15:16:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:20.277 15:16:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:20.277 15:16:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:20.277 15:16:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:20.277 15:16:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:20.277 15:16:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:20.277 15:16:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:20.277 15:16:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:20.277 15:16:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:20.278 15:16:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:20.278 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:20.278 15:16:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:20.278 15:16:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:20.278 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:20.278 15:16:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:20.278 15:16:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:20.278 15:16:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:20.278 15:16:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:20.278 15:16:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:20.278 15:16:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:20.278 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:20.278 15:16:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:20.278 15:16:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:20.278 15:16:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:20.278 15:16:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:20.278 15:16:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:20.278 15:16:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:20.278 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:20.278 15:16:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:20.278 15:16:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:20.278 15:16:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:20.278 15:16:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:20.278 15:16:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:20.278 15:16:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:20.278 15:16:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:20.278 15:16:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:20.278 15:16:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:20.278 15:16:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:20.278 15:16:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:20.278 15:16:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:20.278 15:16:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:20.278 15:16:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:20.278 15:16:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:20.278 15:16:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:20.278 15:16:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:20.278 15:16:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:20.278 15:16:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:20.278 15:16:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:20.278 15:16:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:20.278 15:16:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:20.278 15:16:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:20.278 15:16:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:20.278 15:16:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:20.278 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:20.278 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.180 ms 00:21:20.278 00:21:20.278 --- 10.0.0.2 ping statistics --- 00:21:20.278 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:20.278 rtt min/avg/max/mdev = 0.180/0.180/0.180/0.000 ms 00:21:20.278 15:16:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:20.278 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:20.278 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:21:20.278 00:21:20.278 --- 10.0.0.1 ping statistics --- 00:21:20.278 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:20.278 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:21:20.278 15:16:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:20.278 15:16:20 -- nvmf/common.sh@410 -- # return 0 00:21:20.278 15:16:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:20.278 15:16:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:20.278 15:16:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:20.278 15:16:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:20.278 15:16:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:20.278 15:16:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:20.278 15:16:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:20.278 15:16:20 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:20.278 15:16:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:20.278 15:16:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:20.278 15:16:20 -- common/autotest_common.sh@10 -- # set +x 00:21:20.278 15:16:20 -- nvmf/common.sh@469 -- # nvmfpid=745702 00:21:20.278 15:16:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:20.278 15:16:20 -- nvmf/common.sh@470 -- # waitforlisten 745702 00:21:20.278 15:16:20 -- common/autotest_common.sh@829 -- # '[' -z 745702 ']' 00:21:20.278 15:16:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:20.278 15:16:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:20.278 15:16:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:20.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:20.278 15:16:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:20.278 15:16:20 -- common/autotest_common.sh@10 -- # set +x 00:21:20.278 [2024-11-28 15:16:20.228669] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:20.278 [2024-11-28 15:16:20.228781] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:20.278 EAL: No free 2048 kB hugepages reported on node 1 00:21:20.278 [2024-11-28 15:16:20.299536] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:20.278 [2024-11-28 15:16:20.392675] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:20.278 [2024-11-28 15:16:20.392853] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:20.278 [2024-11-28 15:16:20.392874] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:20.278 [2024-11-28 15:16:20.392889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:20.278 [2024-11-28 15:16:20.392927] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:21.214 15:16:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:21.214 15:16:21 -- common/autotest_common.sh@862 -- # return 0 00:21:21.214 15:16:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:21.214 15:16:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:21.214 15:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:21.214 15:16:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:21.214 15:16:21 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:21.214 15:16:21 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:21.214 15:16:21 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:21.214 15:16:21 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:21.214 15:16:21 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:21.214 15:16:21 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:21.214 15:16:21 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:21.214 15:16:21 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:21.473 [2024-11-28 15:16:21.474462] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:21.473 [2024-11-28 15:16:21.490430] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:21.473 [2024-11-28 15:16:21.490652] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:21.473 malloc0 00:21:21.473 15:16:21 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:21.473 15:16:21 -- fips/fips.sh@147 -- # bdevperf_pid=745906 00:21:21.473 15:16:21 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:21.473 15:16:21 -- fips/fips.sh@148 -- # waitforlisten 745906 /var/tmp/bdevperf.sock 00:21:21.473 15:16:21 -- common/autotest_common.sh@829 -- # '[' -z 745906 ']' 00:21:21.473 15:16:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:21.473 15:16:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:21.473 15:16:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:21.473 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:21.473 15:16:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:21.473 15:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:21.473 [2024-11-28 15:16:21.608059] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:21:21.473 [2024-11-28 15:16:21.608159] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid745906 ] 00:21:21.473 EAL: No free 2048 kB hugepages reported on node 1 00:21:21.473 [2024-11-28 15:16:21.670485] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:21.732 [2024-11-28 15:16:21.762261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:22.669 15:16:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:22.669 15:16:22 -- common/autotest_common.sh@862 -- # return 0 00:21:22.669 15:16:22 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:22.669 [2024-11-28 15:16:22.794842] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:22.669 TLSTESTn1 00:21:22.669 15:16:22 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:22.928 Running I/O for 10 seconds... 00:21:32.898 00:21:32.898 Latency(us) 00:21:32.898 [2024-11-28T14:16:33.132Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:32.898 [2024-11-28T14:16:33.132Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:32.899 Verification LBA range: start 0x0 length 0x2000 00:21:32.899 TLSTESTn1 : 10.02 4581.20 17.90 0.00 0.00 27905.69 5145.79 43108.12 00:21:32.899 [2024-11-28T14:16:33.133Z] =================================================================================================================== 00:21:32.899 [2024-11-28T14:16:33.133Z] Total : 4581.20 17.90 0.00 0.00 27905.69 5145.79 43108.12 00:21:32.899 0 00:21:32.899 15:16:33 -- fips/fips.sh@1 -- # cleanup 00:21:32.899 15:16:33 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:32.899 15:16:33 -- common/autotest_common.sh@806 -- # type=--id 00:21:32.899 15:16:33 -- common/autotest_common.sh@807 -- # id=0 00:21:32.899 15:16:33 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:32.899 15:16:33 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:32.899 15:16:33 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:32.899 15:16:33 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:32.899 15:16:33 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:32.899 15:16:33 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:32.899 nvmf_trace.0 00:21:32.899 15:16:33 -- common/autotest_common.sh@821 -- # return 0 00:21:32.899 15:16:33 -- fips/fips.sh@16 -- # killprocess 745906 00:21:32.899 15:16:33 -- common/autotest_common.sh@936 -- # '[' -z 745906 ']' 00:21:32.899 15:16:33 -- common/autotest_common.sh@940 -- # kill -0 745906 00:21:32.899 15:16:33 -- common/autotest_common.sh@941 -- # uname 00:21:32.899 15:16:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:32.899 15:16:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 745906 00:21:33.158 15:16:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:33.158 15:16:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:33.158 15:16:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 745906' 00:21:33.158 killing process with pid 745906 00:21:33.158 15:16:33 -- common/autotest_common.sh@955 -- # kill 745906 00:21:33.158 Received shutdown signal, test time was about 10.000000 seconds 00:21:33.158 00:21:33.158 Latency(us) 00:21:33.158 [2024-11-28T14:16:33.392Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:33.158 [2024-11-28T14:16:33.392Z] =================================================================================================================== 00:21:33.158 [2024-11-28T14:16:33.392Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:33.158 15:16:33 -- common/autotest_common.sh@960 -- # wait 745906 00:21:33.158 15:16:33 -- fips/fips.sh@17 -- # nvmftestfini 00:21:33.158 15:16:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:33.158 15:16:33 -- nvmf/common.sh@116 -- # sync 00:21:33.158 15:16:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:33.158 15:16:33 -- nvmf/common.sh@119 -- # set +e 00:21:33.158 15:16:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:33.158 15:16:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:33.158 rmmod nvme_tcp 00:21:33.417 rmmod nvme_fabrics 00:21:33.417 rmmod nvme_keyring 00:21:33.417 15:16:33 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:33.417 15:16:33 -- nvmf/common.sh@123 -- # set -e 00:21:33.417 15:16:33 -- nvmf/common.sh@124 -- # return 0 00:21:33.417 15:16:33 -- nvmf/common.sh@477 -- # '[' -n 745702 ']' 00:21:33.417 15:16:33 -- nvmf/common.sh@478 -- # killprocess 745702 00:21:33.417 15:16:33 -- common/autotest_common.sh@936 -- # '[' -z 745702 ']' 00:21:33.417 15:16:33 -- common/autotest_common.sh@940 -- # kill -0 745702 00:21:33.417 15:16:33 -- common/autotest_common.sh@941 -- # uname 00:21:33.417 15:16:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:33.417 15:16:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 745702 00:21:33.417 15:16:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:33.417 15:16:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:33.417 15:16:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 745702' 00:21:33.417 killing process with pid 745702 00:21:33.417 15:16:33 -- common/autotest_common.sh@955 -- # kill 745702 00:21:33.417 15:16:33 -- common/autotest_common.sh@960 -- # wait 745702 00:21:33.676 15:16:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:33.676 15:16:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:33.676 15:16:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:33.676 15:16:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:33.676 15:16:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:33.676 15:16:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:33.676 15:16:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:33.676 15:16:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:35.579 15:16:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:35.579 15:16:35 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:35.579 00:21:35.579 real 0m18.086s 00:21:35.579 user 0m23.960s 00:21:35.579 sys 0m5.622s 00:21:35.579 15:16:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:35.579 15:16:35 -- common/autotest_common.sh@10 -- # set +x 00:21:35.579 ************************************ 00:21:35.579 END TEST nvmf_fips 00:21:35.579 ************************************ 00:21:35.579 15:16:35 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:35.579 15:16:35 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:35.579 15:16:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:35.579 15:16:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:35.579 15:16:35 -- common/autotest_common.sh@10 -- # set +x 00:21:35.838 ************************************ 00:21:35.838 START TEST nvmf_fuzz 00:21:35.838 ************************************ 00:21:35.838 15:16:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:35.838 * Looking for test storage... 00:21:35.838 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:35.838 15:16:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:35.838 15:16:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:35.838 15:16:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:35.838 15:16:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:35.838 15:16:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:35.838 15:16:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:35.838 15:16:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:35.838 15:16:35 -- scripts/common.sh@335 -- # IFS=.-: 00:21:35.838 15:16:35 -- scripts/common.sh@335 -- # read -ra ver1 00:21:35.838 15:16:35 -- scripts/common.sh@336 -- # IFS=.-: 00:21:35.838 15:16:35 -- scripts/common.sh@336 -- # read -ra ver2 00:21:35.838 15:16:35 -- scripts/common.sh@337 -- # local 'op=<' 00:21:35.838 15:16:35 -- scripts/common.sh@339 -- # ver1_l=2 00:21:35.838 15:16:35 -- scripts/common.sh@340 -- # ver2_l=1 00:21:35.838 15:16:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:35.838 15:16:35 -- scripts/common.sh@343 -- # case "$op" in 00:21:35.838 15:16:35 -- scripts/common.sh@344 -- # : 1 00:21:35.838 15:16:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:35.838 15:16:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:35.838 15:16:35 -- scripts/common.sh@364 -- # decimal 1 00:21:35.838 15:16:35 -- scripts/common.sh@352 -- # local d=1 00:21:35.838 15:16:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:35.838 15:16:35 -- scripts/common.sh@354 -- # echo 1 00:21:35.838 15:16:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:35.838 15:16:35 -- scripts/common.sh@365 -- # decimal 2 00:21:35.838 15:16:35 -- scripts/common.sh@352 -- # local d=2 00:21:35.838 15:16:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:35.838 15:16:35 -- scripts/common.sh@354 -- # echo 2 00:21:35.838 15:16:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:35.838 15:16:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:35.838 15:16:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:35.838 15:16:35 -- scripts/common.sh@367 -- # return 0 00:21:35.838 15:16:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:35.838 15:16:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:35.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.838 --rc genhtml_branch_coverage=1 00:21:35.838 --rc genhtml_function_coverage=1 00:21:35.838 --rc genhtml_legend=1 00:21:35.838 --rc geninfo_all_blocks=1 00:21:35.838 --rc geninfo_unexecuted_blocks=1 00:21:35.838 00:21:35.838 ' 00:21:35.838 15:16:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:35.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.838 --rc genhtml_branch_coverage=1 00:21:35.838 --rc genhtml_function_coverage=1 00:21:35.838 --rc genhtml_legend=1 00:21:35.838 --rc geninfo_all_blocks=1 00:21:35.838 --rc geninfo_unexecuted_blocks=1 00:21:35.838 00:21:35.838 ' 00:21:35.838 15:16:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:35.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.838 --rc genhtml_branch_coverage=1 00:21:35.838 --rc genhtml_function_coverage=1 00:21:35.838 --rc genhtml_legend=1 00:21:35.838 --rc geninfo_all_blocks=1 00:21:35.838 --rc geninfo_unexecuted_blocks=1 00:21:35.838 00:21:35.838 ' 00:21:35.838 15:16:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:35.838 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:35.838 --rc genhtml_branch_coverage=1 00:21:35.838 --rc genhtml_function_coverage=1 00:21:35.838 --rc genhtml_legend=1 00:21:35.838 --rc geninfo_all_blocks=1 00:21:35.838 --rc geninfo_unexecuted_blocks=1 00:21:35.838 00:21:35.838 ' 00:21:35.838 15:16:35 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:35.838 15:16:35 -- nvmf/common.sh@7 -- # uname -s 00:21:35.838 15:16:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:35.838 15:16:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:35.838 15:16:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:35.838 15:16:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:35.838 15:16:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:35.838 15:16:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:35.838 15:16:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:35.838 15:16:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:35.838 15:16:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:35.838 15:16:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:35.839 15:16:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:35.839 15:16:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:35.839 15:16:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:35.839 15:16:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:35.839 15:16:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:35.839 15:16:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:35.839 15:16:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:35.839 15:16:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:35.839 15:16:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:35.839 15:16:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.839 15:16:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.839 15:16:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.839 15:16:35 -- paths/export.sh@5 -- # export PATH 00:21:35.839 15:16:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:35.839 15:16:35 -- nvmf/common.sh@46 -- # : 0 00:21:35.839 15:16:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:35.839 15:16:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:35.839 15:16:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:35.839 15:16:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:35.839 15:16:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:35.839 15:16:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:35.839 15:16:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:35.839 15:16:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:35.839 15:16:35 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:35.839 15:16:35 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:35.839 15:16:35 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:35.839 15:16:35 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:35.839 15:16:35 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:35.839 15:16:35 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:35.839 15:16:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:35.839 15:16:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:35.839 15:16:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:35.839 15:16:35 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:35.839 15:16:35 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:35.839 15:16:35 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:35.839 15:16:35 -- common/autotest_common.sh@10 -- # set +x 00:21:37.741 15:16:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:37.741 15:16:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:37.741 15:16:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:37.741 15:16:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:37.741 15:16:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:37.741 15:16:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:37.741 15:16:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:37.741 15:16:37 -- nvmf/common.sh@294 -- # net_devs=() 00:21:37.741 15:16:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:37.741 15:16:37 -- nvmf/common.sh@295 -- # e810=() 00:21:37.741 15:16:37 -- nvmf/common.sh@295 -- # local -ga e810 00:21:37.741 15:16:37 -- nvmf/common.sh@296 -- # x722=() 00:21:37.741 15:16:37 -- nvmf/common.sh@296 -- # local -ga x722 00:21:37.741 15:16:37 -- nvmf/common.sh@297 -- # mlx=() 00:21:37.741 15:16:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:37.741 15:16:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:37.741 15:16:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:37.741 15:16:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:37.741 15:16:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:37.741 15:16:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:37.741 15:16:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:37.741 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:37.741 15:16:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:37.741 15:16:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:37.741 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:37.741 15:16:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:37.741 15:16:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:37.741 15:16:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:37.741 15:16:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:37.741 15:16:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:37.741 15:16:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:37.741 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:37.741 15:16:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:37.741 15:16:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:37.741 15:16:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:37.741 15:16:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:37.741 15:16:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:37.741 15:16:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:37.741 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:37.741 15:16:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:37.741 15:16:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:37.741 15:16:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:37.741 15:16:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:37.741 15:16:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:37.741 15:16:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:37.741 15:16:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:37.741 15:16:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:37.741 15:16:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:37.741 15:16:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:37.741 15:16:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:37.741 15:16:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:37.741 15:16:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:37.741 15:16:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:37.741 15:16:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:37.741 15:16:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:37.741 15:16:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:37.741 15:16:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:38.000 15:16:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:38.000 15:16:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:38.000 15:16:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:38.000 15:16:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:38.000 15:16:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:38.000 15:16:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:38.000 15:16:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:38.000 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:38.000 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.178 ms 00:21:38.000 00:21:38.000 --- 10.0.0.2 ping statistics --- 00:21:38.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:38.000 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:21:38.000 15:16:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:38.000 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:38.000 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.127 ms 00:21:38.000 00:21:38.000 --- 10.0.0.1 ping statistics --- 00:21:38.000 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:38.000 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:21:38.000 15:16:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:38.000 15:16:38 -- nvmf/common.sh@410 -- # return 0 00:21:38.000 15:16:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:38.000 15:16:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:38.000 15:16:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:38.000 15:16:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:38.000 15:16:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:38.000 15:16:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:38.000 15:16:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:38.000 15:16:38 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=749225 00:21:38.000 15:16:38 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:38.000 15:16:38 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:38.000 15:16:38 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 749225 00:21:38.000 15:16:38 -- common/autotest_common.sh@829 -- # '[' -z 749225 ']' 00:21:38.000 15:16:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:38.000 15:16:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:38.000 15:16:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:38.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:38.000 15:16:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:38.000 15:16:38 -- common/autotest_common.sh@10 -- # set +x 00:21:38.934 15:16:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:38.934 15:16:39 -- common/autotest_common.sh@862 -- # return 0 00:21:38.934 15:16:39 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:38.934 15:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:38.934 15:16:39 -- common/autotest_common.sh@10 -- # set +x 00:21:38.934 15:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:38.934 15:16:39 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:38.934 15:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:38.934 15:16:39 -- common/autotest_common.sh@10 -- # set +x 00:21:39.193 Malloc0 00:21:39.193 15:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.193 15:16:39 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:39.193 15:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.193 15:16:39 -- common/autotest_common.sh@10 -- # set +x 00:21:39.193 15:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.193 15:16:39 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:39.193 15:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.193 15:16:39 -- common/autotest_common.sh@10 -- # set +x 00:21:39.193 15:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.193 15:16:39 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:39.193 15:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:39.193 15:16:39 -- common/autotest_common.sh@10 -- # set +x 00:21:39.193 15:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:39.193 15:16:39 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:39.193 15:16:39 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:11.337 Fuzzing completed. Shutting down the fuzz application 00:22:11.337 00:22:11.337 Dumping successful admin opcodes: 00:22:11.337 8, 9, 10, 24, 00:22:11.337 Dumping successful io opcodes: 00:22:11.337 0, 9, 00:22:11.337 NS: 0x200003aeff00 I/O qp, Total commands completed: 470745, total successful commands: 2715, random_seed: 3719671424 00:22:11.337 NS: 0x200003aeff00 admin qp, Total commands completed: 55584, total successful commands: 443, random_seed: 31451648 00:22:11.337 15:17:10 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:11.902 Fuzzing completed. Shutting down the fuzz application 00:22:11.902 00:22:11.902 Dumping successful admin opcodes: 00:22:11.902 24, 00:22:11.902 Dumping successful io opcodes: 00:22:11.902 00:22:11.902 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 2569925779 00:22:11.902 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 2570063503 00:22:11.902 15:17:12 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:11.902 15:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:11.902 15:17:12 -- common/autotest_common.sh@10 -- # set +x 00:22:11.902 15:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:11.902 15:17:12 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:11.902 15:17:12 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:11.902 15:17:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:11.902 15:17:12 -- nvmf/common.sh@116 -- # sync 00:22:11.902 15:17:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:11.902 15:17:12 -- nvmf/common.sh@119 -- # set +e 00:22:11.902 15:17:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:11.902 15:17:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:11.902 rmmod nvme_tcp 00:22:11.902 rmmod nvme_fabrics 00:22:12.159 rmmod nvme_keyring 00:22:12.159 15:17:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:12.159 15:17:12 -- nvmf/common.sh@123 -- # set -e 00:22:12.159 15:17:12 -- nvmf/common.sh@124 -- # return 0 00:22:12.159 15:17:12 -- nvmf/common.sh@477 -- # '[' -n 749225 ']' 00:22:12.159 15:17:12 -- nvmf/common.sh@478 -- # killprocess 749225 00:22:12.159 15:17:12 -- common/autotest_common.sh@936 -- # '[' -z 749225 ']' 00:22:12.159 15:17:12 -- common/autotest_common.sh@940 -- # kill -0 749225 00:22:12.159 15:17:12 -- common/autotest_common.sh@941 -- # uname 00:22:12.159 15:17:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:12.159 15:17:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 749225 00:22:12.159 15:17:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:12.159 15:17:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:12.159 15:17:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 749225' 00:22:12.159 killing process with pid 749225 00:22:12.159 15:17:12 -- common/autotest_common.sh@955 -- # kill 749225 00:22:12.159 15:17:12 -- common/autotest_common.sh@960 -- # wait 749225 00:22:12.416 15:17:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:12.416 15:17:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:12.416 15:17:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:12.417 15:17:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:12.417 15:17:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:12.417 15:17:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:12.417 15:17:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:12.417 15:17:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:14.320 15:17:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:14.320 15:17:14 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:14.320 00:22:14.320 real 0m38.733s 00:22:14.320 user 0m53.537s 00:22:14.320 sys 0m15.297s 00:22:14.320 15:17:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:14.320 15:17:14 -- common/autotest_common.sh@10 -- # set +x 00:22:14.320 ************************************ 00:22:14.320 END TEST nvmf_fuzz 00:22:14.320 ************************************ 00:22:14.579 15:17:14 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:14.579 15:17:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:14.579 15:17:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:14.579 15:17:14 -- common/autotest_common.sh@10 -- # set +x 00:22:14.579 ************************************ 00:22:14.579 START TEST nvmf_multiconnection 00:22:14.579 ************************************ 00:22:14.579 15:17:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:14.579 * Looking for test storage... 00:22:14.579 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:14.579 15:17:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:14.579 15:17:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:14.579 15:17:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:14.579 15:17:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:14.579 15:17:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:14.579 15:17:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:14.579 15:17:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:14.579 15:17:14 -- scripts/common.sh@335 -- # IFS=.-: 00:22:14.579 15:17:14 -- scripts/common.sh@335 -- # read -ra ver1 00:22:14.579 15:17:14 -- scripts/common.sh@336 -- # IFS=.-: 00:22:14.579 15:17:14 -- scripts/common.sh@336 -- # read -ra ver2 00:22:14.579 15:17:14 -- scripts/common.sh@337 -- # local 'op=<' 00:22:14.579 15:17:14 -- scripts/common.sh@339 -- # ver1_l=2 00:22:14.579 15:17:14 -- scripts/common.sh@340 -- # ver2_l=1 00:22:14.579 15:17:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:14.579 15:17:14 -- scripts/common.sh@343 -- # case "$op" in 00:22:14.579 15:17:14 -- scripts/common.sh@344 -- # : 1 00:22:14.579 15:17:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:14.579 15:17:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:14.579 15:17:14 -- scripts/common.sh@364 -- # decimal 1 00:22:14.579 15:17:14 -- scripts/common.sh@352 -- # local d=1 00:22:14.579 15:17:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:14.579 15:17:14 -- scripts/common.sh@354 -- # echo 1 00:22:14.579 15:17:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:14.579 15:17:14 -- scripts/common.sh@365 -- # decimal 2 00:22:14.579 15:17:14 -- scripts/common.sh@352 -- # local d=2 00:22:14.579 15:17:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:14.579 15:17:14 -- scripts/common.sh@354 -- # echo 2 00:22:14.579 15:17:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:14.579 15:17:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:14.579 15:17:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:14.579 15:17:14 -- scripts/common.sh@367 -- # return 0 00:22:14.580 15:17:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:14.580 15:17:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:14.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:14.580 --rc genhtml_branch_coverage=1 00:22:14.580 --rc genhtml_function_coverage=1 00:22:14.580 --rc genhtml_legend=1 00:22:14.580 --rc geninfo_all_blocks=1 00:22:14.580 --rc geninfo_unexecuted_blocks=1 00:22:14.580 00:22:14.580 ' 00:22:14.580 15:17:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:14.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:14.580 --rc genhtml_branch_coverage=1 00:22:14.580 --rc genhtml_function_coverage=1 00:22:14.580 --rc genhtml_legend=1 00:22:14.580 --rc geninfo_all_blocks=1 00:22:14.580 --rc geninfo_unexecuted_blocks=1 00:22:14.580 00:22:14.580 ' 00:22:14.580 15:17:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:14.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:14.580 --rc genhtml_branch_coverage=1 00:22:14.580 --rc genhtml_function_coverage=1 00:22:14.580 --rc genhtml_legend=1 00:22:14.580 --rc geninfo_all_blocks=1 00:22:14.580 --rc geninfo_unexecuted_blocks=1 00:22:14.580 00:22:14.580 ' 00:22:14.580 15:17:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:14.580 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:14.580 --rc genhtml_branch_coverage=1 00:22:14.580 --rc genhtml_function_coverage=1 00:22:14.580 --rc genhtml_legend=1 00:22:14.580 --rc geninfo_all_blocks=1 00:22:14.580 --rc geninfo_unexecuted_blocks=1 00:22:14.580 00:22:14.580 ' 00:22:14.580 15:17:14 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:14.580 15:17:14 -- nvmf/common.sh@7 -- # uname -s 00:22:14.580 15:17:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:14.580 15:17:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:14.580 15:17:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:14.580 15:17:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:14.580 15:17:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:14.580 15:17:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:14.580 15:17:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:14.580 15:17:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:14.580 15:17:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:14.580 15:17:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:14.580 15:17:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:14.580 15:17:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:14.580 15:17:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:14.580 15:17:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:14.580 15:17:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:14.580 15:17:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:14.580 15:17:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:14.580 15:17:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:14.580 15:17:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:14.580 15:17:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:14.580 15:17:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:14.580 15:17:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:14.580 15:17:14 -- paths/export.sh@5 -- # export PATH 00:22:14.580 15:17:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:14.580 15:17:14 -- nvmf/common.sh@46 -- # : 0 00:22:14.580 15:17:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:14.580 15:17:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:14.580 15:17:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:14.580 15:17:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:14.580 15:17:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:14.580 15:17:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:14.580 15:17:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:14.580 15:17:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:14.580 15:17:14 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:14.580 15:17:14 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:14.580 15:17:14 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:14.580 15:17:14 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:14.580 15:17:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:14.580 15:17:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:14.580 15:17:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:14.580 15:17:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:14.580 15:17:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:14.580 15:17:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:14.580 15:17:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:14.580 15:17:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:14.580 15:17:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:14.580 15:17:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:14.580 15:17:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:14.580 15:17:14 -- common/autotest_common.sh@10 -- # set +x 00:22:17.110 15:17:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:17.110 15:17:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:17.110 15:17:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:17.110 15:17:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:17.110 15:17:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:17.110 15:17:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:17.110 15:17:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:17.110 15:17:16 -- nvmf/common.sh@294 -- # net_devs=() 00:22:17.110 15:17:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:17.110 15:17:16 -- nvmf/common.sh@295 -- # e810=() 00:22:17.110 15:17:16 -- nvmf/common.sh@295 -- # local -ga e810 00:22:17.110 15:17:16 -- nvmf/common.sh@296 -- # x722=() 00:22:17.110 15:17:16 -- nvmf/common.sh@296 -- # local -ga x722 00:22:17.110 15:17:16 -- nvmf/common.sh@297 -- # mlx=() 00:22:17.110 15:17:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:17.110 15:17:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:17.110 15:17:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:17.110 15:17:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:17.110 15:17:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:17.110 15:17:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.110 15:17:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:17.110 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:17.110 15:17:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:17.110 15:17:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:17.110 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:17.110 15:17:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:17.110 15:17:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.110 15:17:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.110 15:17:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.110 15:17:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.110 15:17:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:17.110 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:17.110 15:17:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.110 15:17:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:17.110 15:17:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:17.110 15:17:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:17.110 15:17:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:17.110 15:17:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:17.110 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:17.110 15:17:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:17.110 15:17:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:17.110 15:17:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:17.110 15:17:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:17.110 15:17:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:17.111 15:17:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:17.111 15:17:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:17.111 15:17:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:17.111 15:17:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:17.111 15:17:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:17.111 15:17:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:17.111 15:17:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:17.111 15:17:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:17.111 15:17:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:17.111 15:17:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:17.111 15:17:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:17.111 15:17:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:17.111 15:17:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:17.111 15:17:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:17.111 15:17:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:17.111 15:17:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:17.111 15:17:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:17.111 15:17:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:17.111 15:17:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:17.111 15:17:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:17.111 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:17.111 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:22:17.111 00:22:17.111 --- 10.0.0.2 ping statistics --- 00:22:17.111 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.111 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:22:17.111 15:17:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:17.111 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:17.111 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:22:17.111 00:22:17.111 --- 10.0.0.1 ping statistics --- 00:22:17.111 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:17.111 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:22:17.111 15:17:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:17.111 15:17:16 -- nvmf/common.sh@410 -- # return 0 00:22:17.111 15:17:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:17.111 15:17:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:17.111 15:17:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:17.111 15:17:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:17.111 15:17:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:17.111 15:17:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:17.111 15:17:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:17.111 15:17:16 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:17.111 15:17:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:17.111 15:17:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:17.111 15:17:16 -- common/autotest_common.sh@10 -- # set +x 00:22:17.111 15:17:16 -- nvmf/common.sh@469 -- # nvmfpid=755253 00:22:17.111 15:17:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:17.111 15:17:16 -- nvmf/common.sh@470 -- # waitforlisten 755253 00:22:17.111 15:17:16 -- common/autotest_common.sh@829 -- # '[' -z 755253 ']' 00:22:17.111 15:17:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:17.111 15:17:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:17.111 15:17:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:17.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:17.111 15:17:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:17.111 15:17:16 -- common/autotest_common.sh@10 -- # set +x 00:22:17.111 [2024-11-28 15:17:16.923942] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:22:17.111 [2024-11-28 15:17:16.924010] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:17.111 EAL: No free 2048 kB hugepages reported on node 1 00:22:17.111 [2024-11-28 15:17:16.992365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:17.111 [2024-11-28 15:17:17.086613] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:17.111 [2024-11-28 15:17:17.086773] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:17.111 [2024-11-28 15:17:17.086794] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:17.111 [2024-11-28 15:17:17.086809] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:17.111 [2024-11-28 15:17:17.086879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:17.111 [2024-11-28 15:17:17.086932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:17.111 [2024-11-28 15:17:17.086987] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:17.111 [2024-11-28 15:17:17.086990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:17.676 15:17:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:17.676 15:17:17 -- common/autotest_common.sh@862 -- # return 0 00:22:17.677 15:17:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:17.677 15:17:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:17.677 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.677 15:17:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:17.677 15:17:17 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:17.677 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.677 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.677 [2024-11-28 15:17:17.906725] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:17.936 15:17:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.936 15:17:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 Malloc1 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 [2024-11-28 15:17:17.963771] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.936 15:17:17 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 Malloc2 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:17 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:17.936 15:17:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:17 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.936 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 Malloc3 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.936 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 Malloc4 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:17.936 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.936 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.936 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.936 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.937 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:17.937 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.937 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.937 Malloc5 00:22:17.937 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.937 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:17.937 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.937 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.937 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.937 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:17.937 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.937 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.937 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.937 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:17.937 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.937 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:17.937 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:17.937 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.937 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:17.937 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:17.937 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 Malloc6 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.196 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 Malloc7 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.196 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 Malloc8 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.196 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 Malloc9 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.196 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 Malloc10 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.196 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.196 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:18.196 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.196 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.197 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.197 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:18.197 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.197 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.197 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.197 15:17:18 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.197 15:17:18 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:18.197 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.197 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.454 Malloc11 00:22:18.454 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.454 15:17:18 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:18.454 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.454 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.454 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.454 15:17:18 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:18.454 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.454 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.454 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.454 15:17:18 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:18.454 15:17:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:18.454 15:17:18 -- common/autotest_common.sh@10 -- # set +x 00:22:18.454 15:17:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:18.454 15:17:18 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:18.454 15:17:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:18.454 15:17:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:19.019 15:17:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:19.019 15:17:19 -- common/autotest_common.sh@1187 -- # local i=0 00:22:19.019 15:17:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:19.019 15:17:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:19.019 15:17:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:21.547 15:17:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:21.547 15:17:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:21.547 15:17:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:21.547 15:17:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:21.547 15:17:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:21.547 15:17:21 -- common/autotest_common.sh@1197 -- # return 0 00:22:21.547 15:17:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:21.547 15:17:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:21.547 15:17:21 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:21.547 15:17:21 -- common/autotest_common.sh@1187 -- # local i=0 00:22:21.547 15:17:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:21.547 15:17:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:21.547 15:17:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:24.076 15:17:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:24.076 15:17:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:24.076 15:17:23 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:24.076 15:17:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:24.076 15:17:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:24.076 15:17:23 -- common/autotest_common.sh@1197 -- # return 0 00:22:24.076 15:17:23 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:24.076 15:17:23 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:24.335 15:17:24 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:24.335 15:17:24 -- common/autotest_common.sh@1187 -- # local i=0 00:22:24.335 15:17:24 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:24.335 15:17:24 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:24.335 15:17:24 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:26.861 15:17:26 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:26.861 15:17:26 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:26.861 15:17:26 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:26.861 15:17:26 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:26.862 15:17:26 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:26.862 15:17:26 -- common/autotest_common.sh@1197 -- # return 0 00:22:26.862 15:17:26 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:26.862 15:17:26 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:27.119 15:17:27 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:27.119 15:17:27 -- common/autotest_common.sh@1187 -- # local i=0 00:22:27.119 15:17:27 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:27.119 15:17:27 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:27.119 15:17:27 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:29.019 15:17:29 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:29.019 15:17:29 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:29.019 15:17:29 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:29.019 15:17:29 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:29.019 15:17:29 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:29.019 15:17:29 -- common/autotest_common.sh@1197 -- # return 0 00:22:29.019 15:17:29 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:29.019 15:17:29 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:29.953 15:17:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:29.953 15:17:29 -- common/autotest_common.sh@1187 -- # local i=0 00:22:29.953 15:17:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:29.953 15:17:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:29.953 15:17:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:31.852 15:17:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:31.852 15:17:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:31.852 15:17:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:31.852 15:17:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:31.852 15:17:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:31.852 15:17:31 -- common/autotest_common.sh@1197 -- # return 0 00:22:31.852 15:17:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:31.852 15:17:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:32.786 15:17:32 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:32.787 15:17:32 -- common/autotest_common.sh@1187 -- # local i=0 00:22:32.787 15:17:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:32.787 15:17:32 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:32.787 15:17:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:34.683 15:17:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:34.683 15:17:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:34.683 15:17:34 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:34.683 15:17:34 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:34.683 15:17:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:34.683 15:17:34 -- common/autotest_common.sh@1197 -- # return 0 00:22:34.683 15:17:34 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.683 15:17:34 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:35.248 15:17:35 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:35.248 15:17:35 -- common/autotest_common.sh@1187 -- # local i=0 00:22:35.248 15:17:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:35.248 15:17:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:35.248 15:17:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:37.773 15:17:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:37.773 15:17:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:37.773 15:17:37 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:37.773 15:17:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:37.773 15:17:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:37.773 15:17:37 -- common/autotest_common.sh@1197 -- # return 0 00:22:37.773 15:17:37 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:37.773 15:17:37 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:38.339 15:17:38 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:38.339 15:17:38 -- common/autotest_common.sh@1187 -- # local i=0 00:22:38.339 15:17:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:38.339 15:17:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:38.339 15:17:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:40.238 15:17:40 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:40.238 15:17:40 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:40.238 15:17:40 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:40.238 15:17:40 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:40.238 15:17:40 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.238 15:17:40 -- common/autotest_common.sh@1197 -- # return 0 00:22:40.238 15:17:40 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.238 15:17:40 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:41.174 15:17:41 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:41.174 15:17:41 -- common/autotest_common.sh@1187 -- # local i=0 00:22:41.174 15:17:41 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:41.174 15:17:41 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:41.174 15:17:41 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:43.170 15:17:43 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:43.170 15:17:43 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:43.170 15:17:43 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:43.170 15:17:43 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:43.170 15:17:43 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:43.170 15:17:43 -- common/autotest_common.sh@1197 -- # return 0 00:22:43.170 15:17:43 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:43.170 15:17:43 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:44.105 15:17:44 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:44.105 15:17:44 -- common/autotest_common.sh@1187 -- # local i=0 00:22:44.105 15:17:44 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:44.105 15:17:44 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:44.105 15:17:44 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:46.638 15:17:46 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:46.638 15:17:46 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:46.638 15:17:46 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:46.638 15:17:46 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:46.638 15:17:46 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:46.638 15:17:46 -- common/autotest_common.sh@1197 -- # return 0 00:22:46.638 15:17:46 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:46.638 15:17:46 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:46.897 15:17:47 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:46.897 15:17:47 -- common/autotest_common.sh@1187 -- # local i=0 00:22:46.897 15:17:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:46.897 15:17:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:46.897 15:17:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:49.428 15:17:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:49.428 15:17:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:49.428 15:17:49 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:49.428 15:17:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:49.428 15:17:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:49.428 15:17:49 -- common/autotest_common.sh@1197 -- # return 0 00:22:49.428 15:17:49 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:49.428 [global] 00:22:49.428 thread=1 00:22:49.428 invalidate=1 00:22:49.428 rw=read 00:22:49.428 time_based=1 00:22:49.428 runtime=10 00:22:49.428 ioengine=libaio 00:22:49.428 direct=1 00:22:49.428 bs=262144 00:22:49.428 iodepth=64 00:22:49.428 norandommap=1 00:22:49.428 numjobs=1 00:22:49.428 00:22:49.428 [job0] 00:22:49.428 filename=/dev/nvme0n1 00:22:49.428 [job1] 00:22:49.428 filename=/dev/nvme10n1 00:22:49.428 [job2] 00:22:49.428 filename=/dev/nvme1n1 00:22:49.428 [job3] 00:22:49.428 filename=/dev/nvme2n1 00:22:49.428 [job4] 00:22:49.428 filename=/dev/nvme3n1 00:22:49.428 [job5] 00:22:49.428 filename=/dev/nvme4n1 00:22:49.428 [job6] 00:22:49.428 filename=/dev/nvme5n1 00:22:49.428 [job7] 00:22:49.428 filename=/dev/nvme6n1 00:22:49.428 [job8] 00:22:49.428 filename=/dev/nvme7n1 00:22:49.428 [job9] 00:22:49.428 filename=/dev/nvme8n1 00:22:49.428 [job10] 00:22:49.428 filename=/dev/nvme9n1 00:22:49.428 Could not set queue depth (nvme0n1) 00:22:49.428 Could not set queue depth (nvme10n1) 00:22:49.428 Could not set queue depth (nvme1n1) 00:22:49.428 Could not set queue depth (nvme2n1) 00:22:49.428 Could not set queue depth (nvme3n1) 00:22:49.428 Could not set queue depth (nvme4n1) 00:22:49.428 Could not set queue depth (nvme5n1) 00:22:49.428 Could not set queue depth (nvme6n1) 00:22:49.428 Could not set queue depth (nvme7n1) 00:22:49.428 Could not set queue depth (nvme8n1) 00:22:49.428 Could not set queue depth (nvme9n1) 00:22:49.428 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:49.428 fio-3.35 00:22:49.428 Starting 11 threads 00:23:01.633 00:23:01.633 job0: (groupid=0, jobs=1): err= 0: pid=759735: Thu Nov 28 15:17:59 2024 00:23:01.633 read: IOPS=499, BW=125MiB/s (131MB/s)(1264MiB/10123msec) 00:23:01.633 slat (usec): min=13, max=101889, avg=1922.44, stdev=6024.07 00:23:01.633 clat (msec): min=28, max=369, avg=126.10, stdev=47.01 00:23:01.633 lat (msec): min=28, max=369, avg=128.03, stdev=47.85 00:23:01.633 clat percentiles (msec): 00:23:01.633 | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 77], 20.00th=[ 92], 00:23:01.633 | 30.00th=[ 104], 40.00th=[ 113], 50.00th=[ 122], 60.00th=[ 129], 00:23:01.633 | 70.00th=[ 136], 80.00th=[ 148], 90.00th=[ 171], 95.00th=[ 241], 00:23:01.633 | 99.00th=[ 296], 99.50th=[ 305], 99.90th=[ 347], 99.95th=[ 355], 00:23:01.633 | 99.99th=[ 372] 00:23:01.633 bw ( KiB/s): min=59904, max=225280, per=6.79%, avg=127784.85, stdev=39999.51, samples=20 00:23:01.633 iops : min= 234, max= 880, avg=499.05, stdev=156.24, samples=20 00:23:01.633 lat (msec) : 50=0.91%, 100=26.86%, 250=68.06%, 500=4.17% 00:23:01.633 cpu : usr=0.17%, sys=1.99%, ctx=924, majf=0, minf=4097 00:23:01.633 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:01.633 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.633 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.633 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.633 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.633 job1: (groupid=0, jobs=1): err= 0: pid=759736: Thu Nov 28 15:17:59 2024 00:23:01.633 read: IOPS=502, BW=126MiB/s (132MB/s)(1273MiB/10121msec) 00:23:01.633 slat (usec): min=11, max=103126, avg=1660.70, stdev=5643.83 00:23:01.633 clat (msec): min=6, max=321, avg=125.47, stdev=50.22 00:23:01.633 lat (msec): min=7, max=389, avg=127.13, stdev=50.92 00:23:01.633 clat percentiles (msec): 00:23:01.633 | 1.00th=[ 19], 5.00th=[ 43], 10.00th=[ 68], 20.00th=[ 89], 00:23:01.633 | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 136], 00:23:01.633 | 70.00th=[ 144], 80.00th=[ 157], 90.00th=[ 182], 95.00th=[ 213], 00:23:01.633 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 309], 99.95th=[ 313], 00:23:01.633 | 99.99th=[ 321] 00:23:01.633 bw ( KiB/s): min=64512, max=216064, per=6.88%, avg=129453.89, stdev=38040.53, samples=19 00:23:01.633 iops : min= 252, max= 844, avg=505.63, stdev=148.57, samples=19 00:23:01.633 lat (msec) : 10=0.24%, 20=0.86%, 50=5.36%, 100=22.59%, 250=68.47% 00:23:01.633 lat (msec) : 500=2.48% 00:23:01.633 cpu : usr=0.28%, sys=1.92%, ctx=974, majf=0, minf=4097 00:23:01.634 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:01.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.634 issued rwts: total=5090,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.634 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.634 job2: (groupid=0, jobs=1): err= 0: pid=759737: Thu Nov 28 15:17:59 2024 00:23:01.634 read: IOPS=644, BW=161MiB/s (169MB/s)(1630MiB/10122msec) 00:23:01.634 slat (usec): min=8, max=144501, avg=1083.80, stdev=5334.32 00:23:01.634 clat (usec): min=638, max=432972, avg=98180.54, stdev=58364.55 00:23:01.634 lat (usec): min=664, max=433006, avg=99264.35, stdev=59303.53 00:23:01.634 clat percentiles (msec): 00:23:01.634 | 1.00th=[ 3], 5.00th=[ 15], 10.00th=[ 22], 20.00th=[ 37], 00:23:01.634 | 30.00th=[ 67], 40.00th=[ 90], 50.00th=[ 103], 60.00th=[ 114], 00:23:01.634 | 70.00th=[ 126], 80.00th=[ 138], 90.00th=[ 155], 95.00th=[ 215], 00:23:01.634 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 305], 99.95th=[ 305], 00:23:01.634 | 99.99th=[ 435] 00:23:01.634 bw ( KiB/s): min=52224, max=280064, per=8.78%, avg=165261.35, stdev=62779.41, samples=20 00:23:01.634 iops : min= 204, max= 1094, avg=645.50, stdev=245.21, samples=20 00:23:01.634 lat (usec) : 750=0.05%, 1000=0.08% 00:23:01.634 lat (msec) : 2=0.52%, 4=1.01%, 10=1.33%, 20=5.05%, 50=17.42% 00:23:01.634 lat (msec) : 100=21.75%, 250=50.68%, 500=2.12% 00:23:01.634 cpu : usr=0.30%, sys=1.84%, ctx=1261, majf=0, minf=4098 00:23:01.634 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:23:01.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.634 issued rwts: total=6521,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.634 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.634 job3: (groupid=0, jobs=1): err= 0: pid=759738: Thu Nov 28 15:17:59 2024 00:23:01.634 read: IOPS=713, BW=178MiB/s (187MB/s)(1792MiB/10049msec) 00:23:01.634 slat (usec): min=8, max=91768, avg=1211.90, stdev=4198.94 00:23:01.634 clat (usec): min=954, max=310438, avg=88456.27, stdev=49466.80 00:23:01.634 lat (usec): min=989, max=335124, avg=89668.16, stdev=50156.11 00:23:01.634 clat percentiles (msec): 00:23:01.634 | 1.00th=[ 4], 5.00th=[ 19], 10.00th=[ 27], 20.00th=[ 30], 00:23:01.634 | 30.00th=[ 46], 40.00th=[ 78], 50.00th=[ 96], 60.00th=[ 113], 00:23:01.634 | 70.00th=[ 125], 80.00th=[ 134], 90.00th=[ 144], 95.00th=[ 153], 00:23:01.634 | 99.00th=[ 207], 99.50th=[ 215], 99.90th=[ 305], 99.95th=[ 305], 00:23:01.634 | 99.99th=[ 313] 00:23:01.634 bw ( KiB/s): min=112128, max=467968, per=9.66%, avg=181811.95, stdev=101506.62, samples=20 00:23:01.634 iops : min= 438, max= 1828, avg=710.15, stdev=396.54, samples=20 00:23:01.634 lat (usec) : 1000=0.01% 00:23:01.634 lat (msec) : 2=0.06%, 4=1.40%, 10=1.90%, 20=2.02%, 50=26.47% 00:23:01.634 lat (msec) : 100=19.99%, 250=47.97%, 500=0.18% 00:23:01.634 cpu : usr=0.36%, sys=2.46%, ctx=1343, majf=0, minf=3721 00:23:01.634 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:01.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.634 issued rwts: total=7167,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.634 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.634 job4: (groupid=0, jobs=1): err= 0: pid=759739: Thu Nov 28 15:17:59 2024 00:23:01.634 read: IOPS=600, BW=150MiB/s (158MB/s)(1521MiB/10126msec) 00:23:01.634 slat (usec): min=9, max=135052, avg=1383.89, stdev=6241.72 00:23:01.634 clat (usec): min=1267, max=366871, avg=105059.66, stdev=51348.01 00:23:01.634 lat (usec): min=1286, max=410591, avg=106443.55, stdev=52174.46 00:23:01.634 clat percentiles (msec): 00:23:01.634 | 1.00th=[ 8], 5.00th=[ 21], 10.00th=[ 37], 20.00th=[ 66], 00:23:01.634 | 30.00th=[ 83], 40.00th=[ 96], 50.00th=[ 112], 60.00th=[ 120], 00:23:01.634 | 70.00th=[ 127], 80.00th=[ 136], 90.00th=[ 150], 95.00th=[ 192], 00:23:01.634 | 99.00th=[ 279], 99.50th=[ 300], 99.90th=[ 355], 99.95th=[ 355], 00:23:01.634 | 99.99th=[ 368] 00:23:01.634 bw ( KiB/s): min=105472, max=205824, per=8.19%, avg=154063.40, stdev=33081.26, samples=20 00:23:01.634 iops : min= 412, max= 804, avg=601.75, stdev=129.18, samples=20 00:23:01.634 lat (msec) : 2=0.08%, 4=0.18%, 10=1.25%, 20=3.50%, 50=10.04% 00:23:01.634 lat (msec) : 100=27.50%, 250=56.10%, 500=1.35% 00:23:01.634 cpu : usr=0.34%, sys=1.96%, ctx=1082, majf=0, minf=4097 00:23:01.634 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:01.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.634 issued rwts: total=6084,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.634 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.634 job5: (groupid=0, jobs=1): err= 0: pid=759741: Thu Nov 28 15:17:59 2024 00:23:01.634 read: IOPS=565, BW=141MiB/s (148MB/s)(1431MiB/10123msec) 00:23:01.634 slat (usec): min=13, max=83044, avg=1597.21, stdev=5331.25 00:23:01.634 clat (msec): min=2, max=359, avg=111.51, stdev=55.07 00:23:01.634 lat (msec): min=2, max=359, avg=113.11, stdev=55.96 00:23:01.634 clat percentiles (msec): 00:23:01.634 | 1.00th=[ 6], 5.00th=[ 21], 10.00th=[ 36], 20.00th=[ 67], 00:23:01.634 | 30.00th=[ 87], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 126], 00:23:01.634 | 70.00th=[ 136], 80.00th=[ 144], 90.00th=[ 165], 95.00th=[ 205], 00:23:01.634 | 99.00th=[ 284], 99.50th=[ 305], 99.90th=[ 342], 99.95th=[ 355], 00:23:01.634 | 99.99th=[ 359] 00:23:01.634 bw ( KiB/s): min=56320, max=243200, per=7.70%, avg=144826.90, stdev=49997.63, samples=20 00:23:01.634 iops : min= 220, max= 950, avg=565.65, stdev=195.29, samples=20 00:23:01.634 lat (msec) : 4=0.37%, 10=2.48%, 20=2.08%, 50=8.70%, 100=24.48% 00:23:01.634 lat (msec) : 250=59.30%, 500=2.59% 00:23:01.634 cpu : usr=0.41%, sys=1.98%, ctx=1069, majf=0, minf=4097 00:23:01.634 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:01.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.634 issued rwts: total=5723,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.634 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.634 job6: (groupid=0, jobs=1): err= 0: pid=759742: Thu Nov 28 15:17:59 2024 00:23:01.634 read: IOPS=603, BW=151MiB/s (158MB/s)(1517MiB/10047msec) 00:23:01.634 slat (usec): min=9, max=121964, avg=1086.34, stdev=4899.93 00:23:01.634 clat (usec): min=800, max=397597, avg=104802.60, stdev=52409.22 00:23:01.634 lat (usec): min=828, max=397650, avg=105888.94, stdev=53089.62 00:23:01.634 clat percentiles (msec): 00:23:01.634 | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 26], 20.00th=[ 65], 00:23:01.634 | 30.00th=[ 86], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 123], 00:23:01.634 | 70.00th=[ 130], 80.00th=[ 138], 90.00th=[ 148], 95.00th=[ 171], 00:23:01.634 | 99.00th=[ 284], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 317], 00:23:01.634 | 99.99th=[ 397] 00:23:01.634 bw ( KiB/s): min=88064, max=237056, per=8.17%, avg=153671.00, stdev=42086.78, samples=20 00:23:01.634 iops : min= 344, max= 926, avg=600.20, stdev=164.37, samples=20 00:23:01.634 lat (usec) : 1000=0.05% 00:23:01.634 lat (msec) : 2=0.43%, 4=1.09%, 10=3.74%, 20=3.79%, 50=7.60% 00:23:01.634 lat (msec) : 100=21.85%, 250=59.21%, 500=2.24% 00:23:01.634 cpu : usr=0.16%, sys=1.63%, ctx=1417, majf=0, minf=4097 00:23:01.634 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:01.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.634 issued rwts: total=6068,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.634 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.634 job7: (groupid=0, jobs=1): err= 0: pid=759743: Thu Nov 28 15:17:59 2024 00:23:01.634 read: IOPS=762, BW=191MiB/s (200MB/s)(1930MiB/10120msec) 00:23:01.635 slat (usec): min=12, max=122102, avg=1165.70, stdev=4180.47 00:23:01.635 clat (usec): min=1341, max=308303, avg=82649.90, stdev=54030.85 00:23:01.635 lat (usec): min=1373, max=318098, avg=83815.61, stdev=54693.30 00:23:01.635 clat percentiles (msec): 00:23:01.635 | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 21], 20.00th=[ 34], 00:23:01.635 | 30.00th=[ 40], 40.00th=[ 56], 50.00th=[ 75], 60.00th=[ 100], 00:23:01.635 | 70.00th=[ 117], 80.00th=[ 132], 90.00th=[ 146], 95.00th=[ 163], 00:23:01.635 | 99.00th=[ 239], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 309], 00:23:01.635 | 99.99th=[ 309] 00:23:01.635 bw ( KiB/s): min=112640, max=410112, per=10.41%, avg=195988.75, stdev=93391.47, samples=20 00:23:01.635 iops : min= 440, max= 1602, avg=765.50, stdev=364.84, samples=20 00:23:01.635 lat (msec) : 2=0.40%, 4=2.60%, 10=2.37%, 20=4.14%, 50=27.50% 00:23:01.635 lat (msec) : 100=23.21%, 250=38.88%, 500=0.89% 00:23:01.635 cpu : usr=0.59%, sys=2.41%, ctx=1458, majf=0, minf=4097 00:23:01.635 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:23:01.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.635 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.635 issued rwts: total=7721,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.635 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.635 job8: (groupid=0, jobs=1): err= 0: pid=759744: Thu Nov 28 15:17:59 2024 00:23:01.635 read: IOPS=1074, BW=269MiB/s (282MB/s)(2688MiB/10008msec) 00:23:01.635 slat (usec): min=9, max=245062, avg=617.47, stdev=4932.21 00:23:01.635 clat (usec): min=1606, max=419670, avg=58912.29, stdev=53319.37 00:23:01.635 lat (usec): min=1629, max=525114, avg=59529.77, stdev=53974.36 00:23:01.635 clat percentiles (msec): 00:23:01.635 | 1.00th=[ 5], 5.00th=[ 15], 10.00th=[ 22], 20.00th=[ 27], 00:23:01.635 | 30.00th=[ 28], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 39], 00:23:01.635 | 70.00th=[ 65], 80.00th=[ 103], 90.00th=[ 134], 95.00th=[ 159], 00:23:01.635 | 99.00th=[ 262], 99.50th=[ 284], 99.90th=[ 300], 99.95th=[ 313], 00:23:01.635 | 99.99th=[ 422] 00:23:01.635 bw ( KiB/s): min=38400, max=590336, per=13.93%, avg=262239.00, stdev=156988.04, samples=19 00:23:01.635 iops : min= 150, max= 2306, avg=1024.26, stdev=613.28, samples=19 00:23:01.635 lat (msec) : 2=0.05%, 4=0.76%, 10=2.23%, 20=6.05%, 50=56.80% 00:23:01.635 lat (msec) : 100=13.17%, 250=19.39%, 500=1.55% 00:23:01.635 cpu : usr=0.40%, sys=3.04%, ctx=1961, majf=0, minf=4097 00:23:01.635 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:23:01.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.635 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.635 issued rwts: total=10752,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.635 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.635 job9: (groupid=0, jobs=1): err= 0: pid=759745: Thu Nov 28 15:17:59 2024 00:23:01.635 read: IOPS=543, BW=136MiB/s (142MB/s)(1365MiB/10050msec) 00:23:01.635 slat (usec): min=9, max=199338, avg=1515.83, stdev=6098.20 00:23:01.635 clat (usec): min=1610, max=476646, avg=116202.36, stdev=51401.71 00:23:01.635 lat (usec): min=1643, max=476671, avg=117718.19, stdev=52267.42 00:23:01.635 clat percentiles (msec): 00:23:01.635 | 1.00th=[ 7], 5.00th=[ 26], 10.00th=[ 42], 20.00th=[ 79], 00:23:01.635 | 30.00th=[ 101], 40.00th=[ 115], 50.00th=[ 124], 60.00th=[ 130], 00:23:01.635 | 70.00th=[ 138], 80.00th=[ 144], 90.00th=[ 155], 95.00th=[ 192], 00:23:01.635 | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 414], 00:23:01.635 | 99.99th=[ 477] 00:23:01.635 bw ( KiB/s): min=43008, max=258048, per=7.34%, avg=138118.60, stdev=48723.56, samples=20 00:23:01.635 iops : min= 168, max= 1008, avg=539.50, stdev=190.30, samples=20 00:23:01.635 lat (msec) : 2=0.04%, 4=0.20%, 10=1.39%, 20=2.56%, 50=6.96% 00:23:01.635 lat (msec) : 100=18.55%, 250=67.16%, 500=3.13% 00:23:01.635 cpu : usr=0.27%, sys=1.91%, ctx=1086, majf=0, minf=4098 00:23:01.635 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:01.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.635 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.635 issued rwts: total=5460,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.635 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.635 job10: (groupid=0, jobs=1): err= 0: pid=759746: Thu Nov 28 15:17:59 2024 00:23:01.635 read: IOPS=868, BW=217MiB/s (228MB/s)(2199MiB/10122msec) 00:23:01.635 slat (usec): min=9, max=52379, avg=1097.65, stdev=3760.99 00:23:01.635 clat (msec): min=3, max=247, avg=72.48, stdev=46.48 00:23:01.635 lat (msec): min=3, max=247, avg=73.58, stdev=47.17 00:23:01.635 clat percentiles (msec): 00:23:01.635 | 1.00th=[ 16], 5.00th=[ 28], 10.00th=[ 29], 20.00th=[ 31], 00:23:01.635 | 30.00th=[ 33], 40.00th=[ 36], 50.00th=[ 55], 60.00th=[ 77], 00:23:01.635 | 70.00th=[ 106], 80.00th=[ 127], 90.00th=[ 140], 95.00th=[ 148], 00:23:01.635 | 99.00th=[ 171], 99.50th=[ 209], 99.90th=[ 234], 99.95th=[ 247], 00:23:01.635 | 99.99th=[ 249] 00:23:01.635 bw ( KiB/s): min=104960, max=528896, per=11.88%, avg=223508.80, stdev=146389.14, samples=20 00:23:01.635 iops : min= 410, max= 2066, avg=872.95, stdev=571.84, samples=20 00:23:01.635 lat (msec) : 4=0.01%, 10=0.55%, 20=0.58%, 50=47.62%, 100=19.15% 00:23:01.635 lat (msec) : 250=32.10% 00:23:01.635 cpu : usr=0.61%, sys=2.89%, ctx=1423, majf=0, minf=4097 00:23:01.635 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:23:01.635 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:01.635 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:01.635 issued rwts: total=8795,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:01.635 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:01.635 00:23:01.635 Run status group 0 (all jobs): 00:23:01.635 READ: bw=1838MiB/s (1927MB/s), 125MiB/s-269MiB/s (131MB/s-282MB/s), io=18.2GiB (19.5GB), run=10008-10126msec 00:23:01.635 00:23:01.635 Disk stats (read/write): 00:23:01.635 nvme0n1: ios=9951/0, merge=0/0, ticks=1234137/0, in_queue=1234137, util=97.35% 00:23:01.635 nvme10n1: ios=10027/0, merge=0/0, ticks=1236372/0, in_queue=1236372, util=97.55% 00:23:01.635 nvme1n1: ios=12867/0, merge=0/0, ticks=1237895/0, in_queue=1237895, util=97.82% 00:23:01.635 nvme2n1: ios=14137/0, merge=0/0, ticks=1237070/0, in_queue=1237070, util=97.95% 00:23:01.635 nvme3n1: ios=12010/0, merge=0/0, ticks=1237927/0, in_queue=1237927, util=98.03% 00:23:01.635 nvme4n1: ios=11268/0, merge=0/0, ticks=1231333/0, in_queue=1231333, util=98.32% 00:23:01.635 nvme5n1: ios=11924/0, merge=0/0, ticks=1240664/0, in_queue=1240664, util=98.48% 00:23:01.635 nvme6n1: ios=15264/0, merge=0/0, ticks=1233809/0, in_queue=1233809, util=98.57% 00:23:01.635 nvme7n1: ios=21171/0, merge=0/0, ticks=1248228/0, in_queue=1248228, util=98.96% 00:23:01.635 nvme8n1: ios=10726/0, merge=0/0, ticks=1238794/0, in_queue=1238794, util=99.12% 00:23:01.635 nvme9n1: ios=17459/0, merge=0/0, ticks=1236104/0, in_queue=1236104, util=99.22% 00:23:01.635 15:17:59 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:23:01.635 [global] 00:23:01.635 thread=1 00:23:01.635 invalidate=1 00:23:01.635 rw=randwrite 00:23:01.635 time_based=1 00:23:01.635 runtime=10 00:23:01.635 ioengine=libaio 00:23:01.635 direct=1 00:23:01.635 bs=262144 00:23:01.635 iodepth=64 00:23:01.635 norandommap=1 00:23:01.635 numjobs=1 00:23:01.635 00:23:01.635 [job0] 00:23:01.635 filename=/dev/nvme0n1 00:23:01.635 [job1] 00:23:01.635 filename=/dev/nvme10n1 00:23:01.635 [job2] 00:23:01.635 filename=/dev/nvme1n1 00:23:01.635 [job3] 00:23:01.635 filename=/dev/nvme2n1 00:23:01.635 [job4] 00:23:01.635 filename=/dev/nvme3n1 00:23:01.635 [job5] 00:23:01.635 filename=/dev/nvme4n1 00:23:01.635 [job6] 00:23:01.635 filename=/dev/nvme5n1 00:23:01.635 [job7] 00:23:01.635 filename=/dev/nvme6n1 00:23:01.635 [job8] 00:23:01.635 filename=/dev/nvme7n1 00:23:01.635 [job9] 00:23:01.636 filename=/dev/nvme8n1 00:23:01.636 [job10] 00:23:01.636 filename=/dev/nvme9n1 00:23:01.636 Could not set queue depth (nvme0n1) 00:23:01.636 Could not set queue depth (nvme10n1) 00:23:01.636 Could not set queue depth (nvme1n1) 00:23:01.636 Could not set queue depth (nvme2n1) 00:23:01.636 Could not set queue depth (nvme3n1) 00:23:01.636 Could not set queue depth (nvme4n1) 00:23:01.636 Could not set queue depth (nvme5n1) 00:23:01.636 Could not set queue depth (nvme6n1) 00:23:01.636 Could not set queue depth (nvme7n1) 00:23:01.636 Could not set queue depth (nvme8n1) 00:23:01.636 Could not set queue depth (nvme9n1) 00:23:01.636 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:23:01.636 fio-3.35 00:23:01.636 Starting 11 threads 00:23:11.614 00:23:11.614 job0: (groupid=0, jobs=1): err= 0: pid=760975: Thu Nov 28 15:18:10 2024 00:23:11.614 write: IOPS=702, BW=176MiB/s (184MB/s)(1791MiB/10204msec); 0 zone resets 00:23:11.614 slat (usec): min=15, max=161903, avg=802.51, stdev=3757.20 00:23:11.614 clat (usec): min=857, max=511880, avg=90250.68, stdev=72815.99 00:23:11.614 lat (usec): min=875, max=526196, avg=91053.19, stdev=73499.02 00:23:11.614 clat percentiles (msec): 00:23:11.614 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 23], 20.00th=[ 36], 00:23:11.614 | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 70], 60.00th=[ 88], 00:23:11.614 | 70.00th=[ 113], 80.00th=[ 134], 90.00th=[ 174], 95.00th=[ 245], 00:23:11.614 | 99.00th=[ 338], 99.50th=[ 401], 99.90th=[ 498], 99.95th=[ 514], 00:23:11.614 | 99.99th=[ 514] 00:23:11.614 bw ( KiB/s): min=95232, max=341504, per=12.94%, avg=181826.20, stdev=64159.15, samples=20 00:23:11.614 iops : min= 372, max= 1334, avg=710.25, stdev=250.63, samples=20 00:23:11.614 lat (usec) : 1000=0.08% 00:23:11.614 lat (msec) : 2=0.25%, 4=0.95%, 10=2.62%, 20=4.82%, 50=25.85% 00:23:11.614 lat (msec) : 100=30.86%, 250=30.22%, 500=4.30%, 750=0.06% 00:23:11.614 cpu : usr=2.28%, sys=2.14%, ctx=4675, majf=0, minf=1 00:23:11.614 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:23:11.614 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.614 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.615 issued rwts: total=0,7165,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.615 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.615 job1: (groupid=0, jobs=1): err= 0: pid=760981: Thu Nov 28 15:18:10 2024 00:23:11.615 write: IOPS=456, BW=114MiB/s (120MB/s)(1147MiB/10044msec); 0 zone resets 00:23:11.615 slat (usec): min=15, max=124165, avg=1544.53, stdev=5255.49 00:23:11.615 clat (usec): min=893, max=431323, avg=138509.84, stdev=93194.66 00:23:11.615 lat (usec): min=927, max=431395, avg=140054.37, stdev=94402.64 00:23:11.615 clat percentiles (msec): 00:23:11.615 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 18], 20.00th=[ 42], 00:23:11.615 | 30.00th=[ 71], 40.00th=[ 112], 50.00th=[ 146], 60.00th=[ 163], 00:23:11.615 | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 279], 95.00th=[ 300], 00:23:11.615 | 99.00th=[ 401], 99.50th=[ 422], 99.90th=[ 430], 99.95th=[ 430], 00:23:11.615 | 99.99th=[ 430] 00:23:11.615 bw ( KiB/s): min=43008, max=248832, per=8.24%, avg=115818.50, stdev=55128.95, samples=20 00:23:11.615 iops : min= 168, max= 972, avg=452.40, stdev=215.32, samples=20 00:23:11.615 lat (usec) : 1000=0.04% 00:23:11.615 lat (msec) : 2=0.54%, 4=1.94%, 10=4.62%, 20=3.90%, 50=13.16% 00:23:11.615 lat (msec) : 100=13.25%, 250=49.46%, 500=13.08% 00:23:11.615 cpu : usr=1.40%, sys=1.44%, ctx=2794, majf=0, minf=1 00:23:11.615 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:23:11.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.615 issued rwts: total=0,4588,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.615 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.615 job2: (groupid=0, jobs=1): err= 0: pid=760991: Thu Nov 28 15:18:10 2024 00:23:11.615 write: IOPS=613, BW=153MiB/s (161MB/s)(1548MiB/10092msec); 0 zone resets 00:23:11.615 slat (usec): min=16, max=144624, avg=926.42, stdev=4149.57 00:23:11.615 clat (usec): min=1138, max=458281, avg=103314.87, stdev=86377.68 00:23:11.615 lat (usec): min=1166, max=463810, avg=104241.29, stdev=87319.74 00:23:11.615 clat percentiles (msec): 00:23:11.615 | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 17], 20.00th=[ 36], 00:23:11.615 | 30.00th=[ 50], 40.00th=[ 57], 50.00th=[ 79], 60.00th=[ 93], 00:23:11.615 | 70.00th=[ 121], 80.00th=[ 167], 90.00th=[ 249], 95.00th=[ 288], 00:23:11.615 | 99.00th=[ 334], 99.50th=[ 418], 99.90th=[ 451], 99.95th=[ 451], 00:23:11.615 | 99.99th=[ 460] 00:23:11.615 bw ( KiB/s): min=51200, max=287744, per=11.16%, avg=156882.85, stdev=69924.62, samples=20 00:23:11.615 iops : min= 200, max= 1124, avg=612.80, stdev=273.18, samples=20 00:23:11.615 lat (msec) : 2=0.26%, 4=1.28%, 10=4.01%, 20=7.54%, 50=18.58% 00:23:11.615 lat (msec) : 100=32.82%, 250=25.60%, 500=9.92% 00:23:11.615 cpu : usr=1.83%, sys=2.01%, ctx=4198, majf=0, minf=1 00:23:11.615 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:11.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.615 issued rwts: total=0,6191,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.615 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.615 job3: (groupid=0, jobs=1): err= 0: pid=760993: Thu Nov 28 15:18:10 2024 00:23:11.615 write: IOPS=485, BW=121MiB/s (127MB/s)(1218MiB/10037msec); 0 zone resets 00:23:11.615 slat (usec): min=19, max=109515, avg=1482.68, stdev=4960.97 00:23:11.615 clat (usec): min=818, max=527725, avg=130285.64, stdev=88726.94 00:23:11.615 lat (usec): min=856, max=527822, avg=131768.31, stdev=89828.38 00:23:11.615 clat percentiles (msec): 00:23:11.615 | 1.00th=[ 5], 5.00th=[ 15], 10.00th=[ 38], 20.00th=[ 48], 00:23:11.615 | 30.00th=[ 66], 40.00th=[ 90], 50.00th=[ 124], 60.00th=[ 150], 00:23:11.615 | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 234], 95.00th=[ 300], 00:23:11.615 | 99.00th=[ 435], 99.50th=[ 464], 99.90th=[ 498], 99.95th=[ 527], 00:23:11.615 | 99.99th=[ 527] 00:23:11.615 bw ( KiB/s): min=47520, max=295936, per=8.76%, avg=123080.00, stdev=65634.67, samples=20 00:23:11.615 iops : min= 185, max= 1156, avg=480.75, stdev=256.42, samples=20 00:23:11.615 lat (usec) : 1000=0.02% 00:23:11.615 lat (msec) : 2=0.16%, 4=0.66%, 10=2.53%, 20=3.06%, 50=15.73% 00:23:11.615 lat (msec) : 100=21.58%, 250=47.61%, 500=8.60%, 750=0.06% 00:23:11.615 cpu : usr=1.54%, sys=1.45%, ctx=2581, majf=0, minf=1 00:23:11.615 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:11.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.615 issued rwts: total=0,4871,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.615 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.615 job4: (groupid=0, jobs=1): err= 0: pid=760994: Thu Nov 28 15:18:10 2024 00:23:11.615 write: IOPS=537, BW=134MiB/s (141MB/s)(1372MiB/10201msec); 0 zone resets 00:23:11.615 slat (usec): min=19, max=115081, avg=1614.37, stdev=3818.78 00:23:11.615 clat (msec): min=3, max=472, avg=117.32, stdev=64.94 00:23:11.615 lat (msec): min=3, max=472, avg=118.94, stdev=65.68 00:23:11.615 clat percentiles (msec): 00:23:11.615 | 1.00th=[ 15], 5.00th=[ 45], 10.00th=[ 47], 20.00th=[ 59], 00:23:11.615 | 30.00th=[ 77], 40.00th=[ 84], 50.00th=[ 104], 60.00th=[ 124], 00:23:11.615 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 201], 95.00th=[ 230], 00:23:11.615 | 99.00th=[ 305], 99.50th=[ 347], 99.90th=[ 456], 99.95th=[ 456], 00:23:11.615 | 99.99th=[ 472] 00:23:11.615 bw ( KiB/s): min=61952, max=287744, per=9.88%, avg=138809.15, stdev=69714.96, samples=20 00:23:11.615 iops : min= 242, max= 1124, avg=542.20, stdev=272.30, samples=20 00:23:11.615 lat (msec) : 4=0.04%, 10=0.57%, 20=0.66%, 50=15.79%, 100=31.66% 00:23:11.615 lat (msec) : 250=47.39%, 500=3.90% 00:23:11.615 cpu : usr=1.80%, sys=1.39%, ctx=1826, majf=0, minf=1 00:23:11.615 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:11.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.615 issued rwts: total=0,5486,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.615 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.615 job5: (groupid=0, jobs=1): err= 0: pid=760995: Thu Nov 28 15:18:10 2024 00:23:11.615 write: IOPS=365, BW=91.4MiB/s (95.8MB/s)(932MiB/10202msec); 0 zone resets 00:23:11.615 slat (usec): min=25, max=87456, avg=2343.28, stdev=5703.70 00:23:11.615 clat (usec): min=948, max=479506, avg=172353.01, stdev=81202.81 00:23:11.615 lat (usec): min=986, max=479559, avg=174696.29, stdev=82392.70 00:23:11.615 clat percentiles (msec): 00:23:11.615 | 1.00th=[ 16], 5.00th=[ 37], 10.00th=[ 60], 20.00th=[ 113], 00:23:11.615 | 30.00th=[ 134], 40.00th=[ 148], 50.00th=[ 167], 60.00th=[ 192], 00:23:11.615 | 70.00th=[ 209], 80.00th=[ 239], 90.00th=[ 268], 95.00th=[ 296], 00:23:11.615 | 99.00th=[ 414], 99.50th=[ 430], 99.90th=[ 464], 99.95th=[ 481], 00:23:11.615 | 99.99th=[ 481] 00:23:11.615 bw ( KiB/s): min=52736, max=231936, per=6.68%, avg=93843.80, stdev=44015.41, samples=20 00:23:11.615 iops : min= 206, max= 906, avg=366.55, stdev=171.96, samples=20 00:23:11.615 lat (usec) : 1000=0.05% 00:23:11.615 lat (msec) : 4=0.03%, 10=0.32%, 20=1.61%, 50=5.79%, 100=9.20% 00:23:11.615 lat (msec) : 250=67.12%, 500=15.88% 00:23:11.615 cpu : usr=1.20%, sys=1.20%, ctx=1602, majf=0, minf=1 00:23:11.615 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.9%, >=64=98.3% 00:23:11.615 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.615 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.615 issued rwts: total=0,3729,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.615 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.615 job6: (groupid=0, jobs=1): err= 0: pid=760999: Thu Nov 28 15:18:10 2024 00:23:11.615 write: IOPS=532, BW=133MiB/s (140MB/s)(1360MiB/10209msec); 0 zone resets 00:23:11.615 slat (usec): min=17, max=68316, avg=1265.48, stdev=3395.79 00:23:11.615 clat (usec): min=787, max=436014, avg=118746.97, stdev=64282.41 00:23:11.615 lat (usec): min=826, max=436083, avg=120012.45, stdev=64880.94 00:23:11.615 clat percentiles (msec): 00:23:11.616 | 1.00th=[ 13], 5.00th=[ 25], 10.00th=[ 43], 20.00th=[ 59], 00:23:11.616 | 30.00th=[ 82], 40.00th=[ 96], 50.00th=[ 120], 60.00th=[ 138], 00:23:11.616 | 70.00th=[ 148], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 222], 00:23:11.616 | 99.00th=[ 338], 99.50th=[ 372], 99.90th=[ 414], 99.95th=[ 426], 00:23:11.616 | 99.99th=[ 435] 00:23:11.616 bw ( KiB/s): min=75776, max=242176, per=9.80%, avg=137661.80, stdev=45004.75, samples=20 00:23:11.616 iops : min= 296, max= 946, avg=537.70, stdev=175.83, samples=20 00:23:11.616 lat (usec) : 1000=0.07% 00:23:11.616 lat (msec) : 2=0.11%, 4=0.07%, 10=0.53%, 20=2.44%, 50=13.03% 00:23:11.616 lat (msec) : 100=26.63%, 250=54.05%, 500=3.05% 00:23:11.616 cpu : usr=1.72%, sys=1.85%, ctx=3054, majf=0, minf=1 00:23:11.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:11.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.616 issued rwts: total=0,5441,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.616 job7: (groupid=0, jobs=1): err= 0: pid=761000: Thu Nov 28 15:18:10 2024 00:23:11.616 write: IOPS=413, BW=103MiB/s (108MB/s)(1055MiB/10204msec); 0 zone resets 00:23:11.616 slat (usec): min=19, max=170649, avg=1942.27, stdev=5473.54 00:23:11.616 clat (usec): min=1453, max=503381, avg=152794.20, stdev=89608.98 00:23:11.616 lat (usec): min=1503, max=503422, avg=154736.48, stdev=90797.30 00:23:11.616 clat percentiles (msec): 00:23:11.616 | 1.00th=[ 8], 5.00th=[ 29], 10.00th=[ 45], 20.00th=[ 69], 00:23:11.616 | 30.00th=[ 93], 40.00th=[ 124], 50.00th=[ 146], 60.00th=[ 163], 00:23:11.616 | 70.00th=[ 201], 80.00th=[ 230], 90.00th=[ 271], 95.00th=[ 292], 00:23:11.616 | 99.00th=[ 414], 99.50th=[ 477], 99.90th=[ 502], 99.95th=[ 502], 00:23:11.616 | 99.99th=[ 506] 00:23:11.616 bw ( KiB/s): min=47104, max=225792, per=7.57%, avg=106368.00, stdev=51712.90, samples=20 00:23:11.616 iops : min= 184, max= 882, avg=415.50, stdev=202.00, samples=20 00:23:11.616 lat (msec) : 2=0.05%, 4=0.40%, 10=1.23%, 20=1.66%, 50=10.62% 00:23:11.616 lat (msec) : 100=20.13%, 250=50.69%, 500=15.15%, 750=0.07% 00:23:11.616 cpu : usr=1.23%, sys=1.31%, ctx=2052, majf=0, minf=1 00:23:11.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:23:11.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.616 issued rwts: total=0,4218,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.616 job8: (groupid=0, jobs=1): err= 0: pid=761001: Thu Nov 28 15:18:10 2024 00:23:11.616 write: IOPS=387, BW=96.9MiB/s (102MB/s)(990MiB/10209msec); 0 zone resets 00:23:11.616 slat (usec): min=16, max=102800, avg=1697.58, stdev=5763.60 00:23:11.616 clat (usec): min=862, max=444090, avg=163180.45, stdev=100357.98 00:23:11.616 lat (usec): min=886, max=444126, avg=164878.03, stdev=101677.08 00:23:11.616 clat percentiles (msec): 00:23:11.616 | 1.00th=[ 3], 5.00th=[ 13], 10.00th=[ 26], 20.00th=[ 61], 00:23:11.616 | 30.00th=[ 102], 40.00th=[ 133], 50.00th=[ 165], 60.00th=[ 188], 00:23:11.616 | 70.00th=[ 213], 80.00th=[ 257], 90.00th=[ 300], 95.00th=[ 330], 00:23:11.616 | 99.00th=[ 397], 99.50th=[ 414], 99.90th=[ 439], 99.95th=[ 439], 00:23:11.616 | 99.99th=[ 443] 00:23:11.616 bw ( KiB/s): min=45056, max=212480, per=7.10%, avg=99745.10, stdev=49341.29, samples=20 00:23:11.616 iops : min= 176, max= 830, avg=389.60, stdev=192.75, samples=20 00:23:11.616 lat (usec) : 1000=0.23% 00:23:11.616 lat (msec) : 2=0.63%, 4=0.96%, 10=2.35%, 20=2.90%, 50=10.71% 00:23:11.616 lat (msec) : 100=11.85%, 250=49.13%, 500=21.24% 00:23:11.616 cpu : usr=1.15%, sys=1.26%, ctx=2305, majf=0, minf=1 00:23:11.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:23:11.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.616 issued rwts: total=0,3959,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.616 job9: (groupid=0, jobs=1): err= 0: pid=761002: Thu Nov 28 15:18:10 2024 00:23:11.616 write: IOPS=490, BW=123MiB/s (129MB/s)(1238MiB/10092msec); 0 zone resets 00:23:11.616 slat (usec): min=22, max=140403, avg=1748.61, stdev=4838.58 00:23:11.616 clat (msec): min=4, max=362, avg=128.63, stdev=66.09 00:23:11.616 lat (msec): min=5, max=366, avg=130.38, stdev=66.96 00:23:11.616 clat percentiles (msec): 00:23:11.616 | 1.00th=[ 14], 5.00th=[ 41], 10.00th=[ 71], 20.00th=[ 80], 00:23:11.616 | 30.00th=[ 87], 40.00th=[ 100], 50.00th=[ 117], 60.00th=[ 131], 00:23:11.616 | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 279], 00:23:11.616 | 99.00th=[ 342], 99.50th=[ 351], 99.90th=[ 359], 99.95th=[ 363], 00:23:11.616 | 99.99th=[ 363] 00:23:11.616 bw ( KiB/s): min=50688, max=196608, per=8.91%, avg=125163.75, stdev=47252.96, samples=20 00:23:11.616 iops : min= 198, max= 768, avg=488.90, stdev=184.62, samples=20 00:23:11.616 lat (msec) : 10=0.34%, 20=1.58%, 50=4.50%, 100=34.01%, 250=53.05% 00:23:11.616 lat (msec) : 500=6.52% 00:23:11.616 cpu : usr=1.46%, sys=1.53%, ctx=1981, majf=0, minf=1 00:23:11.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:23:11.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.616 issued rwts: total=0,4952,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.616 job10: (groupid=0, jobs=1): err= 0: pid=761009: Thu Nov 28 15:18:10 2024 00:23:11.616 write: IOPS=539, BW=135MiB/s (141MB/s)(1362MiB/10098msec); 0 zone resets 00:23:11.616 slat (usec): min=18, max=123320, avg=1073.28, stdev=4160.53 00:23:11.616 clat (usec): min=949, max=404425, avg=117540.43, stdev=95262.28 00:23:11.616 lat (usec): min=981, max=415598, avg=118613.71, stdev=96352.39 00:23:11.616 clat percentiles (msec): 00:23:11.616 | 1.00th=[ 3], 5.00th=[ 7], 10.00th=[ 12], 20.00th=[ 26], 00:23:11.616 | 30.00th=[ 45], 40.00th=[ 66], 50.00th=[ 96], 60.00th=[ 122], 00:23:11.616 | 70.00th=[ 165], 80.00th=[ 209], 90.00th=[ 262], 95.00th=[ 296], 00:23:11.616 | 99.00th=[ 363], 99.50th=[ 372], 99.90th=[ 393], 99.95th=[ 397], 00:23:11.616 | 99.99th=[ 405] 00:23:11.616 bw ( KiB/s): min=53248, max=276480, per=9.80%, avg=137788.60, stdev=67612.20, samples=20 00:23:11.616 iops : min= 208, max= 1080, avg=538.20, stdev=264.10, samples=20 00:23:11.616 lat (usec) : 1000=0.06% 00:23:11.616 lat (msec) : 2=0.50%, 4=1.52%, 10=6.32%, 20=8.23%, 50=15.66% 00:23:11.616 lat (msec) : 100=19.11%, 250=37.44%, 500=11.16% 00:23:11.616 cpu : usr=1.71%, sys=1.93%, ctx=3751, majf=0, minf=1 00:23:11.616 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:11.616 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:11.616 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:11.616 issued rwts: total=0,5446,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:11.616 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:11.616 00:23:11.616 Run status group 0 (all jobs): 00:23:11.616 WRITE: bw=1372MiB/s (1439MB/s), 91.4MiB/s-176MiB/s (95.8MB/s-184MB/s), io=13.7GiB (14.7GB), run=10037-10209msec 00:23:11.616 00:23:11.616 Disk stats (read/write): 00:23:11.616 nvme0n1: ios=50/14307, merge=0/0, ticks=3408/1227043, in_queue=1230451, util=99.88% 00:23:11.616 nvme10n1: ios=41/8814, merge=0/0, ticks=542/1219186, in_queue=1219728, util=100.00% 00:23:11.616 nvme1n1: ios=44/12167, merge=0/0, ticks=1266/1227647, in_queue=1228913, util=100.00% 00:23:11.616 nvme2n1: ios=41/9435, merge=0/0, ticks=285/1222346, in_queue=1222631, util=100.00% 00:23:11.616 nvme3n1: ios=0/10951, merge=0/0, ticks=0/1236720, in_queue=1236720, util=97.85% 00:23:11.617 nvme4n1: ios=43/7429, merge=0/0, ticks=1552/1229447, in_queue=1230999, util=100.00% 00:23:11.617 nvme5n1: ios=39/10852, merge=0/0, ticks=794/1244957, in_queue=1245751, util=100.00% 00:23:11.617 nvme6n1: ios=0/8414, merge=0/0, ticks=0/1240278, in_queue=1240278, util=98.48% 00:23:11.617 nvme7n1: ios=44/7887, merge=0/0, ticks=310/1245163, in_queue=1245473, util=100.00% 00:23:11.617 nvme8n1: ios=0/9689, merge=0/0, ticks=0/1213933, in_queue=1213933, util=98.97% 00:23:11.617 nvme9n1: ios=0/10626, merge=0/0, ticks=0/1215312, in_queue=1215312, util=99.10% 00:23:11.617 15:18:10 -- target/multiconnection.sh@36 -- # sync 00:23:11.617 15:18:10 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:11.617 15:18:10 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:11.617 15:18:10 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:11.617 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:11.617 15:18:11 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:11.617 15:18:11 -- common/autotest_common.sh@1208 -- # local i=0 00:23:11.617 15:18:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:11.617 15:18:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:11.617 15:18:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:11.617 15:18:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:11.617 15:18:11 -- common/autotest_common.sh@1220 -- # return 0 00:23:11.617 15:18:11 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:11.617 15:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.617 15:18:11 -- common/autotest_common.sh@10 -- # set +x 00:23:11.617 15:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.617 15:18:11 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:11.617 15:18:11 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:11.617 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:11.617 15:18:11 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:11.617 15:18:11 -- common/autotest_common.sh@1208 -- # local i=0 00:23:11.617 15:18:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:11.617 15:18:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:11.617 15:18:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:11.617 15:18:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:11.617 15:18:11 -- common/autotest_common.sh@1220 -- # return 0 00:23:11.617 15:18:11 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:11.617 15:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.617 15:18:11 -- common/autotest_common.sh@10 -- # set +x 00:23:11.617 15:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.617 15:18:11 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:11.617 15:18:11 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:11.617 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:11.617 15:18:11 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:11.617 15:18:11 -- common/autotest_common.sh@1208 -- # local i=0 00:23:11.617 15:18:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:11.617 15:18:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:11.617 15:18:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:11.617 15:18:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:11.617 15:18:11 -- common/autotest_common.sh@1220 -- # return 0 00:23:11.617 15:18:11 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:11.617 15:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.617 15:18:11 -- common/autotest_common.sh@10 -- # set +x 00:23:11.617 15:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.617 15:18:11 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:11.617 15:18:11 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:11.875 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:11.875 15:18:11 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:11.875 15:18:11 -- common/autotest_common.sh@1208 -- # local i=0 00:23:11.875 15:18:11 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:11.875 15:18:11 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:11.875 15:18:11 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:11.875 15:18:11 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:11.875 15:18:12 -- common/autotest_common.sh@1220 -- # return 0 00:23:11.875 15:18:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:11.875 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:11.875 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:23:11.875 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:11.875 15:18:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:11.875 15:18:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:12.135 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:12.135 15:18:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:12.135 15:18:12 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.135 15:18:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.135 15:18:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:12.135 15:18:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.135 15:18:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:12.135 15:18:12 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.135 15:18:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:12.135 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.135 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:23:12.135 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.135 15:18:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.135 15:18:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:12.395 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:12.395 15:18:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:12.395 15:18:12 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.395 15:18:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.395 15:18:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:12.395 15:18:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.395 15:18:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:12.395 15:18:12 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.395 15:18:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:12.395 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.395 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:23:12.395 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.395 15:18:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.395 15:18:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:12.655 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:12.655 15:18:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:12.655 15:18:12 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.655 15:18:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.655 15:18:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:12.655 15:18:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.655 15:18:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:12.655 15:18:12 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.655 15:18:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:12.655 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.655 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:23:12.655 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.655 15:18:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.655 15:18:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:12.914 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:12.914 15:18:12 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:12.914 15:18:12 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.914 15:18:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.914 15:18:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:12.914 15:18:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.914 15:18:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:12.914 15:18:12 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.914 15:18:12 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:12.914 15:18:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.914 15:18:12 -- common/autotest_common.sh@10 -- # set +x 00:23:12.914 15:18:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.914 15:18:12 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.914 15:18:12 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:12.914 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:12.915 15:18:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:12.915 15:18:13 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.915 15:18:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.915 15:18:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:12.915 15:18:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:12.915 15:18:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:12.915 15:18:13 -- common/autotest_common.sh@1220 -- # return 0 00:23:12.915 15:18:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:12.915 15:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:12.915 15:18:13 -- common/autotest_common.sh@10 -- # set +x 00:23:12.915 15:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:12.915 15:18:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:12.915 15:18:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:12.915 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:12.915 15:18:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:12.915 15:18:13 -- common/autotest_common.sh@1208 -- # local i=0 00:23:12.915 15:18:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:12.915 15:18:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:13.173 15:18:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.173 15:18:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:13.173 15:18:13 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.173 15:18:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:13.173 15:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.173 15:18:13 -- common/autotest_common.sh@10 -- # set +x 00:23:13.173 15:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.173 15:18:13 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:13.173 15:18:13 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:13.173 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:13.173 15:18:13 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:13.173 15:18:13 -- common/autotest_common.sh@1208 -- # local i=0 00:23:13.173 15:18:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:13.173 15:18:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:13.173 15:18:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:13.173 15:18:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:13.173 15:18:13 -- common/autotest_common.sh@1220 -- # return 0 00:23:13.173 15:18:13 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:13.173 15:18:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:13.173 15:18:13 -- common/autotest_common.sh@10 -- # set +x 00:23:13.173 15:18:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:13.173 15:18:13 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:13.173 15:18:13 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:13.173 15:18:13 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:13.173 15:18:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:13.173 15:18:13 -- nvmf/common.sh@116 -- # sync 00:23:13.173 15:18:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:13.173 15:18:13 -- nvmf/common.sh@119 -- # set +e 00:23:13.173 15:18:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:13.173 15:18:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:13.173 rmmod nvme_tcp 00:23:13.173 rmmod nvme_fabrics 00:23:13.173 rmmod nvme_keyring 00:23:13.173 15:18:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:13.173 15:18:13 -- nvmf/common.sh@123 -- # set -e 00:23:13.173 15:18:13 -- nvmf/common.sh@124 -- # return 0 00:23:13.173 15:18:13 -- nvmf/common.sh@477 -- # '[' -n 755253 ']' 00:23:13.173 15:18:13 -- nvmf/common.sh@478 -- # killprocess 755253 00:23:13.173 15:18:13 -- common/autotest_common.sh@936 -- # '[' -z 755253 ']' 00:23:13.173 15:18:13 -- common/autotest_common.sh@940 -- # kill -0 755253 00:23:13.173 15:18:13 -- common/autotest_common.sh@941 -- # uname 00:23:13.173 15:18:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:13.173 15:18:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 755253 00:23:13.173 15:18:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:13.173 15:18:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:13.173 15:18:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 755253' 00:23:13.173 killing process with pid 755253 00:23:13.173 15:18:13 -- common/autotest_common.sh@955 -- # kill 755253 00:23:13.173 15:18:13 -- common/autotest_common.sh@960 -- # wait 755253 00:23:13.739 15:18:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:13.739 15:18:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:13.739 15:18:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:13.739 15:18:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:13.739 15:18:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:13.739 15:18:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:13.739 15:18:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:13.739 15:18:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:16.277 15:18:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:16.277 00:23:16.277 real 1m1.316s 00:23:16.277 user 3m25.072s 00:23:16.277 sys 0m25.514s 00:23:16.277 15:18:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:16.277 15:18:15 -- common/autotest_common.sh@10 -- # set +x 00:23:16.277 ************************************ 00:23:16.277 END TEST nvmf_multiconnection 00:23:16.277 ************************************ 00:23:16.277 15:18:15 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:16.277 15:18:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:16.277 15:18:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:16.277 15:18:15 -- common/autotest_common.sh@10 -- # set +x 00:23:16.277 ************************************ 00:23:16.277 START TEST nvmf_initiator_timeout 00:23:16.277 ************************************ 00:23:16.277 15:18:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:16.277 * Looking for test storage... 00:23:16.277 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:16.277 15:18:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:16.277 15:18:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:16.277 15:18:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:16.277 15:18:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:16.277 15:18:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:16.277 15:18:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:16.278 15:18:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:16.278 15:18:16 -- scripts/common.sh@335 -- # IFS=.-: 00:23:16.278 15:18:16 -- scripts/common.sh@335 -- # read -ra ver1 00:23:16.278 15:18:16 -- scripts/common.sh@336 -- # IFS=.-: 00:23:16.278 15:18:16 -- scripts/common.sh@336 -- # read -ra ver2 00:23:16.278 15:18:16 -- scripts/common.sh@337 -- # local 'op=<' 00:23:16.278 15:18:16 -- scripts/common.sh@339 -- # ver1_l=2 00:23:16.278 15:18:16 -- scripts/common.sh@340 -- # ver2_l=1 00:23:16.278 15:18:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:16.278 15:18:16 -- scripts/common.sh@343 -- # case "$op" in 00:23:16.278 15:18:16 -- scripts/common.sh@344 -- # : 1 00:23:16.278 15:18:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:16.278 15:18:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:16.278 15:18:16 -- scripts/common.sh@364 -- # decimal 1 00:23:16.278 15:18:16 -- scripts/common.sh@352 -- # local d=1 00:23:16.278 15:18:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:16.278 15:18:16 -- scripts/common.sh@354 -- # echo 1 00:23:16.278 15:18:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:16.278 15:18:16 -- scripts/common.sh@365 -- # decimal 2 00:23:16.278 15:18:16 -- scripts/common.sh@352 -- # local d=2 00:23:16.278 15:18:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:16.278 15:18:16 -- scripts/common.sh@354 -- # echo 2 00:23:16.278 15:18:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:16.278 15:18:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:16.278 15:18:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:16.278 15:18:16 -- scripts/common.sh@367 -- # return 0 00:23:16.278 15:18:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:16.278 15:18:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:16.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.278 --rc genhtml_branch_coverage=1 00:23:16.278 --rc genhtml_function_coverage=1 00:23:16.278 --rc genhtml_legend=1 00:23:16.278 --rc geninfo_all_blocks=1 00:23:16.278 --rc geninfo_unexecuted_blocks=1 00:23:16.278 00:23:16.278 ' 00:23:16.278 15:18:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:16.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.278 --rc genhtml_branch_coverage=1 00:23:16.278 --rc genhtml_function_coverage=1 00:23:16.278 --rc genhtml_legend=1 00:23:16.278 --rc geninfo_all_blocks=1 00:23:16.278 --rc geninfo_unexecuted_blocks=1 00:23:16.278 00:23:16.278 ' 00:23:16.278 15:18:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:16.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.278 --rc genhtml_branch_coverage=1 00:23:16.278 --rc genhtml_function_coverage=1 00:23:16.278 --rc genhtml_legend=1 00:23:16.278 --rc geninfo_all_blocks=1 00:23:16.278 --rc geninfo_unexecuted_blocks=1 00:23:16.278 00:23:16.278 ' 00:23:16.278 15:18:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:16.278 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:16.278 --rc genhtml_branch_coverage=1 00:23:16.278 --rc genhtml_function_coverage=1 00:23:16.278 --rc genhtml_legend=1 00:23:16.278 --rc geninfo_all_blocks=1 00:23:16.278 --rc geninfo_unexecuted_blocks=1 00:23:16.278 00:23:16.278 ' 00:23:16.278 15:18:16 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:16.278 15:18:16 -- nvmf/common.sh@7 -- # uname -s 00:23:16.278 15:18:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:16.278 15:18:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:16.278 15:18:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:16.278 15:18:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:16.278 15:18:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:16.278 15:18:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:16.278 15:18:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:16.278 15:18:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:16.278 15:18:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:16.278 15:18:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:16.278 15:18:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:16.278 15:18:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:16.278 15:18:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:16.278 15:18:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:16.278 15:18:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:16.278 15:18:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:16.278 15:18:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:16.278 15:18:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:16.278 15:18:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:16.278 15:18:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.278 15:18:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.278 15:18:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.278 15:18:16 -- paths/export.sh@5 -- # export PATH 00:23:16.278 15:18:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:16.278 15:18:16 -- nvmf/common.sh@46 -- # : 0 00:23:16.278 15:18:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:16.278 15:18:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:16.278 15:18:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:16.278 15:18:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:16.278 15:18:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:16.278 15:18:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:16.278 15:18:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:16.278 15:18:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:16.278 15:18:16 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:16.278 15:18:16 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:16.278 15:18:16 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:16.278 15:18:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:16.278 15:18:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:16.278 15:18:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:16.278 15:18:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:16.278 15:18:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:16.278 15:18:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:16.278 15:18:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:16.278 15:18:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:16.278 15:18:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:16.278 15:18:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:16.278 15:18:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:16.278 15:18:16 -- common/autotest_common.sh@10 -- # set +x 00:23:18.186 15:18:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:18.186 15:18:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:18.186 15:18:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:18.186 15:18:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:18.186 15:18:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:18.186 15:18:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:18.186 15:18:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:18.186 15:18:18 -- nvmf/common.sh@294 -- # net_devs=() 00:23:18.186 15:18:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:18.186 15:18:18 -- nvmf/common.sh@295 -- # e810=() 00:23:18.186 15:18:18 -- nvmf/common.sh@295 -- # local -ga e810 00:23:18.186 15:18:18 -- nvmf/common.sh@296 -- # x722=() 00:23:18.186 15:18:18 -- nvmf/common.sh@296 -- # local -ga x722 00:23:18.186 15:18:18 -- nvmf/common.sh@297 -- # mlx=() 00:23:18.186 15:18:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:18.186 15:18:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:18.186 15:18:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:18.186 15:18:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:18.186 15:18:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:18.186 15:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:18.186 15:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:18.186 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:18.186 15:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:18.186 15:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:18.186 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:18.186 15:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:18.186 15:18:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:18.186 15:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:18.186 15:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:18.186 15:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:18.186 15:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:18.186 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:18.186 15:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:18.186 15:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:18.186 15:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:18.186 15:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:18.186 15:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:18.186 15:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:18.186 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:18.186 15:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:18.186 15:18:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:18.186 15:18:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:18.186 15:18:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:18.186 15:18:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:18.186 15:18:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:18.186 15:18:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:18.186 15:18:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:18.186 15:18:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:18.186 15:18:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:18.186 15:18:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:18.186 15:18:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:18.186 15:18:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:18.186 15:18:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:18.186 15:18:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:18.186 15:18:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:18.186 15:18:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:18.186 15:18:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:18.186 15:18:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:18.186 15:18:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:18.186 15:18:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:18.186 15:18:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:18.186 15:18:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:18.186 15:18:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:18.186 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:18.186 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.363 ms 00:23:18.186 00:23:18.186 --- 10.0.0.2 ping statistics --- 00:23:18.186 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.186 rtt min/avg/max/mdev = 0.363/0.363/0.363/0.000 ms 00:23:18.186 15:18:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:18.186 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:18.186 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:23:18.186 00:23:18.186 --- 10.0.0.1 ping statistics --- 00:23:18.186 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:18.186 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:23:18.186 15:18:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:18.186 15:18:18 -- nvmf/common.sh@410 -- # return 0 00:23:18.186 15:18:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:18.186 15:18:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:18.186 15:18:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:18.186 15:18:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:18.186 15:18:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:18.186 15:18:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:18.186 15:18:18 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:18.186 15:18:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:18.186 15:18:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:18.186 15:18:18 -- common/autotest_common.sh@10 -- # set +x 00:23:18.186 15:18:18 -- nvmf/common.sh@469 -- # nvmfpid=764963 00:23:18.186 15:18:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:18.186 15:18:18 -- nvmf/common.sh@470 -- # waitforlisten 764963 00:23:18.186 15:18:18 -- common/autotest_common.sh@829 -- # '[' -z 764963 ']' 00:23:18.186 15:18:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:18.186 15:18:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:18.186 15:18:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:18.186 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:18.186 15:18:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:18.186 15:18:18 -- common/autotest_common.sh@10 -- # set +x 00:23:18.186 [2024-11-28 15:18:18.242381] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:23:18.186 [2024-11-28 15:18:18.242469] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:18.186 EAL: No free 2048 kB hugepages reported on node 1 00:23:18.186 [2024-11-28 15:18:18.317281] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:18.186 [2024-11-28 15:18:18.417501] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:18.186 [2024-11-28 15:18:18.417660] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:18.186 [2024-11-28 15:18:18.417680] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:18.187 [2024-11-28 15:18:18.417695] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:18.187 [2024-11-28 15:18:18.417792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:18.445 [2024-11-28 15:18:18.420119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:18.445 [2024-11-28 15:18:18.420167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:18.445 [2024-11-28 15:18:18.420171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:19.385 15:18:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:19.385 15:18:19 -- common/autotest_common.sh@862 -- # return 0 00:23:19.385 15:18:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:19.385 15:18:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 15:18:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:19.385 15:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 Malloc0 00:23:19.385 15:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:19.385 15:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 Delay0 00:23:19.385 15:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:19.385 15:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 [2024-11-28 15:18:19.318714] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:19.385 15:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:19.385 15:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 15:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:19.385 15:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 15:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:19.385 15:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:19.385 15:18:19 -- common/autotest_common.sh@10 -- # set +x 00:23:19.385 [2024-11-28 15:18:19.346987] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:19.385 15:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:19.385 15:18:19 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:19.955 15:18:20 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:19.955 15:18:20 -- common/autotest_common.sh@1187 -- # local i=0 00:23:19.955 15:18:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:19.955 15:18:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:19.955 15:18:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:21.861 15:18:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:21.861 15:18:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:21.861 15:18:22 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:21.861 15:18:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:21.861 15:18:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:21.861 15:18:22 -- common/autotest_common.sh@1197 -- # return 0 00:23:21.861 15:18:22 -- target/initiator_timeout.sh@35 -- # fio_pid=765414 00:23:21.861 15:18:22 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:21.861 15:18:22 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:21.861 [global] 00:23:21.861 thread=1 00:23:21.861 invalidate=1 00:23:21.861 rw=write 00:23:21.861 time_based=1 00:23:21.861 runtime=60 00:23:21.861 ioengine=libaio 00:23:21.861 direct=1 00:23:21.861 bs=4096 00:23:21.861 iodepth=1 00:23:21.861 norandommap=0 00:23:21.861 numjobs=1 00:23:21.861 00:23:21.861 verify_dump=1 00:23:21.861 verify_backlog=512 00:23:21.861 verify_state_save=0 00:23:21.861 do_verify=1 00:23:21.861 verify=crc32c-intel 00:23:21.861 [job0] 00:23:21.861 filename=/dev/nvme0n1 00:23:22.119 Could not set queue depth (nvme0n1) 00:23:22.119 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:22.119 fio-3.35 00:23:22.120 Starting 1 thread 00:23:25.412 15:18:25 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:25.412 15:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.412 15:18:25 -- common/autotest_common.sh@10 -- # set +x 00:23:25.412 true 00:23:25.412 15:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.412 15:18:25 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:25.412 15:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.412 15:18:25 -- common/autotest_common.sh@10 -- # set +x 00:23:25.412 true 00:23:25.412 15:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.412 15:18:25 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:25.412 15:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.412 15:18:25 -- common/autotest_common.sh@10 -- # set +x 00:23:25.412 true 00:23:25.412 15:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.412 15:18:25 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:25.412 15:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:25.412 15:18:25 -- common/autotest_common.sh@10 -- # set +x 00:23:25.412 true 00:23:25.412 15:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:25.412 15:18:25 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:28.005 15:18:28 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:28.005 15:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.005 15:18:28 -- common/autotest_common.sh@10 -- # set +x 00:23:28.005 true 00:23:28.005 15:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.005 15:18:28 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:28.005 15:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.005 15:18:28 -- common/autotest_common.sh@10 -- # set +x 00:23:28.005 true 00:23:28.005 15:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.005 15:18:28 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:28.005 15:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.005 15:18:28 -- common/autotest_common.sh@10 -- # set +x 00:23:28.005 true 00:23:28.005 15:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.005 15:18:28 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:28.005 15:18:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:28.005 15:18:28 -- common/autotest_common.sh@10 -- # set +x 00:23:28.005 true 00:23:28.005 15:18:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:28.005 15:18:28 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:28.005 15:18:28 -- target/initiator_timeout.sh@54 -- # wait 765414 00:24:24.243 00:24:24.243 job0: (groupid=0, jobs=1): err= 0: pid=765605: Thu Nov 28 15:19:22 2024 00:24:24.243 read: IOPS=55, BW=222KiB/s (227kB/s)(13.0MiB/60027msec) 00:24:24.243 slat (nsec): min=4285, max=62475, avg=15299.58, stdev=9466.45 00:24:24.243 clat (usec): min=199, max=40838k, avg=17741.36, stdev=707299.42 00:24:24.243 lat (usec): min=204, max=40838k, avg=17756.66, stdev=707299.82 00:24:24.243 clat percentiles (usec): 00:24:24.243 | 1.00th=[ 215], 5.00th=[ 225], 10.00th=[ 233], 00:24:24.243 | 20.00th=[ 247], 30.00th=[ 253], 40.00th=[ 262], 00:24:24.243 | 50.00th=[ 273], 60.00th=[ 297], 70.00th=[ 322], 00:24:24.243 | 80.00th=[ 379], 90.00th=[ 41157], 95.00th=[ 41157], 00:24:24.243 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42730], 00:24:24.243 | 99.95th=[ 63701], 99.99th=[17112761] 00:24:24.243 write: IOPS=59, BW=239KiB/s (245kB/s)(14.0MiB/60027msec); 0 zone resets 00:24:24.243 slat (usec): min=5, max=27741, avg=19.40, stdev=463.24 00:24:24.243 clat (usec): min=159, max=526, avg=202.72, stdev=34.49 00:24:24.243 lat (usec): min=165, max=28011, avg=222.11, stdev=465.86 00:24:24.243 clat percentiles (usec): 00:24:24.243 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 174], 20.00th=[ 182], 00:24:24.243 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 200], 00:24:24.243 | 70.00th=[ 204], 80.00th=[ 215], 90.00th=[ 237], 95.00th=[ 265], 00:24:24.243 | 99.00th=[ 367], 99.50th=[ 383], 99.90th=[ 453], 99.95th=[ 494], 00:24:24.243 | 99.99th=[ 529] 00:24:24.243 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=7168.00, stdev=2048.00, samples=4 00:24:24.243 iops : min= 1024, max= 2048, avg=1792.00, stdev=512.00, samples=4 00:24:24.243 lat (usec) : 250=61.12%, 500=32.54%, 750=0.19% 00:24:24.243 lat (msec) : 20=0.01%, 50=6.11%, 100=0.01%, >=2000=0.01% 00:24:24.243 cpu : usr=0.07%, sys=0.19%, ctx=6923, majf=0, minf=1 00:24:24.243 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:24.243 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:24.243 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:24.243 issued rwts: total=3334,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:24.243 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:24.243 00:24:24.243 Run status group 0 (all jobs): 00:24:24.243 READ: bw=222KiB/s (227kB/s), 222KiB/s-222KiB/s (227kB/s-227kB/s), io=13.0MiB (13.7MB), run=60027-60027msec 00:24:24.243 WRITE: bw=239KiB/s (245kB/s), 239KiB/s-239KiB/s (245kB/s-245kB/s), io=14.0MiB (14.7MB), run=60027-60027msec 00:24:24.243 00:24:24.243 Disk stats (read/write): 00:24:24.243 nvme0n1: ios=3382/3584, merge=0/0, ticks=19360/689, in_queue=20049, util=99.80% 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:24.243 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:24.243 15:19:22 -- common/autotest_common.sh@1208 -- # local i=0 00:24:24.243 15:19:22 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:24.243 15:19:22 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:24.243 15:19:22 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:24.243 15:19:22 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:24.243 15:19:22 -- common/autotest_common.sh@1220 -- # return 0 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:24.243 nvmf hotplug test: fio successful as expected 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:24.243 15:19:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:24.243 15:19:22 -- common/autotest_common.sh@10 -- # set +x 00:24:24.243 15:19:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:24.243 15:19:22 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:24.243 15:19:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:24.243 15:19:22 -- nvmf/common.sh@116 -- # sync 00:24:24.243 15:19:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:24.243 15:19:22 -- nvmf/common.sh@119 -- # set +e 00:24:24.243 15:19:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:24.243 15:19:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:24.243 rmmod nvme_tcp 00:24:24.243 rmmod nvme_fabrics 00:24:24.243 rmmod nvme_keyring 00:24:24.243 15:19:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:24.243 15:19:22 -- nvmf/common.sh@123 -- # set -e 00:24:24.243 15:19:22 -- nvmf/common.sh@124 -- # return 0 00:24:24.243 15:19:22 -- nvmf/common.sh@477 -- # '[' -n 764963 ']' 00:24:24.243 15:19:22 -- nvmf/common.sh@478 -- # killprocess 764963 00:24:24.243 15:19:22 -- common/autotest_common.sh@936 -- # '[' -z 764963 ']' 00:24:24.243 15:19:22 -- common/autotest_common.sh@940 -- # kill -0 764963 00:24:24.243 15:19:22 -- common/autotest_common.sh@941 -- # uname 00:24:24.243 15:19:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:24.243 15:19:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 764963 00:24:24.243 15:19:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:24.243 15:19:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:24.243 15:19:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 764963' 00:24:24.243 killing process with pid 764963 00:24:24.243 15:19:22 -- common/autotest_common.sh@955 -- # kill 764963 00:24:24.243 15:19:22 -- common/autotest_common.sh@960 -- # wait 764963 00:24:24.243 15:19:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:24.243 15:19:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:24.243 15:19:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:24.243 15:19:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:24.244 15:19:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:24.244 15:19:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:24.244 15:19:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:24.244 15:19:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:24.814 15:19:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:24.815 00:24:24.815 real 1m9.071s 00:24:24.815 user 4m14.099s 00:24:24.815 sys 0m6.954s 00:24:24.815 15:19:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:24.815 15:19:24 -- common/autotest_common.sh@10 -- # set +x 00:24:24.815 ************************************ 00:24:24.815 END TEST nvmf_initiator_timeout 00:24:24.815 ************************************ 00:24:24.815 15:19:25 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:24.815 15:19:25 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:24.815 15:19:25 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:24.815 15:19:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:24.815 15:19:25 -- common/autotest_common.sh@10 -- # set +x 00:24:27.355 15:19:27 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:27.355 15:19:27 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:27.355 15:19:27 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:27.355 15:19:27 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:27.355 15:19:27 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:27.355 15:19:27 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:27.355 15:19:27 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:27.355 15:19:27 -- nvmf/common.sh@294 -- # net_devs=() 00:24:27.355 15:19:27 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:27.355 15:19:27 -- nvmf/common.sh@295 -- # e810=() 00:24:27.355 15:19:27 -- nvmf/common.sh@295 -- # local -ga e810 00:24:27.355 15:19:27 -- nvmf/common.sh@296 -- # x722=() 00:24:27.355 15:19:27 -- nvmf/common.sh@296 -- # local -ga x722 00:24:27.355 15:19:27 -- nvmf/common.sh@297 -- # mlx=() 00:24:27.355 15:19:27 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:27.355 15:19:27 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:27.355 15:19:27 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:27.355 15:19:27 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:27.355 15:19:27 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:27.355 15:19:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.355 15:19:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:27.355 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:27.355 15:19:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:27.355 15:19:27 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:27.355 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:27.355 15:19:27 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:27.355 15:19:27 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.355 15:19:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.355 15:19:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.355 15:19:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.355 15:19:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:27.355 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:27.355 15:19:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.355 15:19:27 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:27.355 15:19:27 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:27.355 15:19:27 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:27.355 15:19:27 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:27.355 15:19:27 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:27.355 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:27.355 15:19:27 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:27.355 15:19:27 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:27.355 15:19:27 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:27.355 15:19:27 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:27.355 15:19:27 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:27.355 15:19:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:27.355 15:19:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:27.355 15:19:27 -- common/autotest_common.sh@10 -- # set +x 00:24:27.355 ************************************ 00:24:27.355 START TEST nvmf_perf_adq 00:24:27.355 ************************************ 00:24:27.355 15:19:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:27.355 * Looking for test storage... 00:24:27.355 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:27.355 15:19:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:27.355 15:19:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:27.355 15:19:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:27.355 15:19:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:27.355 15:19:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:27.355 15:19:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:27.355 15:19:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:27.355 15:19:27 -- scripts/common.sh@335 -- # IFS=.-: 00:24:27.355 15:19:27 -- scripts/common.sh@335 -- # read -ra ver1 00:24:27.355 15:19:27 -- scripts/common.sh@336 -- # IFS=.-: 00:24:27.355 15:19:27 -- scripts/common.sh@336 -- # read -ra ver2 00:24:27.355 15:19:27 -- scripts/common.sh@337 -- # local 'op=<' 00:24:27.355 15:19:27 -- scripts/common.sh@339 -- # ver1_l=2 00:24:27.355 15:19:27 -- scripts/common.sh@340 -- # ver2_l=1 00:24:27.355 15:19:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:27.355 15:19:27 -- scripts/common.sh@343 -- # case "$op" in 00:24:27.355 15:19:27 -- scripts/common.sh@344 -- # : 1 00:24:27.355 15:19:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:27.355 15:19:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:27.355 15:19:27 -- scripts/common.sh@364 -- # decimal 1 00:24:27.355 15:19:27 -- scripts/common.sh@352 -- # local d=1 00:24:27.355 15:19:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:27.355 15:19:27 -- scripts/common.sh@354 -- # echo 1 00:24:27.355 15:19:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:27.355 15:19:27 -- scripts/common.sh@365 -- # decimal 2 00:24:27.355 15:19:27 -- scripts/common.sh@352 -- # local d=2 00:24:27.355 15:19:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:27.355 15:19:27 -- scripts/common.sh@354 -- # echo 2 00:24:27.355 15:19:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:27.355 15:19:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:27.355 15:19:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:27.355 15:19:27 -- scripts/common.sh@367 -- # return 0 00:24:27.355 15:19:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:27.355 15:19:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:27.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.355 --rc genhtml_branch_coverage=1 00:24:27.355 --rc genhtml_function_coverage=1 00:24:27.355 --rc genhtml_legend=1 00:24:27.355 --rc geninfo_all_blocks=1 00:24:27.355 --rc geninfo_unexecuted_blocks=1 00:24:27.355 00:24:27.355 ' 00:24:27.355 15:19:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:27.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.355 --rc genhtml_branch_coverage=1 00:24:27.355 --rc genhtml_function_coverage=1 00:24:27.355 --rc genhtml_legend=1 00:24:27.355 --rc geninfo_all_blocks=1 00:24:27.355 --rc geninfo_unexecuted_blocks=1 00:24:27.355 00:24:27.355 ' 00:24:27.355 15:19:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:27.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.355 --rc genhtml_branch_coverage=1 00:24:27.355 --rc genhtml_function_coverage=1 00:24:27.355 --rc genhtml_legend=1 00:24:27.355 --rc geninfo_all_blocks=1 00:24:27.355 --rc geninfo_unexecuted_blocks=1 00:24:27.355 00:24:27.355 ' 00:24:27.355 15:19:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:27.355 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:27.355 --rc genhtml_branch_coverage=1 00:24:27.355 --rc genhtml_function_coverage=1 00:24:27.355 --rc genhtml_legend=1 00:24:27.355 --rc geninfo_all_blocks=1 00:24:27.355 --rc geninfo_unexecuted_blocks=1 00:24:27.355 00:24:27.355 ' 00:24:27.355 15:19:27 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:27.355 15:19:27 -- nvmf/common.sh@7 -- # uname -s 00:24:27.355 15:19:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:27.355 15:19:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:27.355 15:19:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:27.355 15:19:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:27.355 15:19:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:27.355 15:19:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:27.355 15:19:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:27.356 15:19:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:27.356 15:19:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:27.356 15:19:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:27.356 15:19:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:27.356 15:19:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:27.356 15:19:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:27.356 15:19:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:27.356 15:19:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:27.356 15:19:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:27.356 15:19:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:27.356 15:19:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:27.356 15:19:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:27.356 15:19:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.356 15:19:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.356 15:19:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.356 15:19:27 -- paths/export.sh@5 -- # export PATH 00:24:27.356 15:19:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:27.356 15:19:27 -- nvmf/common.sh@46 -- # : 0 00:24:27.356 15:19:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:27.356 15:19:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:27.356 15:19:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:27.356 15:19:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:27.356 15:19:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:27.356 15:19:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:27.356 15:19:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:27.356 15:19:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:27.356 15:19:27 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:27.356 15:19:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:27.356 15:19:27 -- common/autotest_common.sh@10 -- # set +x 00:24:29.267 15:19:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:29.267 15:19:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:29.267 15:19:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:29.267 15:19:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:29.267 15:19:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:29.267 15:19:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:29.267 15:19:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:29.267 15:19:29 -- nvmf/common.sh@294 -- # net_devs=() 00:24:29.267 15:19:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:29.267 15:19:29 -- nvmf/common.sh@295 -- # e810=() 00:24:29.267 15:19:29 -- nvmf/common.sh@295 -- # local -ga e810 00:24:29.267 15:19:29 -- nvmf/common.sh@296 -- # x722=() 00:24:29.267 15:19:29 -- nvmf/common.sh@296 -- # local -ga x722 00:24:29.267 15:19:29 -- nvmf/common.sh@297 -- # mlx=() 00:24:29.267 15:19:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:29.267 15:19:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:29.267 15:19:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:29.267 15:19:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:29.267 15:19:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:29.267 15:19:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.267 15:19:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:29.267 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:29.267 15:19:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:29.267 15:19:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:29.267 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:29.267 15:19:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:29.267 15:19:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:29.267 15:19:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.267 15:19:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.267 15:19:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.267 15:19:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.267 15:19:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:29.267 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:29.267 15:19:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.267 15:19:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:29.267 15:19:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:29.267 15:19:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:29.267 15:19:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:29.267 15:19:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:29.267 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:29.267 15:19:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:29.267 15:19:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:29.267 15:19:29 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:29.267 15:19:29 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:29.267 15:19:29 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:29.267 15:19:29 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:29.267 15:19:29 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:29.835 15:19:29 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:32.372 15:19:32 -- target/perf_adq.sh@54 -- # sleep 5 00:24:37.654 15:19:37 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:37.654 15:19:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:37.654 15:19:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:37.654 15:19:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:37.654 15:19:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:37.654 15:19:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:37.654 15:19:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:37.654 15:19:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:37.654 15:19:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:37.654 15:19:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:37.654 15:19:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:37.654 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.654 15:19:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:37.654 15:19:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:37.654 15:19:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:37.654 15:19:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:37.654 15:19:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:37.654 15:19:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:37.654 15:19:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:37.654 15:19:37 -- nvmf/common.sh@294 -- # net_devs=() 00:24:37.654 15:19:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:37.654 15:19:37 -- nvmf/common.sh@295 -- # e810=() 00:24:37.654 15:19:37 -- nvmf/common.sh@295 -- # local -ga e810 00:24:37.654 15:19:37 -- nvmf/common.sh@296 -- # x722=() 00:24:37.654 15:19:37 -- nvmf/common.sh@296 -- # local -ga x722 00:24:37.654 15:19:37 -- nvmf/common.sh@297 -- # mlx=() 00:24:37.654 15:19:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:37.654 15:19:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:37.654 15:19:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:37.654 15:19:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:37.654 15:19:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:37.654 15:19:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:37.654 15:19:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:37.654 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:37.654 15:19:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:37.654 15:19:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:37.654 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:37.654 15:19:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:37.654 15:19:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:37.654 15:19:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:37.654 15:19:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:37.654 15:19:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:37.654 15:19:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:37.654 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:37.654 15:19:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:37.654 15:19:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:37.654 15:19:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:37.654 15:19:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:37.654 15:19:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:37.654 15:19:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:37.654 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:37.654 15:19:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:37.654 15:19:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:37.654 15:19:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:37.654 15:19:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:37.654 15:19:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:37.654 15:19:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:37.654 15:19:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:37.654 15:19:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:37.654 15:19:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:37.654 15:19:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:37.654 15:19:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:37.654 15:19:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:37.654 15:19:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:37.654 15:19:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:37.654 15:19:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:37.654 15:19:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:37.654 15:19:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:37.654 15:19:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:37.654 15:19:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:37.654 15:19:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:37.654 15:19:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:37.654 15:19:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:37.654 15:19:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:37.654 15:19:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:37.654 15:19:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:37.654 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:37.654 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.163 ms 00:24:37.654 00:24:37.654 --- 10.0.0.2 ping statistics --- 00:24:37.654 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:37.654 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:24:37.654 15:19:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:37.654 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:37.655 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:24:37.655 00:24:37.655 --- 10.0.0.1 ping statistics --- 00:24:37.655 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:37.655 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:24:37.655 15:19:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:37.655 15:19:37 -- nvmf/common.sh@410 -- # return 0 00:24:37.655 15:19:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:37.655 15:19:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:37.655 15:19:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:37.655 15:19:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:37.655 15:19:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:37.655 15:19:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:37.655 15:19:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:37.655 15:19:37 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:37.655 15:19:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:37.655 15:19:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 15:19:37 -- nvmf/common.sh@469 -- # nvmfpid=777410 00:24:37.655 15:19:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:37.655 15:19:37 -- nvmf/common.sh@470 -- # waitforlisten 777410 00:24:37.655 15:19:37 -- common/autotest_common.sh@829 -- # '[' -z 777410 ']' 00:24:37.655 15:19:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:37.655 15:19:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:37.655 15:19:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:37.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:37.655 15:19:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 [2024-11-28 15:19:37.403617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:37.655 [2024-11-28 15:19:37.403694] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:37.655 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.655 [2024-11-28 15:19:37.473055] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:37.655 [2024-11-28 15:19:37.565143] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:37.655 [2024-11-28 15:19:37.565317] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:37.655 [2024-11-28 15:19:37.565335] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:37.655 [2024-11-28 15:19:37.565350] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:37.655 [2024-11-28 15:19:37.565447] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:37.655 [2024-11-28 15:19:37.565505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:37.655 [2024-11-28 15:19:37.565561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:37.655 [2024-11-28 15:19:37.565564] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:37.655 15:19:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:37.655 15:19:37 -- common/autotest_common.sh@862 -- # return 0 00:24:37.655 15:19:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:37.655 15:19:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 15:19:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:37.655 15:19:37 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:37.655 15:19:37 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 [2024-11-28 15:19:37.754065] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 Malloc1 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:37.655 15:19:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.655 15:19:37 -- common/autotest_common.sh@10 -- # set +x 00:24:37.655 [2024-11-28 15:19:37.807243] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:37.655 15:19:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.655 15:19:37 -- target/perf_adq.sh@73 -- # perfpid=777562 00:24:37.655 15:19:37 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:37.655 15:19:37 -- target/perf_adq.sh@74 -- # sleep 2 00:24:37.655 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.191 15:19:39 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:40.191 15:19:39 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:40.191 15:19:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.191 15:19:39 -- common/autotest_common.sh@10 -- # set +x 00:24:40.191 15:19:39 -- target/perf_adq.sh@76 -- # wc -l 00:24:40.191 15:19:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.191 15:19:39 -- target/perf_adq.sh@76 -- # count=4 00:24:40.191 15:19:39 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:40.191 15:19:39 -- target/perf_adq.sh@81 -- # wait 777562 00:24:48.314 Initializing NVMe Controllers 00:24:48.314 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:48.314 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:48.314 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:48.314 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:48.314 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:48.314 Initialization complete. Launching workers. 00:24:48.314 ======================================================== 00:24:48.314 Latency(us) 00:24:48.314 Device Information : IOPS MiB/s Average min max 00:24:48.314 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 10854.20 42.40 5896.44 1828.41 10442.30 00:24:48.314 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11433.90 44.66 5597.33 1750.58 9125.97 00:24:48.314 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11744.70 45.88 5450.39 1554.10 8473.43 00:24:48.314 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11142.00 43.52 5744.55 1627.06 9758.42 00:24:48.314 ======================================================== 00:24:48.314 Total : 45174.78 176.46 5667.30 1554.10 10442.30 00:24:48.314 00:24:48.314 15:19:48 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:48.314 15:19:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:48.314 15:19:48 -- nvmf/common.sh@116 -- # sync 00:24:48.314 15:19:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:48.314 15:19:48 -- nvmf/common.sh@119 -- # set +e 00:24:48.314 15:19:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:48.314 15:19:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:48.314 rmmod nvme_tcp 00:24:48.314 rmmod nvme_fabrics 00:24:48.314 rmmod nvme_keyring 00:24:48.314 15:19:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:48.314 15:19:48 -- nvmf/common.sh@123 -- # set -e 00:24:48.314 15:19:48 -- nvmf/common.sh@124 -- # return 0 00:24:48.314 15:19:48 -- nvmf/common.sh@477 -- # '[' -n 777410 ']' 00:24:48.314 15:19:48 -- nvmf/common.sh@478 -- # killprocess 777410 00:24:48.314 15:19:48 -- common/autotest_common.sh@936 -- # '[' -z 777410 ']' 00:24:48.314 15:19:48 -- common/autotest_common.sh@940 -- # kill -0 777410 00:24:48.314 15:19:48 -- common/autotest_common.sh@941 -- # uname 00:24:48.314 15:19:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:48.314 15:19:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 777410 00:24:48.314 15:19:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:48.314 15:19:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:48.314 15:19:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 777410' 00:24:48.314 killing process with pid 777410 00:24:48.314 15:19:48 -- common/autotest_common.sh@955 -- # kill 777410 00:24:48.314 15:19:48 -- common/autotest_common.sh@960 -- # wait 777410 00:24:48.314 15:19:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:48.314 15:19:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:48.314 15:19:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:48.314 15:19:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:48.314 15:19:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:48.314 15:19:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:48.314 15:19:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:48.314 15:19:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:50.220 15:19:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:50.220 15:19:50 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:50.220 15:19:50 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:51.161 15:19:51 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:53.697 15:19:53 -- target/perf_adq.sh@54 -- # sleep 5 00:24:59.041 15:19:58 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:59.041 15:19:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:59.041 15:19:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:59.041 15:19:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:59.041 15:19:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:59.041 15:19:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:59.041 15:19:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.041 15:19:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.041 15:19:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:59.041 15:19:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:59.041 15:19:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:59.041 15:19:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:59.041 15:19:58 -- common/autotest_common.sh@10 -- # set +x 00:24:59.041 15:19:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:59.041 15:19:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:59.041 15:19:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:59.041 15:19:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:59.041 15:19:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:59.041 15:19:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:59.041 15:19:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:59.041 15:19:58 -- nvmf/common.sh@294 -- # net_devs=() 00:24:59.041 15:19:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:59.041 15:19:58 -- nvmf/common.sh@295 -- # e810=() 00:24:59.041 15:19:58 -- nvmf/common.sh@295 -- # local -ga e810 00:24:59.041 15:19:58 -- nvmf/common.sh@296 -- # x722=() 00:24:59.041 15:19:58 -- nvmf/common.sh@296 -- # local -ga x722 00:24:59.041 15:19:58 -- nvmf/common.sh@297 -- # mlx=() 00:24:59.041 15:19:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:59.041 15:19:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:59.041 15:19:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:59.041 15:19:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:59.041 15:19:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:59.041 15:19:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:59.041 15:19:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:59.042 15:19:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:59.042 15:19:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:59.042 15:19:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:59.042 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:59.042 15:19:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:59.042 15:19:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:59.042 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:59.042 15:19:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:59.042 15:19:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:59.042 15:19:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:59.042 15:19:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:59.042 15:19:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:59.042 15:19:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:59.042 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:59.042 15:19:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:59.042 15:19:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:59.042 15:19:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:59.042 15:19:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:59.042 15:19:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:59.042 15:19:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:59.042 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:59.042 15:19:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:59.042 15:19:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:59.042 15:19:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:59.042 15:19:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:59.042 15:19:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:59.042 15:19:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:59.042 15:19:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:59.042 15:19:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:59.042 15:19:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:59.042 15:19:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:59.042 15:19:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:59.042 15:19:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:59.042 15:19:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:59.042 15:19:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:59.042 15:19:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:59.042 15:19:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:59.042 15:19:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:59.042 15:19:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:59.042 15:19:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:59.042 15:19:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:59.042 15:19:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:59.042 15:19:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:59.042 15:19:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:59.042 15:19:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:59.042 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:59.042 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:24:59.042 00:24:59.042 --- 10.0.0.2 ping statistics --- 00:24:59.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:59.042 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:24:59.042 15:19:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:59.042 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:59.042 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:24:59.042 00:24:59.042 --- 10.0.0.1 ping statistics --- 00:24:59.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:59.042 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:24:59.042 15:19:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:59.042 15:19:58 -- nvmf/common.sh@410 -- # return 0 00:24:59.042 15:19:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:59.042 15:19:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:59.042 15:19:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:59.042 15:19:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:59.042 15:19:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:59.042 15:19:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:59.042 15:19:58 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:59.042 15:19:58 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:59.042 15:19:58 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:59.042 15:19:58 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:59.042 net.core.busy_poll = 1 00:24:59.042 15:19:58 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:59.042 net.core.busy_read = 1 00:24:59.042 15:19:58 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:59.042 15:19:58 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:59.042 15:19:58 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:59.042 15:19:58 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:59.042 15:19:58 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:59.042 15:19:58 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:59.042 15:19:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:59.042 15:19:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:59.042 15:19:58 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 15:19:58 -- nvmf/common.sh@469 -- # nvmfpid=780259 00:24:59.042 15:19:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:59.042 15:19:58 -- nvmf/common.sh@470 -- # waitforlisten 780259 00:24:59.042 15:19:58 -- common/autotest_common.sh@829 -- # '[' -z 780259 ']' 00:24:59.042 15:19:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:59.042 15:19:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:59.042 15:19:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:59.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:59.042 15:19:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:59.042 15:19:58 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 [2024-11-28 15:19:58.787432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:24:59.042 [2024-11-28 15:19:58.787517] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:59.042 EAL: No free 2048 kB hugepages reported on node 1 00:24:59.042 [2024-11-28 15:19:58.850296] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:59.042 [2024-11-28 15:19:58.934777] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:59.042 [2024-11-28 15:19:58.934935] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:59.042 [2024-11-28 15:19:58.934953] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:59.042 [2024-11-28 15:19:58.934965] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:59.042 [2024-11-28 15:19:58.935013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:59.042 [2024-11-28 15:19:58.935075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:59.042 [2024-11-28 15:19:58.935141] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:59.042 [2024-11-28 15:19:58.935144] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.042 15:19:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:59.042 15:19:59 -- common/autotest_common.sh@862 -- # return 0 00:24:59.042 15:19:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:59.042 15:19:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:59.042 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 15:19:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:59.042 15:19:59 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:59.042 15:19:59 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:59.042 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.042 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.042 15:19:59 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:59.042 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.042 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.042 15:19:59 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:59.042 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.042 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 [2024-11-28 15:19:59.137645] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:59.042 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.042 15:19:59 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:59.042 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.042 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.042 Malloc1 00:24:59.042 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.042 15:19:59 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:59.043 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.043 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.043 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.043 15:19:59 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:59.043 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.043 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.043 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.043 15:19:59 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:59.043 15:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:59.043 15:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:59.043 [2024-11-28 15:19:59.190320] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:59.043 15:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:59.043 15:19:59 -- target/perf_adq.sh@94 -- # perfpid=780284 00:24:59.043 15:19:59 -- target/perf_adq.sh@95 -- # sleep 2 00:24:59.043 15:19:59 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:59.043 EAL: No free 2048 kB hugepages reported on node 1 00:25:01.581 15:20:01 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:25:01.581 15:20:01 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:25:01.581 15:20:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:01.581 15:20:01 -- target/perf_adq.sh@97 -- # wc -l 00:25:01.581 15:20:01 -- common/autotest_common.sh@10 -- # set +x 00:25:01.581 15:20:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:01.581 15:20:01 -- target/perf_adq.sh@97 -- # count=2 00:25:01.581 15:20:01 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:25:01.581 15:20:01 -- target/perf_adq.sh@103 -- # wait 780284 00:25:09.698 Initializing NVMe Controllers 00:25:09.698 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:09.698 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:09.698 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:09.698 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:09.698 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:09.698 Initialization complete. Launching workers. 00:25:09.698 ======================================================== 00:25:09.698 Latency(us) 00:25:09.698 Device Information : IOPS MiB/s Average min max 00:25:09.698 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 4508.50 17.61 14250.48 1817.34 58354.07 00:25:09.698 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5104.40 19.94 12541.35 1720.50 59716.19 00:25:09.698 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5482.10 21.41 11677.61 1564.59 59681.46 00:25:09.698 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 14439.20 56.40 4432.54 1953.79 46088.26 00:25:09.698 ======================================================== 00:25:09.698 Total : 29534.20 115.37 8677.55 1564.59 59716.19 00:25:09.698 00:25:09.698 15:20:09 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:09.698 15:20:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:09.698 15:20:09 -- nvmf/common.sh@116 -- # sync 00:25:09.698 15:20:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:09.698 15:20:09 -- nvmf/common.sh@119 -- # set +e 00:25:09.698 15:20:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:09.698 15:20:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:09.698 rmmod nvme_tcp 00:25:09.698 rmmod nvme_fabrics 00:25:09.698 rmmod nvme_keyring 00:25:09.698 15:20:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:09.698 15:20:09 -- nvmf/common.sh@123 -- # set -e 00:25:09.698 15:20:09 -- nvmf/common.sh@124 -- # return 0 00:25:09.698 15:20:09 -- nvmf/common.sh@477 -- # '[' -n 780259 ']' 00:25:09.698 15:20:09 -- nvmf/common.sh@478 -- # killprocess 780259 00:25:09.698 15:20:09 -- common/autotest_common.sh@936 -- # '[' -z 780259 ']' 00:25:09.698 15:20:09 -- common/autotest_common.sh@940 -- # kill -0 780259 00:25:09.698 15:20:09 -- common/autotest_common.sh@941 -- # uname 00:25:09.698 15:20:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:09.698 15:20:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 780259 00:25:09.698 15:20:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:09.698 15:20:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:09.698 15:20:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 780259' 00:25:09.698 killing process with pid 780259 00:25:09.698 15:20:09 -- common/autotest_common.sh@955 -- # kill 780259 00:25:09.698 15:20:09 -- common/autotest_common.sh@960 -- # wait 780259 00:25:09.698 15:20:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:09.698 15:20:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:09.698 15:20:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:09.698 15:20:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:09.698 15:20:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:09.698 15:20:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:09.698 15:20:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:09.698 15:20:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:11.605 15:20:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:11.605 15:20:11 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:11.605 00:25:11.605 real 0m44.715s 00:25:11.605 user 2m38.060s 00:25:11.605 sys 0m10.040s 00:25:11.605 15:20:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:11.605 15:20:11 -- common/autotest_common.sh@10 -- # set +x 00:25:11.605 ************************************ 00:25:11.605 END TEST nvmf_perf_adq 00:25:11.605 ************************************ 00:25:11.605 15:20:11 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:11.605 15:20:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:11.605 15:20:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:11.605 15:20:11 -- common/autotest_common.sh@10 -- # set +x 00:25:11.605 ************************************ 00:25:11.605 START TEST nvmf_shutdown 00:25:11.605 ************************************ 00:25:11.605 15:20:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:11.605 * Looking for test storage... 00:25:11.605 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:11.605 15:20:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:11.864 15:20:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:11.864 15:20:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:11.864 15:20:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:11.864 15:20:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:11.864 15:20:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:11.864 15:20:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:11.864 15:20:11 -- scripts/common.sh@335 -- # IFS=.-: 00:25:11.865 15:20:11 -- scripts/common.sh@335 -- # read -ra ver1 00:25:11.865 15:20:11 -- scripts/common.sh@336 -- # IFS=.-: 00:25:11.865 15:20:11 -- scripts/common.sh@336 -- # read -ra ver2 00:25:11.865 15:20:11 -- scripts/common.sh@337 -- # local 'op=<' 00:25:11.865 15:20:11 -- scripts/common.sh@339 -- # ver1_l=2 00:25:11.865 15:20:11 -- scripts/common.sh@340 -- # ver2_l=1 00:25:11.865 15:20:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:11.865 15:20:11 -- scripts/common.sh@343 -- # case "$op" in 00:25:11.865 15:20:11 -- scripts/common.sh@344 -- # : 1 00:25:11.865 15:20:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:11.865 15:20:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:11.865 15:20:11 -- scripts/common.sh@364 -- # decimal 1 00:25:11.865 15:20:11 -- scripts/common.sh@352 -- # local d=1 00:25:11.865 15:20:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:11.865 15:20:11 -- scripts/common.sh@354 -- # echo 1 00:25:11.865 15:20:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:11.865 15:20:11 -- scripts/common.sh@365 -- # decimal 2 00:25:11.865 15:20:11 -- scripts/common.sh@352 -- # local d=2 00:25:11.865 15:20:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:11.865 15:20:11 -- scripts/common.sh@354 -- # echo 2 00:25:11.865 15:20:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:11.865 15:20:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:11.865 15:20:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:11.865 15:20:11 -- scripts/common.sh@367 -- # return 0 00:25:11.865 15:20:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:11.865 15:20:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:11.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:11.865 --rc genhtml_branch_coverage=1 00:25:11.865 --rc genhtml_function_coverage=1 00:25:11.865 --rc genhtml_legend=1 00:25:11.865 --rc geninfo_all_blocks=1 00:25:11.865 --rc geninfo_unexecuted_blocks=1 00:25:11.865 00:25:11.865 ' 00:25:11.865 15:20:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:11.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:11.865 --rc genhtml_branch_coverage=1 00:25:11.865 --rc genhtml_function_coverage=1 00:25:11.865 --rc genhtml_legend=1 00:25:11.865 --rc geninfo_all_blocks=1 00:25:11.865 --rc geninfo_unexecuted_blocks=1 00:25:11.865 00:25:11.865 ' 00:25:11.865 15:20:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:11.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:11.865 --rc genhtml_branch_coverage=1 00:25:11.865 --rc genhtml_function_coverage=1 00:25:11.865 --rc genhtml_legend=1 00:25:11.865 --rc geninfo_all_blocks=1 00:25:11.865 --rc geninfo_unexecuted_blocks=1 00:25:11.865 00:25:11.865 ' 00:25:11.865 15:20:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:11.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:11.865 --rc genhtml_branch_coverage=1 00:25:11.865 --rc genhtml_function_coverage=1 00:25:11.865 --rc genhtml_legend=1 00:25:11.865 --rc geninfo_all_blocks=1 00:25:11.865 --rc geninfo_unexecuted_blocks=1 00:25:11.865 00:25:11.865 ' 00:25:11.865 15:20:11 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:11.865 15:20:11 -- nvmf/common.sh@7 -- # uname -s 00:25:11.865 15:20:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:11.865 15:20:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:11.865 15:20:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:11.865 15:20:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:11.865 15:20:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:11.865 15:20:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:11.865 15:20:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:11.865 15:20:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:11.865 15:20:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:11.865 15:20:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:11.865 15:20:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:11.865 15:20:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:11.865 15:20:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:11.865 15:20:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:11.865 15:20:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:11.865 15:20:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:11.865 15:20:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:11.865 15:20:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:11.865 15:20:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:11.865 15:20:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.865 15:20:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.865 15:20:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.865 15:20:11 -- paths/export.sh@5 -- # export PATH 00:25:11.865 15:20:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:11.865 15:20:11 -- nvmf/common.sh@46 -- # : 0 00:25:11.865 15:20:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:11.865 15:20:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:11.865 15:20:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:11.865 15:20:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:11.865 15:20:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:11.865 15:20:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:11.865 15:20:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:11.865 15:20:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:11.865 15:20:11 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:11.865 15:20:11 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:11.865 15:20:11 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:11.865 15:20:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:11.865 15:20:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:11.865 15:20:11 -- common/autotest_common.sh@10 -- # set +x 00:25:11.865 ************************************ 00:25:11.866 START TEST nvmf_shutdown_tc1 00:25:11.866 ************************************ 00:25:11.866 15:20:11 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:11.866 15:20:11 -- target/shutdown.sh@74 -- # starttarget 00:25:11.866 15:20:11 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:11.866 15:20:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:11.866 15:20:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:11.866 15:20:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:11.866 15:20:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:11.866 15:20:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:11.866 15:20:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:11.866 15:20:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:11.866 15:20:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:11.866 15:20:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:11.866 15:20:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:11.866 15:20:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:11.866 15:20:11 -- common/autotest_common.sh@10 -- # set +x 00:25:14.400 15:20:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:14.400 15:20:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:14.400 15:20:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:14.400 15:20:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:14.400 15:20:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:14.400 15:20:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:14.400 15:20:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:14.400 15:20:14 -- nvmf/common.sh@294 -- # net_devs=() 00:25:14.400 15:20:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:14.400 15:20:14 -- nvmf/common.sh@295 -- # e810=() 00:25:14.400 15:20:14 -- nvmf/common.sh@295 -- # local -ga e810 00:25:14.400 15:20:14 -- nvmf/common.sh@296 -- # x722=() 00:25:14.400 15:20:14 -- nvmf/common.sh@296 -- # local -ga x722 00:25:14.400 15:20:14 -- nvmf/common.sh@297 -- # mlx=() 00:25:14.400 15:20:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:14.400 15:20:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:14.400 15:20:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:14.400 15:20:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:14.400 15:20:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:14.400 15:20:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:14.400 15:20:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:14.400 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:14.400 15:20:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:14.400 15:20:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:14.400 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:14.400 15:20:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:14.400 15:20:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:14.400 15:20:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:14.400 15:20:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:14.400 15:20:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:14.400 15:20:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:14.400 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:14.400 15:20:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:14.400 15:20:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:14.400 15:20:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:14.400 15:20:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:14.400 15:20:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:14.400 15:20:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:14.400 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:14.400 15:20:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:14.400 15:20:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:14.400 15:20:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:14.400 15:20:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:14.400 15:20:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:14.400 15:20:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:14.400 15:20:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:14.400 15:20:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:14.400 15:20:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:14.400 15:20:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:14.400 15:20:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:14.400 15:20:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:14.400 15:20:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:14.400 15:20:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:14.400 15:20:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:14.400 15:20:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:14.400 15:20:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:14.400 15:20:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:14.400 15:20:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:14.400 15:20:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:14.400 15:20:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:14.400 15:20:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:14.400 15:20:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:14.400 15:20:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:14.400 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:14.400 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.259 ms 00:25:14.400 00:25:14.400 --- 10.0.0.2 ping statistics --- 00:25:14.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.400 rtt min/avg/max/mdev = 0.259/0.259/0.259/0.000 ms 00:25:14.400 15:20:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:14.400 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:14.400 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:25:14.400 00:25:14.400 --- 10.0.0.1 ping statistics --- 00:25:14.400 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:14.400 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:25:14.400 15:20:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:14.400 15:20:14 -- nvmf/common.sh@410 -- # return 0 00:25:14.400 15:20:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:14.400 15:20:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:14.400 15:20:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:14.400 15:20:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:14.401 15:20:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:14.401 15:20:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:14.401 15:20:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:14.401 15:20:14 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:14.401 15:20:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:14.401 15:20:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:14.401 15:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:14.401 15:20:14 -- nvmf/common.sh@469 -- # nvmfpid=783617 00:25:14.401 15:20:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:14.401 15:20:14 -- nvmf/common.sh@470 -- # waitforlisten 783617 00:25:14.401 15:20:14 -- common/autotest_common.sh@829 -- # '[' -z 783617 ']' 00:25:14.401 15:20:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:14.401 15:20:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:14.401 15:20:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:14.401 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:14.401 15:20:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:14.401 15:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:14.401 [2024-11-28 15:20:14.262159] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:14.401 [2024-11-28 15:20:14.262226] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:14.401 EAL: No free 2048 kB hugepages reported on node 1 00:25:14.401 [2024-11-28 15:20:14.328016] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:14.401 [2024-11-28 15:20:14.417505] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:14.401 [2024-11-28 15:20:14.417662] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:14.401 [2024-11-28 15:20:14.417682] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:14.401 [2024-11-28 15:20:14.417696] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:14.401 [2024-11-28 15:20:14.417813] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:14.401 [2024-11-28 15:20:14.417909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:14.401 [2024-11-28 15:20:14.417968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:14.401 [2024-11-28 15:20:14.417965] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:15.338 15:20:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:15.338 15:20:15 -- common/autotest_common.sh@862 -- # return 0 00:25:15.338 15:20:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:15.338 15:20:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.338 15:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:15.338 15:20:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:15.338 15:20:15 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:15.338 15:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.338 15:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:15.338 [2024-11-28 15:20:15.239682] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:15.338 15:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.338 15:20:15 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:15.338 15:20:15 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:15.338 15:20:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:15.338 15:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:15.338 15:20:15 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:15.338 15:20:15 -- target/shutdown.sh@28 -- # cat 00:25:15.338 15:20:15 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:15.338 15:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.338 15:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:15.338 Malloc1 00:25:15.338 [2024-11-28 15:20:15.323778] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:15.338 Malloc2 00:25:15.338 Malloc3 00:25:15.338 Malloc4 00:25:15.338 Malloc5 00:25:15.338 Malloc6 00:25:15.597 Malloc7 00:25:15.597 Malloc8 00:25:15.597 Malloc9 00:25:15.597 Malloc10 00:25:15.597 15:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.597 15:20:15 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:15.597 15:20:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:15.597 15:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:15.597 15:20:15 -- target/shutdown.sh@78 -- # perfpid=783809 00:25:15.597 15:20:15 -- target/shutdown.sh@79 -- # waitforlisten 783809 /var/tmp/bdevperf.sock 00:25:15.597 15:20:15 -- common/autotest_common.sh@829 -- # '[' -z 783809 ']' 00:25:15.597 15:20:15 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:15.597 15:20:15 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:15.597 15:20:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:15.597 15:20:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:15.597 15:20:15 -- nvmf/common.sh@520 -- # config=() 00:25:15.597 15:20:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:15.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:15.597 15:20:15 -- nvmf/common.sh@520 -- # local subsystem config 00:25:15.597 15:20:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:15.597 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.597 15:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:15.597 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.597 { 00:25:15.597 "params": { 00:25:15.597 "name": "Nvme$subsystem", 00:25:15.597 "trtype": "$TEST_TRANSPORT", 00:25:15.597 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.597 "adrfam": "ipv4", 00:25:15.597 "trsvcid": "$NVMF_PORT", 00:25:15.597 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.597 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.597 "hdgst": ${hdgst:-false}, 00:25:15.597 "ddgst": ${ddgst:-false} 00:25:15.597 }, 00:25:15.597 "method": "bdev_nvme_attach_controller" 00:25:15.597 } 00:25:15.597 EOF 00:25:15.597 )") 00:25:15.597 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.597 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.597 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.597 { 00:25:15.597 "params": { 00:25:15.597 "name": "Nvme$subsystem", 00:25:15.597 "trtype": "$TEST_TRANSPORT", 00:25:15.597 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.597 "adrfam": "ipv4", 00:25:15.597 "trsvcid": "$NVMF_PORT", 00:25:15.597 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.597 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.597 "hdgst": ${hdgst:-false}, 00:25:15.597 "ddgst": ${ddgst:-false} 00:25:15.597 }, 00:25:15.597 "method": "bdev_nvme_attach_controller" 00:25:15.597 } 00:25:15.597 EOF 00:25:15.597 )") 00:25:15.597 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.597 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.597 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.597 { 00:25:15.597 "params": { 00:25:15.597 "name": "Nvme$subsystem", 00:25:15.597 "trtype": "$TEST_TRANSPORT", 00:25:15.597 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.597 "adrfam": "ipv4", 00:25:15.597 "trsvcid": "$NVMF_PORT", 00:25:15.597 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.597 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.597 "hdgst": ${hdgst:-false}, 00:25:15.597 "ddgst": ${ddgst:-false} 00:25:15.597 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:15.598 { 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme$subsystem", 00:25:15.598 "trtype": "$TEST_TRANSPORT", 00:25:15.598 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "$NVMF_PORT", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:15.598 "hdgst": ${hdgst:-false}, 00:25:15.598 "ddgst": ${ddgst:-false} 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 } 00:25:15.598 EOF 00:25:15.598 )") 00:25:15.598 15:20:15 -- nvmf/common.sh@542 -- # cat 00:25:15.598 15:20:15 -- nvmf/common.sh@544 -- # jq . 00:25:15.598 15:20:15 -- nvmf/common.sh@545 -- # IFS=, 00:25:15.598 15:20:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme1", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme2", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme3", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme4", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme5", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme6", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme7", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme8", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme9", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 },{ 00:25:15.598 "params": { 00:25:15.598 "name": "Nvme10", 00:25:15.598 "trtype": "tcp", 00:25:15.598 "traddr": "10.0.0.2", 00:25:15.598 "adrfam": "ipv4", 00:25:15.598 "trsvcid": "4420", 00:25:15.598 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:15.598 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:15.598 "hdgst": false, 00:25:15.598 "ddgst": false 00:25:15.598 }, 00:25:15.598 "method": "bdev_nvme_attach_controller" 00:25:15.598 }' 00:25:15.598 [2024-11-28 15:20:15.824883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:15.598 [2024-11-28 15:20:15.824959] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:15.857 EAL: No free 2048 kB hugepages reported on node 1 00:25:15.857 [2024-11-28 15:20:15.888437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:15.857 [2024-11-28 15:20:15.973636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:17.764 15:20:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:17.764 15:20:17 -- common/autotest_common.sh@862 -- # return 0 00:25:17.764 15:20:17 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:17.764 15:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:17.764 15:20:17 -- common/autotest_common.sh@10 -- # set +x 00:25:17.764 15:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:17.764 15:20:17 -- target/shutdown.sh@83 -- # kill -9 783809 00:25:17.764 15:20:17 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:17.764 15:20:17 -- target/shutdown.sh@87 -- # sleep 1 00:25:18.704 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 783809 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:18.704 15:20:18 -- target/shutdown.sh@88 -- # kill -0 783617 00:25:18.704 15:20:18 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:18.704 15:20:18 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:18.704 15:20:18 -- nvmf/common.sh@520 -- # config=() 00:25:18.704 15:20:18 -- nvmf/common.sh@520 -- # local subsystem config 00:25:18.704 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.704 { 00:25:18.704 "params": { 00:25:18.704 "name": "Nvme$subsystem", 00:25:18.704 "trtype": "$TEST_TRANSPORT", 00:25:18.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.704 "adrfam": "ipv4", 00:25:18.704 "trsvcid": "$NVMF_PORT", 00:25:18.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.704 "hdgst": ${hdgst:-false}, 00:25:18.704 "ddgst": ${ddgst:-false} 00:25:18.704 }, 00:25:18.704 "method": "bdev_nvme_attach_controller" 00:25:18.704 } 00:25:18.704 EOF 00:25:18.704 )") 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.704 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.704 { 00:25:18.704 "params": { 00:25:18.704 "name": "Nvme$subsystem", 00:25:18.704 "trtype": "$TEST_TRANSPORT", 00:25:18.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.704 "adrfam": "ipv4", 00:25:18.704 "trsvcid": "$NVMF_PORT", 00:25:18.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.704 "hdgst": ${hdgst:-false}, 00:25:18.704 "ddgst": ${ddgst:-false} 00:25:18.704 }, 00:25:18.704 "method": "bdev_nvme_attach_controller" 00:25:18.704 } 00:25:18.704 EOF 00:25:18.704 )") 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.704 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.704 { 00:25:18.704 "params": { 00:25:18.704 "name": "Nvme$subsystem", 00:25:18.704 "trtype": "$TEST_TRANSPORT", 00:25:18.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.704 "adrfam": "ipv4", 00:25:18.704 "trsvcid": "$NVMF_PORT", 00:25:18.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.704 "hdgst": ${hdgst:-false}, 00:25:18.704 "ddgst": ${ddgst:-false} 00:25:18.704 }, 00:25:18.704 "method": "bdev_nvme_attach_controller" 00:25:18.704 } 00:25:18.704 EOF 00:25:18.704 )") 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.704 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.704 { 00:25:18.704 "params": { 00:25:18.704 "name": "Nvme$subsystem", 00:25:18.704 "trtype": "$TEST_TRANSPORT", 00:25:18.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.704 "adrfam": "ipv4", 00:25:18.704 "trsvcid": "$NVMF_PORT", 00:25:18.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.704 "hdgst": ${hdgst:-false}, 00:25:18.704 "ddgst": ${ddgst:-false} 00:25:18.704 }, 00:25:18.704 "method": "bdev_nvme_attach_controller" 00:25:18.704 } 00:25:18.704 EOF 00:25:18.704 )") 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.704 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.704 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.704 { 00:25:18.704 "params": { 00:25:18.704 "name": "Nvme$subsystem", 00:25:18.704 "trtype": "$TEST_TRANSPORT", 00:25:18.704 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.704 "adrfam": "ipv4", 00:25:18.704 "trsvcid": "$NVMF_PORT", 00:25:18.704 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.704 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.704 "hdgst": ${hdgst:-false}, 00:25:18.705 "ddgst": ${ddgst:-false} 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 } 00:25:18.705 EOF 00:25:18.705 )") 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.705 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.705 { 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme$subsystem", 00:25:18.705 "trtype": "$TEST_TRANSPORT", 00:25:18.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "$NVMF_PORT", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.705 "hdgst": ${hdgst:-false}, 00:25:18.705 "ddgst": ${ddgst:-false} 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 } 00:25:18.705 EOF 00:25:18.705 )") 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.705 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.705 { 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme$subsystem", 00:25:18.705 "trtype": "$TEST_TRANSPORT", 00:25:18.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "$NVMF_PORT", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.705 "hdgst": ${hdgst:-false}, 00:25:18.705 "ddgst": ${ddgst:-false} 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 } 00:25:18.705 EOF 00:25:18.705 )") 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.705 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.705 { 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme$subsystem", 00:25:18.705 "trtype": "$TEST_TRANSPORT", 00:25:18.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "$NVMF_PORT", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.705 "hdgst": ${hdgst:-false}, 00:25:18.705 "ddgst": ${ddgst:-false} 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 } 00:25:18.705 EOF 00:25:18.705 )") 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.705 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.705 { 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme$subsystem", 00:25:18.705 "trtype": "$TEST_TRANSPORT", 00:25:18.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "$NVMF_PORT", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.705 "hdgst": ${hdgst:-false}, 00:25:18.705 "ddgst": ${ddgst:-false} 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 } 00:25:18.705 EOF 00:25:18.705 )") 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.705 15:20:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:18.705 { 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme$subsystem", 00:25:18.705 "trtype": "$TEST_TRANSPORT", 00:25:18.705 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "$NVMF_PORT", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:18.705 "hdgst": ${hdgst:-false}, 00:25:18.705 "ddgst": ${ddgst:-false} 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 } 00:25:18.705 EOF 00:25:18.705 )") 00:25:18.705 15:20:18 -- nvmf/common.sh@542 -- # cat 00:25:18.705 15:20:18 -- nvmf/common.sh@544 -- # jq . 00:25:18.705 15:20:18 -- nvmf/common.sh@545 -- # IFS=, 00:25:18.705 15:20:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme1", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme2", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme3", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme4", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme5", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme6", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme7", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme8", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme9", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 },{ 00:25:18.705 "params": { 00:25:18.705 "name": "Nvme10", 00:25:18.705 "trtype": "tcp", 00:25:18.705 "traddr": "10.0.0.2", 00:25:18.705 "adrfam": "ipv4", 00:25:18.705 "trsvcid": "4420", 00:25:18.705 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:18.705 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:18.705 "hdgst": false, 00:25:18.705 "ddgst": false 00:25:18.705 }, 00:25:18.705 "method": "bdev_nvme_attach_controller" 00:25:18.705 }' 00:25:18.705 [2024-11-28 15:20:18.618397] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:18.705 [2024-11-28 15:20:18.618484] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid784123 ] 00:25:18.705 EAL: No free 2048 kB hugepages reported on node 1 00:25:18.705 [2024-11-28 15:20:18.686833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:18.705 [2024-11-28 15:20:18.775274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:20.607 Running I/O for 1 seconds... 00:25:21.542 00:25:21.542 Latency(us) 00:25:21.542 [2024-11-28T14:20:21.776Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme1n1 : 1.07 404.86 25.30 0.00 0.00 155264.17 18350.08 133596.35 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme2n1 : 1.06 376.43 23.53 0.00 0.00 164064.19 41554.68 143693.75 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme3n1 : 1.07 406.17 25.39 0.00 0.00 152506.71 18544.26 119615.34 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme4n1 : 1.07 404.10 25.26 0.00 0.00 152149.22 18932.62 117285.17 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme5n1 : 1.08 401.88 25.12 0.00 0.00 152081.44 17670.45 115731.72 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme6n1 : 1.09 398.51 24.91 0.00 0.00 153478.57 7330.32 125052.40 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme7n1 : 1.09 399.73 24.98 0.00 0.00 150997.34 15146.10 128159.29 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme8n1 : 1.08 410.40 25.65 0.00 0.00 145872.52 6213.78 121945.51 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme9n1 : 1.09 401.75 25.11 0.00 0.00 148889.69 8932.31 121945.51 00:25:21.542 [2024-11-28T14:20:21.776Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:21.542 Verification LBA range: start 0x0 length 0x400 00:25:21.542 Nvme10n1 : 1.10 396.18 24.76 0.00 0.00 150371.70 4927.34 144470.47 00:25:21.542 [2024-11-28T14:20:21.776Z] =================================================================================================================== 00:25:21.542 [2024-11-28T14:20:21.776Z] Total : 4000.01 250.00 0.00 0.00 152455.02 4927.34 144470.47 00:25:21.826 15:20:21 -- target/shutdown.sh@93 -- # stoptarget 00:25:21.826 15:20:21 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:21.826 15:20:21 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:21.826 15:20:21 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:21.826 15:20:21 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:21.826 15:20:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:21.826 15:20:21 -- nvmf/common.sh@116 -- # sync 00:25:21.826 15:20:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:21.826 15:20:21 -- nvmf/common.sh@119 -- # set +e 00:25:21.826 15:20:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:21.826 15:20:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:21.826 rmmod nvme_tcp 00:25:21.826 rmmod nvme_fabrics 00:25:21.826 rmmod nvme_keyring 00:25:21.826 15:20:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:21.826 15:20:21 -- nvmf/common.sh@123 -- # set -e 00:25:21.826 15:20:21 -- nvmf/common.sh@124 -- # return 0 00:25:21.826 15:20:21 -- nvmf/common.sh@477 -- # '[' -n 783617 ']' 00:25:21.826 15:20:21 -- nvmf/common.sh@478 -- # killprocess 783617 00:25:21.826 15:20:21 -- common/autotest_common.sh@936 -- # '[' -z 783617 ']' 00:25:21.826 15:20:21 -- common/autotest_common.sh@940 -- # kill -0 783617 00:25:21.826 15:20:21 -- common/autotest_common.sh@941 -- # uname 00:25:21.826 15:20:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:21.826 15:20:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 783617 00:25:21.826 15:20:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:21.826 15:20:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:21.826 15:20:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 783617' 00:25:21.826 killing process with pid 783617 00:25:21.826 15:20:21 -- common/autotest_common.sh@955 -- # kill 783617 00:25:21.826 15:20:21 -- common/autotest_common.sh@960 -- # wait 783617 00:25:22.395 15:20:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:22.395 15:20:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:22.395 15:20:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:22.395 15:20:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:22.395 15:20:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:22.395 15:20:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:22.395 15:20:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:22.395 15:20:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.300 15:20:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:24.300 00:25:24.300 real 0m12.566s 00:25:24.300 user 0m37.216s 00:25:24.300 sys 0m3.335s 00:25:24.300 15:20:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:24.300 15:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:24.300 ************************************ 00:25:24.300 END TEST nvmf_shutdown_tc1 00:25:24.300 ************************************ 00:25:24.559 15:20:24 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:24.559 15:20:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:24.559 15:20:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:24.559 15:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:24.559 ************************************ 00:25:24.559 START TEST nvmf_shutdown_tc2 00:25:24.559 ************************************ 00:25:24.559 15:20:24 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:24.559 15:20:24 -- target/shutdown.sh@98 -- # starttarget 00:25:24.559 15:20:24 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:24.559 15:20:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:24.559 15:20:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:24.559 15:20:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:24.559 15:20:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:24.559 15:20:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:24.559 15:20:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:24.560 15:20:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:24.560 15:20:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:24.560 15:20:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:24.560 15:20:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:24.560 15:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:24.560 15:20:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:24.560 15:20:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:24.560 15:20:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:24.560 15:20:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:24.560 15:20:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:24.560 15:20:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:24.560 15:20:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:24.560 15:20:24 -- nvmf/common.sh@294 -- # net_devs=() 00:25:24.560 15:20:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:24.560 15:20:24 -- nvmf/common.sh@295 -- # e810=() 00:25:24.560 15:20:24 -- nvmf/common.sh@295 -- # local -ga e810 00:25:24.560 15:20:24 -- nvmf/common.sh@296 -- # x722=() 00:25:24.560 15:20:24 -- nvmf/common.sh@296 -- # local -ga x722 00:25:24.560 15:20:24 -- nvmf/common.sh@297 -- # mlx=() 00:25:24.560 15:20:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:24.560 15:20:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:24.560 15:20:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:24.560 15:20:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:24.560 15:20:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:24.560 15:20:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.560 15:20:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:24.560 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:24.560 15:20:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:24.560 15:20:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:24.560 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:24.560 15:20:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:24.560 15:20:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.560 15:20:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.560 15:20:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.560 15:20:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.560 15:20:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:24.560 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:24.560 15:20:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.560 15:20:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:24.560 15:20:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:24.560 15:20:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:24.560 15:20:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:24.560 15:20:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:24.560 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:24.560 15:20:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:24.560 15:20:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:24.560 15:20:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:24.560 15:20:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:24.560 15:20:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:24.560 15:20:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:24.560 15:20:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:24.560 15:20:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:24.560 15:20:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:24.560 15:20:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:24.560 15:20:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:24.560 15:20:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:24.560 15:20:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:24.560 15:20:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:24.560 15:20:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:24.560 15:20:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:24.560 15:20:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:24.560 15:20:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:24.560 15:20:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:24.560 15:20:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:24.560 15:20:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:24.560 15:20:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:24.560 15:20:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:24.560 15:20:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:24.560 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:24.560 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:25:24.560 00:25:24.560 --- 10.0.0.2 ping statistics --- 00:25:24.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.560 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:25:24.560 15:20:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:24.560 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:24.560 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.135 ms 00:25:24.560 00:25:24.560 --- 10.0.0.1 ping statistics --- 00:25:24.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:24.560 rtt min/avg/max/mdev = 0.135/0.135/0.135/0.000 ms 00:25:24.560 15:20:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:24.560 15:20:24 -- nvmf/common.sh@410 -- # return 0 00:25:24.560 15:20:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:24.560 15:20:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:24.560 15:20:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:24.560 15:20:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:24.560 15:20:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:24.560 15:20:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:24.560 15:20:24 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:24.560 15:20:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:24.560 15:20:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:24.560 15:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:24.560 15:20:24 -- nvmf/common.sh@469 -- # nvmfpid=785021 00:25:24.560 15:20:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:24.560 15:20:24 -- nvmf/common.sh@470 -- # waitforlisten 785021 00:25:24.560 15:20:24 -- common/autotest_common.sh@829 -- # '[' -z 785021 ']' 00:25:24.560 15:20:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:24.560 15:20:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:24.560 15:20:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:24.560 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:24.560 15:20:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:24.560 15:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:24.560 [2024-11-28 15:20:24.755019] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:24.560 [2024-11-28 15:20:24.755119] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:24.560 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.820 [2024-11-28 15:20:24.819196] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:24.820 [2024-11-28 15:20:24.906817] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:24.820 [2024-11-28 15:20:24.906967] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:24.820 [2024-11-28 15:20:24.906984] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:24.820 [2024-11-28 15:20:24.906996] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:24.820 [2024-11-28 15:20:24.907084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:24.820 [2024-11-28 15:20:24.907158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:24.820 [2024-11-28 15:20:24.907220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:24.820 [2024-11-28 15:20:24.907222] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:25.755 15:20:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:25.755 15:20:25 -- common/autotest_common.sh@862 -- # return 0 00:25:25.755 15:20:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:25.755 15:20:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:25.755 15:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:25.755 15:20:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:25.755 15:20:25 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:25.755 15:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.755 15:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:25.755 [2024-11-28 15:20:25.802905] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:25.755 15:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.755 15:20:25 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:25.755 15:20:25 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:25.755 15:20:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:25.755 15:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:25.755 15:20:25 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:25.755 15:20:25 -- target/shutdown.sh@28 -- # cat 00:25:25.755 15:20:25 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:25.755 15:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.755 15:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:25.755 Malloc1 00:25:25.755 [2024-11-28 15:20:25.885938] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:25.755 Malloc2 00:25:25.755 Malloc3 00:25:26.014 Malloc4 00:25:26.014 Malloc5 00:25:26.014 Malloc6 00:25:26.014 Malloc7 00:25:26.014 Malloc8 00:25:26.272 Malloc9 00:25:26.272 Malloc10 00:25:26.272 15:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.272 15:20:26 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:26.272 15:20:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:26.272 15:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:26.272 15:20:26 -- target/shutdown.sh@102 -- # perfpid=785221 00:25:26.272 15:20:26 -- target/shutdown.sh@103 -- # waitforlisten 785221 /var/tmp/bdevperf.sock 00:25:26.272 15:20:26 -- common/autotest_common.sh@829 -- # '[' -z 785221 ']' 00:25:26.272 15:20:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:26.272 15:20:26 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:26.272 15:20:26 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:26.272 15:20:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:26.272 15:20:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:26.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:26.272 15:20:26 -- nvmf/common.sh@520 -- # config=() 00:25:26.272 15:20:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:26.272 15:20:26 -- nvmf/common.sh@520 -- # local subsystem config 00:25:26.272 15:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:26.272 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.272 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.272 { 00:25:26.272 "params": { 00:25:26.272 "name": "Nvme$subsystem", 00:25:26.272 "trtype": "$TEST_TRANSPORT", 00:25:26.272 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.272 "adrfam": "ipv4", 00:25:26.272 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:26.273 { 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme$subsystem", 00:25:26.273 "trtype": "$TEST_TRANSPORT", 00:25:26.273 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "$NVMF_PORT", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:26.273 "hdgst": ${hdgst:-false}, 00:25:26.273 "ddgst": ${ddgst:-false} 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 } 00:25:26.273 EOF 00:25:26.273 )") 00:25:26.273 15:20:26 -- nvmf/common.sh@542 -- # cat 00:25:26.273 15:20:26 -- nvmf/common.sh@544 -- # jq . 00:25:26.273 15:20:26 -- nvmf/common.sh@545 -- # IFS=, 00:25:26.273 15:20:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme1", 00:25:26.273 "trtype": "tcp", 00:25:26.273 "traddr": "10.0.0.2", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "4420", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:26.273 "hdgst": false, 00:25:26.273 "ddgst": false 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 },{ 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme2", 00:25:26.273 "trtype": "tcp", 00:25:26.273 "traddr": "10.0.0.2", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "4420", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:26.273 "hdgst": false, 00:25:26.273 "ddgst": false 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 },{ 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme3", 00:25:26.273 "trtype": "tcp", 00:25:26.273 "traddr": "10.0.0.2", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "4420", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:26.273 "hdgst": false, 00:25:26.273 "ddgst": false 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 },{ 00:25:26.273 "params": { 00:25:26.273 "name": "Nvme4", 00:25:26.273 "trtype": "tcp", 00:25:26.273 "traddr": "10.0.0.2", 00:25:26.273 "adrfam": "ipv4", 00:25:26.273 "trsvcid": "4420", 00:25:26.273 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:26.273 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:26.273 "hdgst": false, 00:25:26.273 "ddgst": false 00:25:26.273 }, 00:25:26.273 "method": "bdev_nvme_attach_controller" 00:25:26.273 },{ 00:25:26.274 "params": { 00:25:26.274 "name": "Nvme5", 00:25:26.274 "trtype": "tcp", 00:25:26.274 "traddr": "10.0.0.2", 00:25:26.274 "adrfam": "ipv4", 00:25:26.274 "trsvcid": "4420", 00:25:26.274 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:26.274 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:26.274 "hdgst": false, 00:25:26.274 "ddgst": false 00:25:26.274 }, 00:25:26.274 "method": "bdev_nvme_attach_controller" 00:25:26.274 },{ 00:25:26.274 "params": { 00:25:26.274 "name": "Nvme6", 00:25:26.274 "trtype": "tcp", 00:25:26.274 "traddr": "10.0.0.2", 00:25:26.274 "adrfam": "ipv4", 00:25:26.274 "trsvcid": "4420", 00:25:26.274 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:26.274 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:26.274 "hdgst": false, 00:25:26.274 "ddgst": false 00:25:26.274 }, 00:25:26.274 "method": "bdev_nvme_attach_controller" 00:25:26.274 },{ 00:25:26.274 "params": { 00:25:26.274 "name": "Nvme7", 00:25:26.274 "trtype": "tcp", 00:25:26.274 "traddr": "10.0.0.2", 00:25:26.274 "adrfam": "ipv4", 00:25:26.274 "trsvcid": "4420", 00:25:26.274 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:26.274 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:26.274 "hdgst": false, 00:25:26.274 "ddgst": false 00:25:26.274 }, 00:25:26.274 "method": "bdev_nvme_attach_controller" 00:25:26.274 },{ 00:25:26.274 "params": { 00:25:26.274 "name": "Nvme8", 00:25:26.274 "trtype": "tcp", 00:25:26.274 "traddr": "10.0.0.2", 00:25:26.274 "adrfam": "ipv4", 00:25:26.274 "trsvcid": "4420", 00:25:26.274 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:26.274 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:26.274 "hdgst": false, 00:25:26.274 "ddgst": false 00:25:26.274 }, 00:25:26.274 "method": "bdev_nvme_attach_controller" 00:25:26.274 },{ 00:25:26.274 "params": { 00:25:26.274 "name": "Nvme9", 00:25:26.274 "trtype": "tcp", 00:25:26.274 "traddr": "10.0.0.2", 00:25:26.274 "adrfam": "ipv4", 00:25:26.274 "trsvcid": "4420", 00:25:26.274 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:26.274 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:26.274 "hdgst": false, 00:25:26.274 "ddgst": false 00:25:26.274 }, 00:25:26.274 "method": "bdev_nvme_attach_controller" 00:25:26.274 },{ 00:25:26.274 "params": { 00:25:26.274 "name": "Nvme10", 00:25:26.274 "trtype": "tcp", 00:25:26.274 "traddr": "10.0.0.2", 00:25:26.274 "adrfam": "ipv4", 00:25:26.274 "trsvcid": "4420", 00:25:26.274 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:26.274 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:26.274 "hdgst": false, 00:25:26.274 "ddgst": false 00:25:26.274 }, 00:25:26.274 "method": "bdev_nvme_attach_controller" 00:25:26.274 }' 00:25:26.274 [2024-11-28 15:20:26.376904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:26.274 [2024-11-28 15:20:26.376987] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid785221 ] 00:25:26.274 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.274 [2024-11-28 15:20:26.439815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:26.534 [2024-11-28 15:20:26.525757] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:27.911 Running I/O for 10 seconds... 00:25:28.171 15:20:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:28.171 15:20:28 -- common/autotest_common.sh@862 -- # return 0 00:25:28.171 15:20:28 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:28.171 15:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.171 15:20:28 -- common/autotest_common.sh@10 -- # set +x 00:25:28.171 15:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.171 15:20:28 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:28.171 15:20:28 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:28.171 15:20:28 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:28.171 15:20:28 -- target/shutdown.sh@57 -- # local ret=1 00:25:28.171 15:20:28 -- target/shutdown.sh@58 -- # local i 00:25:28.171 15:20:28 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:28.171 15:20:28 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:28.171 15:20:28 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:28.171 15:20:28 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:28.171 15:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.171 15:20:28 -- common/autotest_common.sh@10 -- # set +x 00:25:28.171 15:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.171 15:20:28 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:28.171 15:20:28 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:28.171 15:20:28 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:28.432 15:20:28 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:28.432 15:20:28 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:28.432 15:20:28 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:28.432 15:20:28 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:28.432 15:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:28.432 15:20:28 -- common/autotest_common.sh@10 -- # set +x 00:25:28.432 15:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:28.432 15:20:28 -- target/shutdown.sh@60 -- # read_io_count=129 00:25:28.432 15:20:28 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:25:28.432 15:20:28 -- target/shutdown.sh@64 -- # ret=0 00:25:28.432 15:20:28 -- target/shutdown.sh@65 -- # break 00:25:28.432 15:20:28 -- target/shutdown.sh@69 -- # return 0 00:25:28.432 15:20:28 -- target/shutdown.sh@109 -- # killprocess 785221 00:25:28.432 15:20:28 -- common/autotest_common.sh@936 -- # '[' -z 785221 ']' 00:25:28.432 15:20:28 -- common/autotest_common.sh@940 -- # kill -0 785221 00:25:28.432 15:20:28 -- common/autotest_common.sh@941 -- # uname 00:25:28.432 15:20:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:28.432 15:20:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 785221 00:25:28.432 15:20:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:28.432 15:20:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:28.432 15:20:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 785221' 00:25:28.432 killing process with pid 785221 00:25:28.432 15:20:28 -- common/autotest_common.sh@955 -- # kill 785221 00:25:28.432 15:20:28 -- common/autotest_common.sh@960 -- # wait 785221 00:25:28.764 Received shutdown signal, test time was about 0.583012 seconds 00:25:28.764 00:25:28.764 Latency(us) 00:25:28.764 [2024-11-28T14:20:28.998Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme1n1 : 0.57 396.80 24.80 0.00 0.00 154985.19 25049.32 157674.76 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme2n1 : 0.57 403.30 25.21 0.00 0.00 150794.97 23107.51 117285.17 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme3n1 : 0.57 402.34 25.15 0.00 0.00 149051.60 23010.42 118061.89 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme4n1 : 0.57 401.38 25.09 0.00 0.00 147317.60 23010.42 118838.61 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme5n1 : 0.57 398.76 24.92 0.00 0.00 145976.65 24660.95 120392.06 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme6n1 : 0.58 395.84 24.74 0.00 0.00 145089.21 24660.95 121168.78 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme7n1 : 0.58 394.81 24.68 0.00 0.00 143666.07 23204.60 124275.67 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme8n1 : 0.58 393.06 24.57 0.00 0.00 142178.63 23690.05 127382.57 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme9n1 : 0.58 391.62 24.48 0.00 0.00 140754.21 23204.60 125829.12 00:25:28.764 [2024-11-28T14:20:28.998Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:28.764 Verification LBA range: start 0x0 length 0x400 00:25:28.764 Nvme10n1 : 0.54 358.55 22.41 0.00 0.00 150762.89 18155.90 123498.95 00:25:28.764 [2024-11-28T14:20:28.998Z] =================================================================================================================== 00:25:28.764 [2024-11-28T14:20:28.998Z] Total : 3936.48 246.03 0.00 0.00 146998.26 18155.90 157674.76 00:25:28.764 15:20:28 -- target/shutdown.sh@112 -- # sleep 1 00:25:29.727 15:20:29 -- target/shutdown.sh@113 -- # kill -0 785021 00:25:29.727 15:20:29 -- target/shutdown.sh@115 -- # stoptarget 00:25:29.727 15:20:29 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:29.727 15:20:29 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:29.727 15:20:29 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:29.727 15:20:29 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:29.727 15:20:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:29.727 15:20:29 -- nvmf/common.sh@116 -- # sync 00:25:29.727 15:20:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:29.727 15:20:29 -- nvmf/common.sh@119 -- # set +e 00:25:29.727 15:20:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:29.727 15:20:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:29.727 rmmod nvme_tcp 00:25:29.727 rmmod nvme_fabrics 00:25:29.727 rmmod nvme_keyring 00:25:29.987 15:20:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:29.987 15:20:29 -- nvmf/common.sh@123 -- # set -e 00:25:29.987 15:20:29 -- nvmf/common.sh@124 -- # return 0 00:25:29.987 15:20:29 -- nvmf/common.sh@477 -- # '[' -n 785021 ']' 00:25:29.987 15:20:29 -- nvmf/common.sh@478 -- # killprocess 785021 00:25:29.987 15:20:29 -- common/autotest_common.sh@936 -- # '[' -z 785021 ']' 00:25:29.987 15:20:29 -- common/autotest_common.sh@940 -- # kill -0 785021 00:25:29.987 15:20:29 -- common/autotest_common.sh@941 -- # uname 00:25:29.987 15:20:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:29.987 15:20:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 785021 00:25:29.987 15:20:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:29.987 15:20:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:29.987 15:20:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 785021' 00:25:29.987 killing process with pid 785021 00:25:29.987 15:20:30 -- common/autotest_common.sh@955 -- # kill 785021 00:25:29.987 15:20:30 -- common/autotest_common.sh@960 -- # wait 785021 00:25:30.558 15:20:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:30.559 15:20:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:30.559 15:20:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:30.559 15:20:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:30.559 15:20:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:30.559 15:20:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.559 15:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.559 15:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.462 15:20:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:32.462 00:25:32.462 real 0m8.022s 00:25:32.462 user 0m25.020s 00:25:32.462 sys 0m1.360s 00:25:32.462 15:20:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:32.462 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:25:32.462 ************************************ 00:25:32.462 END TEST nvmf_shutdown_tc2 00:25:32.462 ************************************ 00:25:32.462 15:20:32 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:32.462 15:20:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:32.462 15:20:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:32.462 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:25:32.462 ************************************ 00:25:32.462 START TEST nvmf_shutdown_tc3 00:25:32.462 ************************************ 00:25:32.462 15:20:32 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:32.462 15:20:32 -- target/shutdown.sh@120 -- # starttarget 00:25:32.462 15:20:32 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:32.462 15:20:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:32.462 15:20:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:32.462 15:20:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:32.462 15:20:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:32.462 15:20:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:32.462 15:20:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.462 15:20:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.462 15:20:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:32.462 15:20:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:32.462 15:20:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:32.462 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:25:32.462 15:20:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:32.462 15:20:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:32.462 15:20:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:32.462 15:20:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:32.462 15:20:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:32.462 15:20:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:32.462 15:20:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:32.462 15:20:32 -- nvmf/common.sh@294 -- # net_devs=() 00:25:32.462 15:20:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:32.462 15:20:32 -- nvmf/common.sh@295 -- # e810=() 00:25:32.462 15:20:32 -- nvmf/common.sh@295 -- # local -ga e810 00:25:32.462 15:20:32 -- nvmf/common.sh@296 -- # x722=() 00:25:32.462 15:20:32 -- nvmf/common.sh@296 -- # local -ga x722 00:25:32.462 15:20:32 -- nvmf/common.sh@297 -- # mlx=() 00:25:32.462 15:20:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:32.462 15:20:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:32.462 15:20:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:32.462 15:20:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:32.462 15:20:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:32.462 15:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:32.462 15:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:32.462 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:32.462 15:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:32.462 15:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:32.462 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:32.462 15:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:32.462 15:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:32.463 15:20:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:32.463 15:20:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:32.463 15:20:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:32.463 15:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:32.463 15:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:32.463 15:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:32.463 15:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:32.463 15:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:32.463 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:32.463 15:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:32.463 15:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:32.463 15:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:32.463 15:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:32.463 15:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:32.463 15:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:32.463 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:32.463 15:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:32.463 15:20:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:32.463 15:20:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:32.463 15:20:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:32.463 15:20:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:32.463 15:20:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:32.463 15:20:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:32.463 15:20:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:32.463 15:20:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:32.463 15:20:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:32.463 15:20:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:32.463 15:20:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:32.463 15:20:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:32.463 15:20:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:32.463 15:20:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:32.463 15:20:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:32.463 15:20:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:32.463 15:20:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:32.463 15:20:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:32.720 15:20:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:32.720 15:20:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:32.720 15:20:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:32.720 15:20:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:32.720 15:20:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:32.720 15:20:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:32.720 15:20:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:32.720 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:32.720 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.345 ms 00:25:32.720 00:25:32.720 --- 10.0.0.2 ping statistics --- 00:25:32.720 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:32.720 rtt min/avg/max/mdev = 0.345/0.345/0.345/0.000 ms 00:25:32.720 15:20:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:32.720 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:32.720 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:25:32.720 00:25:32.720 --- 10.0.0.1 ping statistics --- 00:25:32.720 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:32.720 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:25:32.720 15:20:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:32.720 15:20:32 -- nvmf/common.sh@410 -- # return 0 00:25:32.720 15:20:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:32.720 15:20:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:32.720 15:20:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:32.720 15:20:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:32.720 15:20:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:32.720 15:20:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:32.720 15:20:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:32.720 15:20:32 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:32.720 15:20:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:32.720 15:20:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:32.720 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:25:32.720 15:20:32 -- nvmf/common.sh@469 -- # nvmfpid=786144 00:25:32.720 15:20:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:32.720 15:20:32 -- nvmf/common.sh@470 -- # waitforlisten 786144 00:25:32.720 15:20:32 -- common/autotest_common.sh@829 -- # '[' -z 786144 ']' 00:25:32.720 15:20:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:32.720 15:20:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:32.720 15:20:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:32.720 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:32.720 15:20:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:32.720 15:20:32 -- common/autotest_common.sh@10 -- # set +x 00:25:32.720 [2024-11-28 15:20:32.847600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:32.720 [2024-11-28 15:20:32.847673] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:32.720 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.720 [2024-11-28 15:20:32.910861] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:32.977 [2024-11-28 15:20:32.996920] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:32.977 [2024-11-28 15:20:32.997051] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:32.977 [2024-11-28 15:20:32.997068] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:32.977 [2024-11-28 15:20:32.997080] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:32.977 [2024-11-28 15:20:32.997184] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:32.977 [2024-11-28 15:20:32.997241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:32.977 [2024-11-28 15:20:32.997310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:32.977 [2024-11-28 15:20:32.997312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:33.914 15:20:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:33.914 15:20:33 -- common/autotest_common.sh@862 -- # return 0 00:25:33.914 15:20:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:33.914 15:20:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:33.914 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:25:33.914 15:20:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:33.914 15:20:33 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:33.914 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.914 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:25:33.914 [2024-11-28 15:20:33.844859] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:33.914 15:20:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:33.914 15:20:33 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:33.914 15:20:33 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:33.914 15:20:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:33.914 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:25:33.914 15:20:33 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:33.914 15:20:33 -- target/shutdown.sh@28 -- # cat 00:25:33.914 15:20:33 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:33.914 15:20:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:33.914 15:20:33 -- common/autotest_common.sh@10 -- # set +x 00:25:33.914 Malloc1 00:25:33.914 [2024-11-28 15:20:33.934435] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:33.914 Malloc2 00:25:33.914 Malloc3 00:25:33.915 Malloc4 00:25:33.915 Malloc5 00:25:34.174 Malloc6 00:25:34.174 Malloc7 00:25:34.174 Malloc8 00:25:34.174 Malloc9 00:25:34.174 Malloc10 00:25:34.174 15:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.174 15:20:34 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:34.174 15:20:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:34.174 15:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:34.433 15:20:34 -- target/shutdown.sh@124 -- # perfpid=786355 00:25:34.433 15:20:34 -- target/shutdown.sh@125 -- # waitforlisten 786355 /var/tmp/bdevperf.sock 00:25:34.433 15:20:34 -- common/autotest_common.sh@829 -- # '[' -z 786355 ']' 00:25:34.433 15:20:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:34.433 15:20:34 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:34.433 15:20:34 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:34.433 15:20:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:34.433 15:20:34 -- nvmf/common.sh@520 -- # config=() 00:25:34.433 15:20:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:34.433 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:34.433 15:20:34 -- nvmf/common.sh@520 -- # local subsystem config 00:25:34.433 15:20:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:34.433 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.433 15:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:34.433 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.433 { 00:25:34.433 "params": { 00:25:34.433 "name": "Nvme$subsystem", 00:25:34.433 "trtype": "$TEST_TRANSPORT", 00:25:34.433 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.433 "adrfam": "ipv4", 00:25:34.433 "trsvcid": "$NVMF_PORT", 00:25:34.433 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.433 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.433 "hdgst": ${hdgst:-false}, 00:25:34.433 "ddgst": ${ddgst:-false} 00:25:34.433 }, 00:25:34.433 "method": "bdev_nvme_attach_controller" 00:25:34.433 } 00:25:34.433 EOF 00:25:34.433 )") 00:25:34.433 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.433 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.433 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.433 { 00:25:34.433 "params": { 00:25:34.433 "name": "Nvme$subsystem", 00:25:34.433 "trtype": "$TEST_TRANSPORT", 00:25:34.433 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.433 "adrfam": "ipv4", 00:25:34.433 "trsvcid": "$NVMF_PORT", 00:25:34.433 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.433 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.433 "hdgst": ${hdgst:-false}, 00:25:34.433 "ddgst": ${ddgst:-false} 00:25:34.433 }, 00:25:34.433 "method": "bdev_nvme_attach_controller" 00:25:34.433 } 00:25:34.433 EOF 00:25:34.433 )") 00:25:34.433 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.433 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.433 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.433 { 00:25:34.433 "params": { 00:25:34.433 "name": "Nvme$subsystem", 00:25:34.433 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:34.434 { 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme$subsystem", 00:25:34.434 "trtype": "$TEST_TRANSPORT", 00:25:34.434 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "$NVMF_PORT", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:34.434 "hdgst": ${hdgst:-false}, 00:25:34.434 "ddgst": ${ddgst:-false} 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 } 00:25:34.434 EOF 00:25:34.434 )") 00:25:34.434 15:20:34 -- nvmf/common.sh@542 -- # cat 00:25:34.434 15:20:34 -- nvmf/common.sh@544 -- # jq . 00:25:34.434 15:20:34 -- nvmf/common.sh@545 -- # IFS=, 00:25:34.434 15:20:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme1", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme2", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme3", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme4", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme5", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme6", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme7", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.434 }, 00:25:34.434 "method": "bdev_nvme_attach_controller" 00:25:34.434 },{ 00:25:34.434 "params": { 00:25:34.434 "name": "Nvme8", 00:25:34.434 "trtype": "tcp", 00:25:34.434 "traddr": "10.0.0.2", 00:25:34.434 "adrfam": "ipv4", 00:25:34.434 "trsvcid": "4420", 00:25:34.434 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:34.434 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:34.434 "hdgst": false, 00:25:34.434 "ddgst": false 00:25:34.435 }, 00:25:34.435 "method": "bdev_nvme_attach_controller" 00:25:34.435 },{ 00:25:34.435 "params": { 00:25:34.435 "name": "Nvme9", 00:25:34.435 "trtype": "tcp", 00:25:34.435 "traddr": "10.0.0.2", 00:25:34.435 "adrfam": "ipv4", 00:25:34.435 "trsvcid": "4420", 00:25:34.435 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:34.435 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:34.435 "hdgst": false, 00:25:34.435 "ddgst": false 00:25:34.435 }, 00:25:34.435 "method": "bdev_nvme_attach_controller" 00:25:34.435 },{ 00:25:34.435 "params": { 00:25:34.435 "name": "Nvme10", 00:25:34.435 "trtype": "tcp", 00:25:34.435 "traddr": "10.0.0.2", 00:25:34.435 "adrfam": "ipv4", 00:25:34.435 "trsvcid": "4420", 00:25:34.435 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:34.435 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:34.435 "hdgst": false, 00:25:34.435 "ddgst": false 00:25:34.435 }, 00:25:34.435 "method": "bdev_nvme_attach_controller" 00:25:34.435 }' 00:25:34.435 [2024-11-28 15:20:34.457947] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:34.435 [2024-11-28 15:20:34.458029] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid786355 ] 00:25:34.435 EAL: No free 2048 kB hugepages reported on node 1 00:25:34.435 [2024-11-28 15:20:34.523679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:34.435 [2024-11-28 15:20:34.609002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:35.808 Running I/O for 10 seconds... 00:25:36.067 15:20:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:36.067 15:20:36 -- common/autotest_common.sh@862 -- # return 0 00:25:36.067 15:20:36 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:36.067 15:20:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:36.067 15:20:36 -- common/autotest_common.sh@10 -- # set +x 00:25:36.067 15:20:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:36.067 15:20:36 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:36.067 15:20:36 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:36.067 15:20:36 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:36.067 15:20:36 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:36.067 15:20:36 -- target/shutdown.sh@57 -- # local ret=1 00:25:36.067 15:20:36 -- target/shutdown.sh@58 -- # local i 00:25:36.067 15:20:36 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:36.067 15:20:36 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:36.067 15:20:36 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:36.067 15:20:36 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:36.067 15:20:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:36.067 15:20:36 -- common/autotest_common.sh@10 -- # set +x 00:25:36.352 15:20:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:36.352 15:20:36 -- target/shutdown.sh@60 -- # read_io_count=165 00:25:36.352 15:20:36 -- target/shutdown.sh@63 -- # '[' 165 -ge 100 ']' 00:25:36.352 15:20:36 -- target/shutdown.sh@64 -- # ret=0 00:25:36.352 15:20:36 -- target/shutdown.sh@65 -- # break 00:25:36.352 15:20:36 -- target/shutdown.sh@69 -- # return 0 00:25:36.352 15:20:36 -- target/shutdown.sh@134 -- # killprocess 786144 00:25:36.352 15:20:36 -- common/autotest_common.sh@936 -- # '[' -z 786144 ']' 00:25:36.352 15:20:36 -- common/autotest_common.sh@940 -- # kill -0 786144 00:25:36.352 15:20:36 -- common/autotest_common.sh@941 -- # uname 00:25:36.352 15:20:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:36.352 15:20:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 786144 00:25:36.352 15:20:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:36.352 15:20:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:36.352 15:20:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 786144' 00:25:36.352 killing process with pid 786144 00:25:36.352 15:20:36 -- common/autotest_common.sh@955 -- # kill 786144 00:25:36.352 15:20:36 -- common/autotest_common.sh@960 -- # wait 786144 00:25:36.352 [2024-11-28 15:20:36.353889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.353973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.353997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354191] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354741] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.354790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f8e70 is same with the state(5) to be set 00:25:36.353 [2024-11-28 15:20:36.357353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357980] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.357992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358028] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9300 is same with the state(5) to be set 00:25:36.354 [2024-11-28 15:20:36.358476] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358535] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358563] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358592] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c5c240 is same with the state(5) to be set 00:25:36.355 [2024-11-28 15:20:36.358716] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358753] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358808] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.355 [2024-11-28 15:20:36.358821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.358834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a94fe0 is same with the state(5) to be set 00:25:36.355 [2024-11-28 15:20:36.359542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.359978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.359994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.360008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.360028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.360042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.360057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 [2024-11-28 15:20:36.360058] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t[2024-11-28 15:20:36.360072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.355 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.355 [2024-11-28 15:20:36.360110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19968 len:12[2024-11-28 15:20:36.360110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.355 he state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.360128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 he state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.360222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 he state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t[2024-11-28 15:20:36.360274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:12he state(5) to be set 00:25:36.356 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:12[2024-11-28 15:20:36.360341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 he state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t[2024-11-28 15:20:36.360356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.356 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21760 len:12[2024-11-28 15:20:36.360459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 he state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.360473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 he state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360526] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t[2024-11-28 15:20:36.360552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23040 len:12he state(5) to be set 00:25:36.356 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.356 [2024-11-28 15:20:36.360565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t[2024-11-28 15:20:36.360567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.356 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.356 [2024-11-28 15:20:36.360580] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.356 [2024-11-28 15:20:36.360583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23680 len:12[2024-11-28 15:20:36.360642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 he state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.360658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 he state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360725] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:12[2024-11-28 15:20:36.360737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 he state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.360753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 he state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.360880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 he state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f97b0 is same with the state(5) to be set 00:25:36.357 [2024-11-28 15:20:36.360953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.357 [2024-11-28 15:20:36.360967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.357 [2024-11-28 15:20:36.360981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.360995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.358 [2024-11-28 15:20:36.361668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.358 [2024-11-28 15:20:36.361682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a8c060 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362201] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a8c060 was disconnected and freed. reset controller. 00:25:36.358 [2024-11-28 15:20:36.362477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.358 [2024-11-28 15:20:36.362830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.362998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363214] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363226] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363239] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.359 [2024-11-28 15:20:36.363498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8f9c40 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.363895] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:36.360 [2024-11-28 15:20:36.363935] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5c240 (9): Bad file descriptor 00:25:36.360 [2024-11-28 15:20:36.364503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364780] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364955] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.364994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.360 [2024-11-28 15:20:36.365273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa0f0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.365494] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.361 [2024-11-28 15:20:36.365991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.361 [2024-11-28 15:20:36.366815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.361 [2024-11-28 15:20:36.366812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.361 [2024-11-28 15:20:36.366832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.366839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.366854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.366881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.366895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.366908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21760 len:12he state(5) to be set 00:25:36.362 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.366921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.366934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.366947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.366960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.366973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.366985] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 he state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.366998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26880 len:1he state(5) to be set 00:25:36.362 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.362 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27136 len:12[2024-11-28 15:20:36.367137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 he state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.362 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367179] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23424 len:12he state(5) to be set 00:25:36.362 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.362 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.362 [2024-11-28 15:20:36.367296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.362 [2024-11-28 15:20:36.367305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.362 [2024-11-28 15:20:36.367309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27648 len:12he state(5) to be set 00:25:36.363 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27776 len:1[2024-11-28 15:20:36.367437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 he state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 15:20:36.367460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 he state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23936 len:12he state(5) to be set 00:25:36.363 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:12[2024-11-28 15:20:36.367614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 he state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with t[2024-11-28 15:20:36.367629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:36.363 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fa5a0 is same with the state(5) to be set 00:25:36.363 [2024-11-28 15:20:36.367743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.363 [2024-11-28 15:20:36.367772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.363 [2024-11-28 15:20:36.367786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.367979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.367993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.368022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.368051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.364 [2024-11-28 15:20:36.368090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c0ce90 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.368201] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c0ce90 was disconnected and freed. reset controller. 00:25:36.364 [2024-11-28 15:20:36.368266] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.364 [2024-11-28 15:20:36.368706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368747] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368775] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368803] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e980 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.368874] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368910] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368944] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368972] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.368985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.368998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac1200 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369037] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.369057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.369072] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.369091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.369115] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.369129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.369142] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.369139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.364 [2024-11-28 15:20:36.369167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1abf710 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.364 [2024-11-28 15:20:36.369219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.364 [2024-11-28 15:20:36.369234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-28 15:20:36.369260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 he state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:36.365 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369292] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 [2024-11-28 15:20:36.369302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 [2024-11-28 15:20:36.369328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ae0190 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369354] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a94fe0 (9): [2024-11-28 15:20:36.369378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with tBad file descriptor 00:25:36.365 he state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369431] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-28 15:20:36.369435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 he state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 [2024-11-28 15:20:36.369476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:36.365 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369498] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nshe state(5) to be set 00:25:36.365 id:0 cdw10:00000000 cdw11:00000000 00:25:36.365 [2024-11-28 15:20:36.369511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:36.365 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 [2024-11-28 15:20:36.369538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec4f0 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369607] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.365 [2024-11-28 15:20:36.369619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.365 [2024-11-28 15:20:36.369628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.365 [2024-11-28 15:20:36.369632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369643] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 ns[2024-11-28 15:20:36.369645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:36.366 he state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:36.366 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.366 [2024-11-28 15:20:36.369673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369676] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:36.366 [2024-11-28 15:20:36.369686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:36.366 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.366 [2024-11-28 15:20:36.369704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369706] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nshe state(5) to be set 00:25:36.366 id:0 cdw10:00000000 cdw11:00000000 00:25:36.366 [2024-11-28 15:20:36.369719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with t[2024-11-28 15:20:36.369721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:36.366 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.366 [2024-11-28 15:20:36.369734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369735] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c62e80 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369858] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369894] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.369978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faa50 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.370975] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.366 [2024-11-28 15:20:36.371245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:36.366 [2024-11-28 15:20:36.371344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac1200 (9): Bad file descriptor 00:25:36.366 [2024-11-28 15:20:36.371369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.366 [2024-11-28 15:20:36.371626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.371997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372305] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8faee0 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.372531] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.367 [2024-11-28 15:20:36.372601] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.367 [2024-11-28 15:20:36.372936] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.367 [2024-11-28 15:20:36.373227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.367 [2024-11-28 15:20:36.373432] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373483] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373871] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:36.368 [2024-11-28 15:20:36.373888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.373912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x8fb390 is same with the state(5) to be set 00:25:36.368 [2024-11-28 15:20:36.374168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.368 [2024-11-28 15:20:36.374459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.368 [2024-11-28 15:20:36.374475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.374970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.374987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.369 [2024-11-28 15:20:36.375369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.369 [2024-11-28 15:20:36.375383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.375967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.375982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a894a0 is same with the state(5) to be set 00:25:36.370 [2024-11-28 15:20:36.376328] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a894a0 was disconnected and freed. reset controller. 00:25:36.370 [2024-11-28 15:20:36.376370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.370 [2024-11-28 15:20:36.376462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.370 [2024-11-28 15:20:36.376478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.376982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.376995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.371 [2024-11-28 15:20:36.377217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.371 [2024-11-28 15:20:36.377231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.377975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.377989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.378005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.378018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.378034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.378047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.378063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.378077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.378111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.372 [2024-11-28 15:20:36.378132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.372 [2024-11-28 15:20:36.378149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.378168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.378184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.378198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.378214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.378228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.378317] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a8aa80 was disconnected and freed. reset controller. 00:25:36.373 [2024-11-28 15:20:36.378407] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:36.373 [2024-11-28 15:20:36.378429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.378443] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c5c240 is same with the state(5) to be set 00:25:36.373 [2024-11-28 15:20:36.378462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5c240 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:36.373 [2024-11-28 15:20:36.380768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:36.373 [2024-11-28 15:20:36.380820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ae6c00 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5c960 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac1200 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c3e980 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380920] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1abf710 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ae0190 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.380984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aec4f0 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.381014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c62e80 (9): Bad file descriptor 00:25:36.373 [2024-11-28 15:20:36.381158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:36.373 [2024-11-28 15:20:36.381181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:36.373 [2024-11-28 15:20:36.381199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:36.373 [2024-11-28 15:20:36.381219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:36.373 [2024-11-28 15:20:36.381233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:36.373 [2024-11-28 15:20:36.381251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:36.373 [2024-11-28 15:20:36.381310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.373 [2024-11-28 15:20:36.381772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.373 [2024-11-28 15:20:36.381788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.381982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.381997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.374 [2024-11-28 15:20:36.382643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.374 [2024-11-28 15:20:36.382657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.382982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.382996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.383012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.383026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.383043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.383057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.383073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.388971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.388987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.375 [2024-11-28 15:20:36.389001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.375 [2024-11-28 15:20:36.389018] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a6cac0 is same with the state(5) to be set 00:25:36.375 [2024-11-28 15:20:36.390958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.375 [2024-11-28 15:20:36.390988] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.375 [2024-11-28 15:20:36.391006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:36.375 [2024-11-28 15:20:36.391261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.375 [2024-11-28 15:20:36.391425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.375 [2024-11-28 15:20:36.391452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c5c960 with addr=10.0.0.2, port=4420 00:25:36.375 [2024-11-28 15:20:36.391471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c5c960 is same with the state(5) to be set 00:25:36.375 [2024-11-28 15:20:36.391558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.375 [2024-11-28 15:20:36.391650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.375 [2024-11-28 15:20:36.391676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ae6c00 with addr=10.0.0.2, port=4420 00:25:36.375 [2024-11-28 15:20:36.391692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ae6c00 is same with the state(5) to be set 00:25:36.375 [2024-11-28 15:20:36.391960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.375 [2024-11-28 15:20:36.392065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.375 [2024-11-28 15:20:36.392103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a94fe0 with addr=10.0.0.2, port=4420 00:25:36.375 [2024-11-28 15:20:36.392121] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a94fe0 is same with the state(5) to be set 00:25:36.375 [2024-11-28 15:20:36.392146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5c960 (9): Bad file descriptor 00:25:36.375 [2024-11-28 15:20:36.392166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ae6c00 (9): Bad file descriptor 00:25:36.375 [2024-11-28 15:20:36.392187] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.376 [2024-11-28 15:20:36.392208] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.376 [2024-11-28 15:20:36.392544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.392970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.392984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.376 [2024-11-28 15:20:36.393405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.376 [2024-11-28 15:20:36.393419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.393971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.393985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.394015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.394045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.394085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.394125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.394154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.377 [2024-11-28 15:20:36.394183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.377 [2024-11-28 15:20:36.394200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.394586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.394601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c191e0 is same with the state(5) to be set 00:25:36.378 [2024-11-28 15:20:36.395858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.395886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.395908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.395924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.395941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.395955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.395971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.395985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.378 [2024-11-28 15:20:36.396320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.378 [2024-11-28 15:20:36.396335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.396980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.396993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.397009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.397023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.397040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.397053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.397069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.397105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.397123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.397138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.397154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.397167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.379 [2024-11-28 15:20:36.397183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.379 [2024-11-28 15:20:36.397197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.397864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.397880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a83d20 is same with the state(5) to be set 00:25:36.380 [2024-11-28 15:20:36.399112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.399135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.399156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.399171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.399187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.399201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.399218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.399231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.399248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.380 [2024-11-28 15:20:36.399262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.380 [2024-11-28 15:20:36.399278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.399976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.399992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.400006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.400021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.400036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.400052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.400066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.400099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.381 [2024-11-28 15:20:36.400114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.381 [2024-11-28 15:20:36.400130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.400977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.400993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.401007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.382 [2024-11-28 15:20:36.401023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.382 [2024-11-28 15:20:36.401041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.401058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.401072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.401100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.401115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.401132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a85300 is same with the state(5) to be set 00:25:36.383 [2024-11-28 15:20:36.402340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.402980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.402994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.403010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.403023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.403044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.403058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.403074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.403104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.403121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.383 [2024-11-28 15:20:36.403135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.383 [2024-11-28 15:20:36.403151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.384 [2024-11-28 15:20:36.403865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.384 [2024-11-28 15:20:36.403881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.403895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.403910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.403924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.403940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.403954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.403970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.403984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.403999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.404329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.404344] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a868e0 is same with the state(5) to be set 00:25:36.385 [2024-11-28 15:20:36.405598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.385 [2024-11-28 15:20:36.405983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.385 [2024-11-28 15:20:36.405998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.386 [2024-11-28 15:20:36.406872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.386 [2024-11-28 15:20:36.406886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.406902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.406915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.406931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.406945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.406961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.406975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.406994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:36.387 [2024-11-28 15:20:36.407581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:36.387 [2024-11-28 15:20:36.407596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a87ec0 is same with the state(5) to be set 00:25:36.387 [2024-11-28 15:20:36.408798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:36.387 [2024-11-28 15:20:36.408829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:36.387 [2024-11-28 15:20:36.408849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:36.387 [2024-11-28 15:20:36.408868] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:36.387 [2024-11-28 15:20:36.408886] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:36.387 [2024-11-28 15:20:36.408966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a94fe0 (9): Bad file descriptor 00:25:36.387 [2024-11-28 15:20:36.408990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:36.387 [2024-11-28 15:20:36.409004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:36.387 [2024-11-28 15:20:36.409021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:36.387 [2024-11-28 15:20:36.409045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:36.387 [2024-11-28 15:20:36.409060] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:36.387 [2024-11-28 15:20:36.409073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:36.388 [2024-11-28 15:20:36.409176] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.388 [2024-11-28 15:20:36.409203] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.388 [2024-11-28 15:20:36.409229] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.388 [2024-11-28 15:20:36.409249] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.388 [2024-11-28 15:20:36.409267] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.388 [2024-11-28 15:20:36.409367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:36.388 task offset: 24320 on job bdev=Nvme10n1 fails 00:25:36.388 00:25:36.388 Latency(us) 00:25:36.388 [2024-11-28T14:20:36.622Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme1n1 ended in about 0.55 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme1n1 : 0.55 295.90 18.49 115.47 0.00 154208.46 93595.12 141363.58 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme2n1 ended in about 0.53 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme2n1 : 0.53 312.17 19.51 119.63 0.00 144805.35 10777.03 159228.21 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme3n1 ended in about 0.56 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme3n1 : 0.56 292.98 18.31 114.33 0.00 151585.32 87381.33 122722.23 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme4n1 ended in about 0.56 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme4n1 : 0.56 291.27 18.20 113.67 0.00 150411.72 88934.78 118838.61 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme5n1 ended in about 0.57 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme5n1 : 0.57 289.61 18.10 113.02 0.00 149183.61 90099.86 115731.72 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme6n1 ended in about 0.57 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme6n1 : 0.57 287.98 18.00 112.38 0.00 148030.45 86216.25 118838.61 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme7n1 ended in about 0.57 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme7n1 : 0.57 286.35 17.90 111.75 0.00 146878.99 83886.08 115731.72 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme8n1 ended in about 0.54 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme8n1 : 0.54 301.64 18.85 117.71 0.00 136663.21 59807.67 118838.61 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme9n1 ended in about 0.54 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme9n1 : 0.54 310.22 19.39 108.30 0.00 134749.51 50098.63 119615.34 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:36.388 [2024-11-28T14:20:36.622Z] Job: Nvme10n1 ended in about 0.53 seconds with error 00:25:36.388 Verification LBA range: start 0x0 length 0x400 00:25:36.388 Nvme10n1 : 0.53 310.62 19.41 121.22 0.00 128147.21 4708.88 125052.40 00:25:36.388 [2024-11-28T14:20:36.622Z] =================================================================================================================== 00:25:36.388 [2024-11-28T14:20:36.622Z] Total : 2978.74 186.17 1147.49 0.00 144466.83 4708.88 159228.21 00:25:36.388 [2024-11-28 15:20:36.434614] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:36.388 [2024-11-28 15:20:36.434722] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:36.388 [2024-11-28 15:20:36.434757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.388 [2024-11-28 15:20:36.434774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.388 [2024-11-28 15:20:36.435024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ac1200 with addr=10.0.0.2, port=4420 00:25:36.388 [2024-11-28 15:20:36.435180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac1200 is same with the state(5) to be set 00:25:36.388 [2024-11-28 15:20:36.435259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c5c240 with addr=10.0.0.2, port=4420 00:25:36.388 [2024-11-28 15:20:36.435396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c5c240 is same with the state(5) to be set 00:25:36.388 [2024-11-28 15:20:36.435481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1abf710 with addr=10.0.0.2, port=4420 00:25:36.388 [2024-11-28 15:20:36.435611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1abf710 is same with the state(5) to be set 00:25:36.388 [2024-11-28 15:20:36.435686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.388 [2024-11-28 15:20:36.435792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c3e980 with addr=10.0.0.2, port=4420 00:25:36.389 [2024-11-28 15:20:36.435808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3e980 is same with the state(5) to be set 00:25:36.389 [2024-11-28 15:20:36.435903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.435995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.436021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ae0190 with addr=10.0.0.2, port=4420 00:25:36.389 [2024-11-28 15:20:36.436037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ae0190 is same with the state(5) to be set 00:25:36.389 [2024-11-28 15:20:36.436053] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.436067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.436085] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:36.389 [2024-11-28 15:20:36.437521] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.437658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.437739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.437764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1aec4f0 with addr=10.0.0.2, port=4420 00:25:36.389 [2024-11-28 15:20:36.437781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aec4f0 is same with the state(5) to be set 00:25:36.389 [2024-11-28 15:20:36.437859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.437945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.437975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c62e80 with addr=10.0.0.2, port=4420 00:25:36.389 [2024-11-28 15:20:36.437992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c62e80 is same with the state(5) to be set 00:25:36.389 [2024-11-28 15:20:36.438019] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac1200 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5c240 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1abf710 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c3e980 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ae0190 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438173] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.389 [2024-11-28 15:20:36.438199] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.389 [2024-11-28 15:20:36.438218] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.389 [2024-11-28 15:20:36.438237] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.389 [2024-11-28 15:20:36.438257] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:36.389 [2024-11-28 15:20:36.438367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aec4f0 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438396] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c62e80 (9): Bad file descriptor 00:25:36.389 [2024-11-28 15:20:36.438413] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438426] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438558] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438703] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:36.389 [2024-11-28 15:20:36.438728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:36.389 [2024-11-28 15:20:36.438745] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:36.389 [2024-11-28 15:20:36.438761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.438774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.438786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.438797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.438831] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438877] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:36.389 [2024-11-28 15:20:36.438890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:36.389 [2024-11-28 15:20:36.438903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:36.389 [2024-11-28 15:20:36.438930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.438955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.438970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.389 [2024-11-28 15:20:36.439042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.439123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.389 [2024-11-28 15:20:36.439148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1a94fe0 with addr=10.0.0.2, port=4420 00:25:36.390 [2024-11-28 15:20:36.439164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a94fe0 is same with the state(5) to be set 00:25:36.390 [2024-11-28 15:20:36.439237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.390 [2024-11-28 15:20:36.439307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.390 [2024-11-28 15:20:36.439331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ae6c00 with addr=10.0.0.2, port=4420 00:25:36.390 [2024-11-28 15:20:36.439346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ae6c00 is same with the state(5) to be set 00:25:36.390 [2024-11-28 15:20:36.439423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.390 [2024-11-28 15:20:36.439501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:36.390 [2024-11-28 15:20:36.439525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c5c960 with addr=10.0.0.2, port=4420 00:25:36.390 [2024-11-28 15:20:36.439541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c5c960 is same with the state(5) to be set 00:25:36.390 [2024-11-28 15:20:36.439589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1a94fe0 (9): Bad file descriptor 00:25:36.390 [2024-11-28 15:20:36.439615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ae6c00 (9): Bad file descriptor 00:25:36.390 [2024-11-28 15:20:36.439634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c5c960 (9): Bad file descriptor 00:25:36.390 [2024-11-28 15:20:36.439676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:36.390 [2024-11-28 15:20:36.439696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:36.390 [2024-11-28 15:20:36.439710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:36.390 [2024-11-28 15:20:36.439727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:36.390 [2024-11-28 15:20:36.439742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:36.390 [2024-11-28 15:20:36.439755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:36.390 [2024-11-28 15:20:36.439770] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:36.390 [2024-11-28 15:20:36.439784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:36.390 [2024-11-28 15:20:36.439797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:36.390 [2024-11-28 15:20:36.439837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.390 [2024-11-28 15:20:36.439856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.390 [2024-11-28 15:20:36.439868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:36.649 15:20:36 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:36.649 15:20:36 -- target/shutdown.sh@138 -- # sleep 1 00:25:38.026 15:20:37 -- target/shutdown.sh@141 -- # kill -9 786355 00:25:38.026 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (786355) - No such process 00:25:38.026 15:20:37 -- target/shutdown.sh@141 -- # true 00:25:38.026 15:20:37 -- target/shutdown.sh@143 -- # stoptarget 00:25:38.026 15:20:37 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:38.026 15:20:37 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:38.026 15:20:37 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:38.026 15:20:37 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:38.026 15:20:37 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.026 15:20:37 -- nvmf/common.sh@116 -- # sync 00:25:38.026 15:20:37 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.026 15:20:37 -- nvmf/common.sh@119 -- # set +e 00:25:38.026 15:20:37 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.026 15:20:37 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.026 rmmod nvme_tcp 00:25:38.026 rmmod nvme_fabrics 00:25:38.026 rmmod nvme_keyring 00:25:38.026 15:20:37 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:38.026 15:20:37 -- nvmf/common.sh@123 -- # set -e 00:25:38.026 15:20:37 -- nvmf/common.sh@124 -- # return 0 00:25:38.026 15:20:37 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:38.026 15:20:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:38.026 15:20:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:38.026 15:20:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:38.026 15:20:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:38.026 15:20:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:38.026 15:20:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.026 15:20:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.026 15:20:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:39.934 15:20:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:39.934 00:25:39.934 real 0m7.369s 00:25:39.934 user 0m17.554s 00:25:39.934 sys 0m1.384s 00:25:39.934 15:20:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:39.934 15:20:39 -- common/autotest_common.sh@10 -- # set +x 00:25:39.934 ************************************ 00:25:39.934 END TEST nvmf_shutdown_tc3 00:25:39.934 ************************************ 00:25:39.934 15:20:39 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:39.934 00:25:39.934 real 0m28.209s 00:25:39.934 user 1m19.930s 00:25:39.934 sys 0m6.214s 00:25:39.934 15:20:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:39.934 15:20:39 -- common/autotest_common.sh@10 -- # set +x 00:25:39.934 ************************************ 00:25:39.934 END TEST nvmf_shutdown 00:25:39.934 ************************************ 00:25:39.934 15:20:40 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:39.934 15:20:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:39.934 15:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:39.934 15:20:40 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:39.934 15:20:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:39.934 15:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:39.934 15:20:40 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:39.934 15:20:40 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:39.934 15:20:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:39.934 15:20:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:39.934 15:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:39.934 ************************************ 00:25:39.934 START TEST nvmf_multicontroller 00:25:39.934 ************************************ 00:25:39.934 15:20:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:39.934 * Looking for test storage... 00:25:39.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:39.934 15:20:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:39.934 15:20:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:39.934 15:20:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:40.193 15:20:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:40.193 15:20:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:40.193 15:20:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:40.193 15:20:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:40.193 15:20:40 -- scripts/common.sh@335 -- # IFS=.-: 00:25:40.193 15:20:40 -- scripts/common.sh@335 -- # read -ra ver1 00:25:40.193 15:20:40 -- scripts/common.sh@336 -- # IFS=.-: 00:25:40.193 15:20:40 -- scripts/common.sh@336 -- # read -ra ver2 00:25:40.193 15:20:40 -- scripts/common.sh@337 -- # local 'op=<' 00:25:40.193 15:20:40 -- scripts/common.sh@339 -- # ver1_l=2 00:25:40.193 15:20:40 -- scripts/common.sh@340 -- # ver2_l=1 00:25:40.193 15:20:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:40.193 15:20:40 -- scripts/common.sh@343 -- # case "$op" in 00:25:40.193 15:20:40 -- scripts/common.sh@344 -- # : 1 00:25:40.193 15:20:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:40.193 15:20:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:40.193 15:20:40 -- scripts/common.sh@364 -- # decimal 1 00:25:40.193 15:20:40 -- scripts/common.sh@352 -- # local d=1 00:25:40.193 15:20:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:40.193 15:20:40 -- scripts/common.sh@354 -- # echo 1 00:25:40.193 15:20:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:40.193 15:20:40 -- scripts/common.sh@365 -- # decimal 2 00:25:40.193 15:20:40 -- scripts/common.sh@352 -- # local d=2 00:25:40.193 15:20:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:40.193 15:20:40 -- scripts/common.sh@354 -- # echo 2 00:25:40.193 15:20:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:40.193 15:20:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:40.193 15:20:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:40.193 15:20:40 -- scripts/common.sh@367 -- # return 0 00:25:40.193 15:20:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:40.193 15:20:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:40.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.193 --rc genhtml_branch_coverage=1 00:25:40.193 --rc genhtml_function_coverage=1 00:25:40.193 --rc genhtml_legend=1 00:25:40.193 --rc geninfo_all_blocks=1 00:25:40.193 --rc geninfo_unexecuted_blocks=1 00:25:40.193 00:25:40.193 ' 00:25:40.193 15:20:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:40.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.193 --rc genhtml_branch_coverage=1 00:25:40.193 --rc genhtml_function_coverage=1 00:25:40.193 --rc genhtml_legend=1 00:25:40.193 --rc geninfo_all_blocks=1 00:25:40.193 --rc geninfo_unexecuted_blocks=1 00:25:40.193 00:25:40.193 ' 00:25:40.193 15:20:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:40.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.193 --rc genhtml_branch_coverage=1 00:25:40.193 --rc genhtml_function_coverage=1 00:25:40.193 --rc genhtml_legend=1 00:25:40.193 --rc geninfo_all_blocks=1 00:25:40.193 --rc geninfo_unexecuted_blocks=1 00:25:40.193 00:25:40.193 ' 00:25:40.193 15:20:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:40.193 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.193 --rc genhtml_branch_coverage=1 00:25:40.193 --rc genhtml_function_coverage=1 00:25:40.193 --rc genhtml_legend=1 00:25:40.193 --rc geninfo_all_blocks=1 00:25:40.193 --rc geninfo_unexecuted_blocks=1 00:25:40.193 00:25:40.193 ' 00:25:40.193 15:20:40 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:40.193 15:20:40 -- nvmf/common.sh@7 -- # uname -s 00:25:40.193 15:20:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:40.193 15:20:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:40.193 15:20:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:40.193 15:20:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:40.193 15:20:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:40.193 15:20:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:40.193 15:20:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:40.193 15:20:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:40.193 15:20:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:40.193 15:20:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:40.193 15:20:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.193 15:20:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.193 15:20:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:40.193 15:20:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:40.193 15:20:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:40.194 15:20:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:40.194 15:20:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:40.194 15:20:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:40.194 15:20:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:40.194 15:20:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.194 15:20:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.194 15:20:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.194 15:20:40 -- paths/export.sh@5 -- # export PATH 00:25:40.194 15:20:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.194 15:20:40 -- nvmf/common.sh@46 -- # : 0 00:25:40.194 15:20:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:40.194 15:20:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:40.194 15:20:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:40.194 15:20:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:40.194 15:20:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:40.194 15:20:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:40.194 15:20:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:40.194 15:20:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:40.194 15:20:40 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:40.194 15:20:40 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:40.194 15:20:40 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:40.194 15:20:40 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:40.194 15:20:40 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:40.194 15:20:40 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:40.194 15:20:40 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:40.194 15:20:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:40.194 15:20:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:40.194 15:20:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:40.194 15:20:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:40.194 15:20:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:40.194 15:20:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.194 15:20:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.194 15:20:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.194 15:20:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:40.194 15:20:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:40.194 15:20:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:40.194 15:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:42.099 15:20:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:42.099 15:20:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:42.099 15:20:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:42.099 15:20:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:42.099 15:20:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:42.099 15:20:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:42.099 15:20:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:42.099 15:20:42 -- nvmf/common.sh@294 -- # net_devs=() 00:25:42.099 15:20:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:42.099 15:20:42 -- nvmf/common.sh@295 -- # e810=() 00:25:42.099 15:20:42 -- nvmf/common.sh@295 -- # local -ga e810 00:25:42.099 15:20:42 -- nvmf/common.sh@296 -- # x722=() 00:25:42.099 15:20:42 -- nvmf/common.sh@296 -- # local -ga x722 00:25:42.099 15:20:42 -- nvmf/common.sh@297 -- # mlx=() 00:25:42.099 15:20:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:42.099 15:20:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:42.099 15:20:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:42.099 15:20:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:42.099 15:20:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:42.099 15:20:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.099 15:20:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:42.099 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:42.099 15:20:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.099 15:20:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:42.099 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:42.099 15:20:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:42.099 15:20:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.099 15:20:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.099 15:20:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.099 15:20:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.099 15:20:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:42.099 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:42.099 15:20:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.099 15:20:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.099 15:20:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.099 15:20:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.099 15:20:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.099 15:20:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:42.099 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:42.099 15:20:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.099 15:20:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:42.099 15:20:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:42.099 15:20:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:42.099 15:20:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:42.099 15:20:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:42.099 15:20:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:42.099 15:20:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:42.099 15:20:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:42.099 15:20:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:42.099 15:20:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:42.099 15:20:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:42.099 15:20:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:42.099 15:20:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:42.099 15:20:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:42.099 15:20:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:42.099 15:20:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:42.099 15:20:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:42.099 15:20:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:42.099 15:20:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:42.099 15:20:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:42.099 15:20:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:42.099 15:20:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:42.099 15:20:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:42.099 15:20:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:42.100 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:42.100 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.253 ms 00:25:42.100 00:25:42.100 --- 10.0.0.2 ping statistics --- 00:25:42.100 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:42.100 rtt min/avg/max/mdev = 0.253/0.253/0.253/0.000 ms 00:25:42.100 15:20:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:42.100 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:42.100 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.045 ms 00:25:42.100 00:25:42.100 --- 10.0.0.1 ping statistics --- 00:25:42.100 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:42.100 rtt min/avg/max/mdev = 0.045/0.045/0.045/0.000 ms 00:25:42.100 15:20:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:42.100 15:20:42 -- nvmf/common.sh@410 -- # return 0 00:25:42.100 15:20:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:42.100 15:20:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:42.100 15:20:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:42.100 15:20:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:42.100 15:20:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:42.100 15:20:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:42.100 15:20:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:42.100 15:20:42 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:42.100 15:20:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:42.100 15:20:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:42.100 15:20:42 -- common/autotest_common.sh@10 -- # set +x 00:25:42.100 15:20:42 -- nvmf/common.sh@469 -- # nvmfpid=788766 00:25:42.100 15:20:42 -- nvmf/common.sh@470 -- # waitforlisten 788766 00:25:42.100 15:20:42 -- common/autotest_common.sh@829 -- # '[' -z 788766 ']' 00:25:42.100 15:20:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:42.100 15:20:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:42.100 15:20:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:42.100 15:20:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:42.100 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:42.100 15:20:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:42.100 15:20:42 -- common/autotest_common.sh@10 -- # set +x 00:25:42.361 [2024-11-28 15:20:42.360898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:42.361 [2024-11-28 15:20:42.360998] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:42.361 EAL: No free 2048 kB hugepages reported on node 1 00:25:42.361 [2024-11-28 15:20:42.430814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:42.361 [2024-11-28 15:20:42.521245] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:42.361 [2024-11-28 15:20:42.521423] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:42.361 [2024-11-28 15:20:42.521448] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:42.361 [2024-11-28 15:20:42.521464] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:42.361 [2024-11-28 15:20:42.521574] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:42.361 [2024-11-28 15:20:42.521678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:42.361 [2024-11-28 15:20:42.521681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:43.298 15:20:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:43.298 15:20:43 -- common/autotest_common.sh@862 -- # return 0 00:25:43.298 15:20:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:43.298 15:20:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.298 15:20:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:43.298 15:20:43 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:43.298 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.298 [2024-11-28 15:20:43.339126] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:43.298 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.298 15:20:43 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:43.298 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.298 Malloc0 00:25:43.298 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.298 15:20:43 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:43.298 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.298 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.298 15:20:43 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:43.298 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.298 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.298 15:20:43 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:43.298 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.298 [2024-11-28 15:20:43.396535] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:43.298 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.298 15:20:43 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:43.298 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.298 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.299 [2024-11-28 15:20:43.404435] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:43.299 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.299 15:20:43 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:43.299 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.299 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.299 Malloc1 00:25:43.299 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.299 15:20:43 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:43.299 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.299 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.299 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.299 15:20:43 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:43.299 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.299 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.299 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.299 15:20:43 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:43.299 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.299 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.299 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.299 15:20:43 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:43.299 15:20:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:43.299 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:43.299 15:20:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:43.299 15:20:43 -- host/multicontroller.sh@44 -- # bdevperf_pid=788929 00:25:43.299 15:20:43 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:43.299 15:20:43 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:43.299 15:20:43 -- host/multicontroller.sh@47 -- # waitforlisten 788929 /var/tmp/bdevperf.sock 00:25:43.299 15:20:43 -- common/autotest_common.sh@829 -- # '[' -z 788929 ']' 00:25:43.299 15:20:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:43.299 15:20:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.299 15:20:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:43.299 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:43.299 15:20:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.299 15:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:44.679 15:20:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.679 15:20:44 -- common/autotest_common.sh@862 -- # return 0 00:25:44.679 15:20:44 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:44.679 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.679 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.679 NVMe0n1 00:25:44.679 15:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.679 15:20:44 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:44.679 15:20:44 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:44.679 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.679 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.679 15:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.679 1 00:25:44.679 15:20:44 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:44.679 15:20:44 -- common/autotest_common.sh@650 -- # local es=0 00:25:44.679 15:20:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:44.679 15:20:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:44.679 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.679 15:20:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:44.679 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.679 15:20:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:44.679 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.679 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.679 request: 00:25:44.679 { 00:25:44.679 "name": "NVMe0", 00:25:44.679 "trtype": "tcp", 00:25:44.679 "traddr": "10.0.0.2", 00:25:44.679 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:44.679 "hostaddr": "10.0.0.2", 00:25:44.679 "hostsvcid": "60000", 00:25:44.679 "adrfam": "ipv4", 00:25:44.679 "trsvcid": "4420", 00:25:44.679 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.679 "method": "bdev_nvme_attach_controller", 00:25:44.679 "req_id": 1 00:25:44.679 } 00:25:44.679 Got JSON-RPC error response 00:25:44.679 response: 00:25:44.679 { 00:25:44.679 "code": -114, 00:25:44.679 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:44.679 } 00:25:44.679 15:20:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:44.679 15:20:44 -- common/autotest_common.sh@653 -- # es=1 00:25:44.679 15:20:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:44.679 15:20:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:44.679 15:20:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:44.679 15:20:44 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:44.679 15:20:44 -- common/autotest_common.sh@650 -- # local es=0 00:25:44.679 15:20:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:44.679 15:20:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:44.679 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.679 15:20:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:44.679 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.680 15:20:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 request: 00:25:44.680 { 00:25:44.680 "name": "NVMe0", 00:25:44.680 "trtype": "tcp", 00:25:44.680 "traddr": "10.0.0.2", 00:25:44.680 "hostaddr": "10.0.0.2", 00:25:44.680 "hostsvcid": "60000", 00:25:44.680 "adrfam": "ipv4", 00:25:44.680 "trsvcid": "4420", 00:25:44.680 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:44.680 "method": "bdev_nvme_attach_controller", 00:25:44.680 "req_id": 1 00:25:44.680 } 00:25:44.680 Got JSON-RPC error response 00:25:44.680 response: 00:25:44.680 { 00:25:44.680 "code": -114, 00:25:44.680 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:44.680 } 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:44.680 15:20:44 -- common/autotest_common.sh@653 -- # es=1 00:25:44.680 15:20:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:44.680 15:20:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:44.680 15:20:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:44.680 15:20:44 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@650 -- # local es=0 00:25:44.680 15:20:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:44.680 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.680 15:20:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:44.680 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.680 15:20:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 request: 00:25:44.680 { 00:25:44.680 "name": "NVMe0", 00:25:44.680 "trtype": "tcp", 00:25:44.680 "traddr": "10.0.0.2", 00:25:44.680 "hostaddr": "10.0.0.2", 00:25:44.680 "hostsvcid": "60000", 00:25:44.680 "adrfam": "ipv4", 00:25:44.680 "trsvcid": "4420", 00:25:44.680 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.680 "multipath": "disable", 00:25:44.680 "method": "bdev_nvme_attach_controller", 00:25:44.680 "req_id": 1 00:25:44.680 } 00:25:44.680 Got JSON-RPC error response 00:25:44.680 response: 00:25:44.680 { 00:25:44.680 "code": -114, 00:25:44.680 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:44.680 } 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:44.680 15:20:44 -- common/autotest_common.sh@653 -- # es=1 00:25:44.680 15:20:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:44.680 15:20:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:44.680 15:20:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:44.680 15:20:44 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:44.680 15:20:44 -- common/autotest_common.sh@650 -- # local es=0 00:25:44.680 15:20:44 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:44.680 15:20:44 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:44.680 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.680 15:20:44 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:44.680 15:20:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:44.680 15:20:44 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 request: 00:25:44.680 { 00:25:44.680 "name": "NVMe0", 00:25:44.680 "trtype": "tcp", 00:25:44.680 "traddr": "10.0.0.2", 00:25:44.680 "hostaddr": "10.0.0.2", 00:25:44.680 "hostsvcid": "60000", 00:25:44.680 "adrfam": "ipv4", 00:25:44.680 "trsvcid": "4420", 00:25:44.680 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.680 "multipath": "failover", 00:25:44.680 "method": "bdev_nvme_attach_controller", 00:25:44.680 "req_id": 1 00:25:44.680 } 00:25:44.680 Got JSON-RPC error response 00:25:44.680 response: 00:25:44.680 { 00:25:44.680 "code": -114, 00:25:44.680 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:44.680 } 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:44.680 15:20:44 -- common/autotest_common.sh@653 -- # es=1 00:25:44.680 15:20:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:44.680 15:20:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:44.680 15:20:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:44.680 15:20:44 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.680 15:20:44 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.680 15:20:44 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.680 15:20:44 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:44.680 15:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.680 15:20:44 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:44.680 15:20:44 -- common/autotest_common.sh@10 -- # set +x 00:25:44.680 15:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.680 15:20:44 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:44.680 15:20:44 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:46.055 0 00:25:46.055 15:20:45 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:46.055 15:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.055 15:20:45 -- common/autotest_common.sh@10 -- # set +x 00:25:46.055 15:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.055 15:20:46 -- host/multicontroller.sh@100 -- # killprocess 788929 00:25:46.055 15:20:46 -- common/autotest_common.sh@936 -- # '[' -z 788929 ']' 00:25:46.055 15:20:46 -- common/autotest_common.sh@940 -- # kill -0 788929 00:25:46.055 15:20:46 -- common/autotest_common.sh@941 -- # uname 00:25:46.055 15:20:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:46.055 15:20:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 788929 00:25:46.055 15:20:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:46.055 15:20:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:46.055 15:20:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 788929' 00:25:46.055 killing process with pid 788929 00:25:46.055 15:20:46 -- common/autotest_common.sh@955 -- # kill 788929 00:25:46.055 15:20:46 -- common/autotest_common.sh@960 -- # wait 788929 00:25:46.055 15:20:46 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:46.055 15:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.055 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:46.055 15:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.055 15:20:46 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:46.055 15:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:46.055 15:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:46.314 15:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:46.314 15:20:46 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:46.314 15:20:46 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:46.315 15:20:46 -- common/autotest_common.sh@1607 -- # read -r file 00:25:46.315 15:20:46 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:46.315 15:20:46 -- common/autotest_common.sh@1606 -- # sort -u 00:25:46.315 15:20:46 -- common/autotest_common.sh@1608 -- # cat 00:25:46.315 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:46.315 [2024-11-28 15:20:43.502706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:46.315 [2024-11-28 15:20:43.502797] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid788929 ] 00:25:46.315 EAL: No free 2048 kB hugepages reported on node 1 00:25:46.315 [2024-11-28 15:20:43.567124] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:46.315 [2024-11-28 15:20:43.651919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:46.315 [2024-11-28 15:20:44.834705] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 37c79b72-b280-40a7-905e-ef85f701522b already exists 00:25:46.315 [2024-11-28 15:20:44.834746] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:37c79b72-b280-40a7-905e-ef85f701522b alias for bdev NVMe1n1 00:25:46.315 [2024-11-28 15:20:44.834764] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:46.315 Running I/O for 1 seconds... 00:25:46.315 00:25:46.315 Latency(us) 00:25:46.315 [2024-11-28T14:20:46.549Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.315 [2024-11-28T14:20:46.549Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:46.315 NVMe0n1 : 1.00 19886.57 77.68 0.00 0.00 6426.83 3786.52 12330.48 00:25:46.315 [2024-11-28T14:20:46.549Z] =================================================================================================================== 00:25:46.315 [2024-11-28T14:20:46.549Z] Total : 19886.57 77.68 0.00 0.00 6426.83 3786.52 12330.48 00:25:46.315 Received shutdown signal, test time was about 1.000000 seconds 00:25:46.315 00:25:46.315 Latency(us) 00:25:46.315 [2024-11-28T14:20:46.549Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:46.315 [2024-11-28T14:20:46.549Z] =================================================================================================================== 00:25:46.315 [2024-11-28T14:20:46.549Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:46.315 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:46.315 15:20:46 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:46.315 15:20:46 -- common/autotest_common.sh@1607 -- # read -r file 00:25:46.315 15:20:46 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:46.315 15:20:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:46.315 15:20:46 -- nvmf/common.sh@116 -- # sync 00:25:46.315 15:20:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:46.315 15:20:46 -- nvmf/common.sh@119 -- # set +e 00:25:46.315 15:20:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:46.315 15:20:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:46.315 rmmod nvme_tcp 00:25:46.315 rmmod nvme_fabrics 00:25:46.315 rmmod nvme_keyring 00:25:46.315 15:20:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:46.315 15:20:46 -- nvmf/common.sh@123 -- # set -e 00:25:46.315 15:20:46 -- nvmf/common.sh@124 -- # return 0 00:25:46.315 15:20:46 -- nvmf/common.sh@477 -- # '[' -n 788766 ']' 00:25:46.315 15:20:46 -- nvmf/common.sh@478 -- # killprocess 788766 00:25:46.315 15:20:46 -- common/autotest_common.sh@936 -- # '[' -z 788766 ']' 00:25:46.315 15:20:46 -- common/autotest_common.sh@940 -- # kill -0 788766 00:25:46.315 15:20:46 -- common/autotest_common.sh@941 -- # uname 00:25:46.315 15:20:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:46.315 15:20:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 788766 00:25:46.315 15:20:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:46.315 15:20:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:46.315 15:20:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 788766' 00:25:46.315 killing process with pid 788766 00:25:46.315 15:20:46 -- common/autotest_common.sh@955 -- # kill 788766 00:25:46.315 15:20:46 -- common/autotest_common.sh@960 -- # wait 788766 00:25:46.574 15:20:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:46.574 15:20:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:46.574 15:20:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:46.574 15:20:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:46.574 15:20:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:46.574 15:20:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:46.574 15:20:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:46.574 15:20:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:48.477 15:20:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:48.735 00:25:48.735 real 0m8.673s 00:25:48.735 user 0m16.332s 00:25:48.735 sys 0m2.387s 00:25:48.735 15:20:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:48.735 15:20:48 -- common/autotest_common.sh@10 -- # set +x 00:25:48.735 ************************************ 00:25:48.735 END TEST nvmf_multicontroller 00:25:48.735 ************************************ 00:25:48.735 15:20:48 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:48.735 15:20:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:48.735 15:20:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:48.735 15:20:48 -- common/autotest_common.sh@10 -- # set +x 00:25:48.735 ************************************ 00:25:48.735 START TEST nvmf_aer 00:25:48.735 ************************************ 00:25:48.735 15:20:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:48.735 * Looking for test storage... 00:25:48.735 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:48.735 15:20:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:48.735 15:20:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:48.735 15:20:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:48.735 15:20:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:48.735 15:20:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:48.735 15:20:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:48.735 15:20:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:48.735 15:20:48 -- scripts/common.sh@335 -- # IFS=.-: 00:25:48.735 15:20:48 -- scripts/common.sh@335 -- # read -ra ver1 00:25:48.735 15:20:48 -- scripts/common.sh@336 -- # IFS=.-: 00:25:48.735 15:20:48 -- scripts/common.sh@336 -- # read -ra ver2 00:25:48.735 15:20:48 -- scripts/common.sh@337 -- # local 'op=<' 00:25:48.735 15:20:48 -- scripts/common.sh@339 -- # ver1_l=2 00:25:48.735 15:20:48 -- scripts/common.sh@340 -- # ver2_l=1 00:25:48.735 15:20:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:48.735 15:20:48 -- scripts/common.sh@343 -- # case "$op" in 00:25:48.735 15:20:48 -- scripts/common.sh@344 -- # : 1 00:25:48.735 15:20:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:48.735 15:20:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:48.735 15:20:48 -- scripts/common.sh@364 -- # decimal 1 00:25:48.735 15:20:48 -- scripts/common.sh@352 -- # local d=1 00:25:48.735 15:20:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:48.735 15:20:48 -- scripts/common.sh@354 -- # echo 1 00:25:48.735 15:20:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:48.735 15:20:48 -- scripts/common.sh@365 -- # decimal 2 00:25:48.735 15:20:48 -- scripts/common.sh@352 -- # local d=2 00:25:48.735 15:20:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:48.735 15:20:48 -- scripts/common.sh@354 -- # echo 2 00:25:48.735 15:20:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:48.735 15:20:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:48.735 15:20:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:48.735 15:20:48 -- scripts/common.sh@367 -- # return 0 00:25:48.735 15:20:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:48.735 15:20:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:48.735 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:48.735 --rc genhtml_branch_coverage=1 00:25:48.735 --rc genhtml_function_coverage=1 00:25:48.735 --rc genhtml_legend=1 00:25:48.735 --rc geninfo_all_blocks=1 00:25:48.735 --rc geninfo_unexecuted_blocks=1 00:25:48.735 00:25:48.735 ' 00:25:48.736 15:20:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:48.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:48.736 --rc genhtml_branch_coverage=1 00:25:48.736 --rc genhtml_function_coverage=1 00:25:48.736 --rc genhtml_legend=1 00:25:48.736 --rc geninfo_all_blocks=1 00:25:48.736 --rc geninfo_unexecuted_blocks=1 00:25:48.736 00:25:48.736 ' 00:25:48.736 15:20:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:48.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:48.736 --rc genhtml_branch_coverage=1 00:25:48.736 --rc genhtml_function_coverage=1 00:25:48.736 --rc genhtml_legend=1 00:25:48.736 --rc geninfo_all_blocks=1 00:25:48.736 --rc geninfo_unexecuted_blocks=1 00:25:48.736 00:25:48.736 ' 00:25:48.736 15:20:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:48.736 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:48.736 --rc genhtml_branch_coverage=1 00:25:48.736 --rc genhtml_function_coverage=1 00:25:48.736 --rc genhtml_legend=1 00:25:48.736 --rc geninfo_all_blocks=1 00:25:48.736 --rc geninfo_unexecuted_blocks=1 00:25:48.736 00:25:48.736 ' 00:25:48.736 15:20:48 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:48.736 15:20:48 -- nvmf/common.sh@7 -- # uname -s 00:25:48.736 15:20:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:48.736 15:20:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:48.736 15:20:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:48.736 15:20:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:48.736 15:20:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:48.736 15:20:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:48.736 15:20:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:48.736 15:20:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:48.736 15:20:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:48.736 15:20:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:48.736 15:20:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:48.736 15:20:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:48.736 15:20:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:48.736 15:20:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:48.736 15:20:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:48.736 15:20:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:48.736 15:20:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:48.736 15:20:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:48.736 15:20:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:48.736 15:20:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.736 15:20:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.736 15:20:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.736 15:20:48 -- paths/export.sh@5 -- # export PATH 00:25:48.736 15:20:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:48.736 15:20:48 -- nvmf/common.sh@46 -- # : 0 00:25:48.736 15:20:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:48.736 15:20:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:48.736 15:20:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:48.736 15:20:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:48.736 15:20:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:48.736 15:20:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:48.736 15:20:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:48.736 15:20:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:48.736 15:20:48 -- host/aer.sh@11 -- # nvmftestinit 00:25:48.736 15:20:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:48.736 15:20:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:48.736 15:20:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:48.736 15:20:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:48.736 15:20:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:48.736 15:20:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:48.736 15:20:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:48.736 15:20:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:48.736 15:20:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:48.736 15:20:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:48.736 15:20:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:48.736 15:20:48 -- common/autotest_common.sh@10 -- # set +x 00:25:51.271 15:20:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:51.271 15:20:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:51.271 15:20:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:51.271 15:20:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:51.271 15:20:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:51.271 15:20:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:51.271 15:20:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:51.271 15:20:50 -- nvmf/common.sh@294 -- # net_devs=() 00:25:51.271 15:20:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:51.271 15:20:50 -- nvmf/common.sh@295 -- # e810=() 00:25:51.271 15:20:50 -- nvmf/common.sh@295 -- # local -ga e810 00:25:51.271 15:20:50 -- nvmf/common.sh@296 -- # x722=() 00:25:51.271 15:20:50 -- nvmf/common.sh@296 -- # local -ga x722 00:25:51.271 15:20:50 -- nvmf/common.sh@297 -- # mlx=() 00:25:51.271 15:20:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:51.271 15:20:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:51.271 15:20:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:51.271 15:20:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:51.271 15:20:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:51.271 15:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:51.271 15:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:51.271 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:51.271 15:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:51.271 15:20:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:51.271 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:51.271 15:20:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:51.271 15:20:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:51.271 15:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:51.271 15:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:51.271 15:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:51.271 15:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:51.271 15:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:51.271 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:51.271 15:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:51.271 15:20:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:51.271 15:20:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:51.272 15:20:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:51.272 15:20:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:51.272 15:20:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:51.272 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:51.272 15:20:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:51.272 15:20:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:51.272 15:20:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:51.272 15:20:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:51.272 15:20:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:51.272 15:20:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:51.272 15:20:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:51.272 15:20:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:51.272 15:20:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:51.272 15:20:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:51.272 15:20:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:51.272 15:20:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:51.272 15:20:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:51.272 15:20:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:51.272 15:20:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:51.272 15:20:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:51.272 15:20:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:51.272 15:20:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:51.272 15:20:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:51.272 15:20:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:51.272 15:20:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:51.272 15:20:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:51.272 15:20:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:51.272 15:20:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:51.272 15:20:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:51.272 15:20:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:51.272 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:51.272 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:25:51.272 00:25:51.272 --- 10.0.0.2 ping statistics --- 00:25:51.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:51.272 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:25:51.272 15:20:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:51.272 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:51.272 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.068 ms 00:25:51.272 00:25:51.272 --- 10.0.0.1 ping statistics --- 00:25:51.272 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:51.272 rtt min/avg/max/mdev = 0.068/0.068/0.068/0.000 ms 00:25:51.272 15:20:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:51.272 15:20:51 -- nvmf/common.sh@410 -- # return 0 00:25:51.272 15:20:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:51.272 15:20:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:51.272 15:20:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:51.272 15:20:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:51.272 15:20:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:51.272 15:20:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:51.272 15:20:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:51.272 15:20:51 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:51.272 15:20:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:51.272 15:20:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:51.272 15:20:51 -- common/autotest_common.sh@10 -- # set +x 00:25:51.272 15:20:51 -- nvmf/common.sh@469 -- # nvmfpid=791300 00:25:51.272 15:20:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:51.272 15:20:51 -- nvmf/common.sh@470 -- # waitforlisten 791300 00:25:51.272 15:20:51 -- common/autotest_common.sh@829 -- # '[' -z 791300 ']' 00:25:51.272 15:20:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:51.272 15:20:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:51.272 15:20:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:51.272 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:51.272 15:20:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:51.272 15:20:51 -- common/autotest_common.sh@10 -- # set +x 00:25:51.272 [2024-11-28 15:20:51.187879] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:51.272 [2024-11-28 15:20:51.187966] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:51.272 EAL: No free 2048 kB hugepages reported on node 1 00:25:51.272 [2024-11-28 15:20:51.253840] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:51.272 [2024-11-28 15:20:51.344662] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:51.272 [2024-11-28 15:20:51.344800] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:51.272 [2024-11-28 15:20:51.344817] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:51.272 [2024-11-28 15:20:51.344829] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:51.272 [2024-11-28 15:20:51.344889] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:51.272 [2024-11-28 15:20:51.344914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:51.272 [2024-11-28 15:20:51.344973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:51.272 [2024-11-28 15:20:51.344976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:52.209 15:20:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:52.209 15:20:52 -- common/autotest_common.sh@862 -- # return 0 00:25:52.209 15:20:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:52.209 15:20:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:52.209 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 15:20:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:52.210 15:20:52 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:52.210 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.210 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 [2024-11-28 15:20:52.183705] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:52.210 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.210 15:20:52 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:52.210 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.210 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 Malloc0 00:25:52.210 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.210 15:20:52 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:52.210 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.210 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.210 15:20:52 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:52.210 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.210 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.210 15:20:52 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:52.210 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.210 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 [2024-11-28 15:20:52.234798] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:52.210 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.210 15:20:52 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:52.210 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.210 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.210 [2024-11-28 15:20:52.242562] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:52.210 [ 00:25:52.210 { 00:25:52.210 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:52.210 "subtype": "Discovery", 00:25:52.210 "listen_addresses": [], 00:25:52.210 "allow_any_host": true, 00:25:52.210 "hosts": [] 00:25:52.210 }, 00:25:52.210 { 00:25:52.210 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:52.210 "subtype": "NVMe", 00:25:52.210 "listen_addresses": [ 00:25:52.210 { 00:25:52.210 "transport": "TCP", 00:25:52.210 "trtype": "TCP", 00:25:52.210 "adrfam": "IPv4", 00:25:52.210 "traddr": "10.0.0.2", 00:25:52.210 "trsvcid": "4420" 00:25:52.210 } 00:25:52.210 ], 00:25:52.210 "allow_any_host": true, 00:25:52.210 "hosts": [], 00:25:52.210 "serial_number": "SPDK00000000000001", 00:25:52.210 "model_number": "SPDK bdev Controller", 00:25:52.210 "max_namespaces": 2, 00:25:52.210 "min_cntlid": 1, 00:25:52.210 "max_cntlid": 65519, 00:25:52.210 "namespaces": [ 00:25:52.210 { 00:25:52.210 "nsid": 1, 00:25:52.210 "bdev_name": "Malloc0", 00:25:52.210 "name": "Malloc0", 00:25:52.210 "nguid": "317D3D7CDB4B4B598B029CF438BA35AF", 00:25:52.210 "uuid": "317d3d7c-db4b-4b59-8b02-9cf438ba35af" 00:25:52.210 } 00:25:52.210 ] 00:25:52.210 } 00:25:52.210 ] 00:25:52.210 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.210 15:20:52 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:52.210 15:20:52 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:52.210 15:20:52 -- host/aer.sh@33 -- # aerpid=791460 00:25:52.210 15:20:52 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:52.210 15:20:52 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:52.210 15:20:52 -- common/autotest_common.sh@1254 -- # local i=0 00:25:52.210 15:20:52 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:52.210 15:20:52 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:52.210 15:20:52 -- common/autotest_common.sh@1257 -- # i=1 00:25:52.210 15:20:52 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:52.210 EAL: No free 2048 kB hugepages reported on node 1 00:25:52.210 15:20:52 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:52.210 15:20:52 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:52.210 15:20:52 -- common/autotest_common.sh@1257 -- # i=2 00:25:52.210 15:20:52 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:52.470 15:20:52 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:52.470 15:20:52 -- common/autotest_common.sh@1256 -- # '[' 2 -lt 200 ']' 00:25:52.470 15:20:52 -- common/autotest_common.sh@1257 -- # i=3 00:25:52.470 15:20:52 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:52.470 15:20:52 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:52.470 15:20:52 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:52.470 15:20:52 -- common/autotest_common.sh@1265 -- # return 0 00:25:52.470 15:20:52 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:52.470 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.470 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.470 Malloc1 00:25:52.470 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.470 15:20:52 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:52.470 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.470 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.470 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.470 15:20:52 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:52.470 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.470 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.470 Asynchronous Event Request test 00:25:52.470 Attaching to 10.0.0.2 00:25:52.470 Attached to 10.0.0.2 00:25:52.470 Registering asynchronous event callbacks... 00:25:52.470 Starting namespace attribute notice tests for all controllers... 00:25:52.470 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:52.470 aer_cb - Changed Namespace 00:25:52.470 Cleaning up... 00:25:52.470 [ 00:25:52.470 { 00:25:52.470 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:52.470 "subtype": "Discovery", 00:25:52.470 "listen_addresses": [], 00:25:52.470 "allow_any_host": true, 00:25:52.470 "hosts": [] 00:25:52.470 }, 00:25:52.470 { 00:25:52.470 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:52.470 "subtype": "NVMe", 00:25:52.470 "listen_addresses": [ 00:25:52.470 { 00:25:52.470 "transport": "TCP", 00:25:52.470 "trtype": "TCP", 00:25:52.470 "adrfam": "IPv4", 00:25:52.470 "traddr": "10.0.0.2", 00:25:52.470 "trsvcid": "4420" 00:25:52.470 } 00:25:52.470 ], 00:25:52.470 "allow_any_host": true, 00:25:52.470 "hosts": [], 00:25:52.470 "serial_number": "SPDK00000000000001", 00:25:52.470 "model_number": "SPDK bdev Controller", 00:25:52.470 "max_namespaces": 2, 00:25:52.470 "min_cntlid": 1, 00:25:52.470 "max_cntlid": 65519, 00:25:52.470 "namespaces": [ 00:25:52.470 { 00:25:52.470 "nsid": 1, 00:25:52.470 "bdev_name": "Malloc0", 00:25:52.470 "name": "Malloc0", 00:25:52.470 "nguid": "317D3D7CDB4B4B598B029CF438BA35AF", 00:25:52.470 "uuid": "317d3d7c-db4b-4b59-8b02-9cf438ba35af" 00:25:52.470 }, 00:25:52.470 { 00:25:52.470 "nsid": 2, 00:25:52.470 "bdev_name": "Malloc1", 00:25:52.470 "name": "Malloc1", 00:25:52.470 "nguid": "46765D810BAB450E89D550EF13CB11B3", 00:25:52.470 "uuid": "46765d81-0bab-450e-89d5-50ef13cb11b3" 00:25:52.470 } 00:25:52.470 ] 00:25:52.470 } 00:25:52.470 ] 00:25:52.470 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.470 15:20:52 -- host/aer.sh@43 -- # wait 791460 00:25:52.470 15:20:52 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:52.470 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.470 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.470 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.470 15:20:52 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:52.470 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.470 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.470 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.470 15:20:52 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:52.470 15:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:52.470 15:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:52.470 15:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:52.470 15:20:52 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:52.470 15:20:52 -- host/aer.sh@51 -- # nvmftestfini 00:25:52.470 15:20:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:52.730 15:20:52 -- nvmf/common.sh@116 -- # sync 00:25:52.730 15:20:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:52.730 15:20:52 -- nvmf/common.sh@119 -- # set +e 00:25:52.730 15:20:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:52.730 15:20:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:52.730 rmmod nvme_tcp 00:25:52.730 rmmod nvme_fabrics 00:25:52.730 rmmod nvme_keyring 00:25:52.730 15:20:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:52.730 15:20:52 -- nvmf/common.sh@123 -- # set -e 00:25:52.730 15:20:52 -- nvmf/common.sh@124 -- # return 0 00:25:52.730 15:20:52 -- nvmf/common.sh@477 -- # '[' -n 791300 ']' 00:25:52.730 15:20:52 -- nvmf/common.sh@478 -- # killprocess 791300 00:25:52.730 15:20:52 -- common/autotest_common.sh@936 -- # '[' -z 791300 ']' 00:25:52.730 15:20:52 -- common/autotest_common.sh@940 -- # kill -0 791300 00:25:52.730 15:20:52 -- common/autotest_common.sh@941 -- # uname 00:25:52.730 15:20:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:52.730 15:20:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 791300 00:25:52.730 15:20:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:52.730 15:20:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:52.730 15:20:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 791300' 00:25:52.730 killing process with pid 791300 00:25:52.730 15:20:52 -- common/autotest_common.sh@955 -- # kill 791300 00:25:52.730 [2024-11-28 15:20:52.806618] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:52.730 15:20:52 -- common/autotest_common.sh@960 -- # wait 791300 00:25:52.991 15:20:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:52.991 15:20:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:52.991 15:20:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:52.991 15:20:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:52.991 15:20:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:52.991 15:20:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:52.991 15:20:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:52.991 15:20:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:54.889 15:20:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:54.889 00:25:54.889 real 0m6.346s 00:25:54.889 user 0m7.660s 00:25:54.889 sys 0m1.946s 00:25:54.889 15:20:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:54.889 15:20:55 -- common/autotest_common.sh@10 -- # set +x 00:25:54.889 ************************************ 00:25:54.889 END TEST nvmf_aer 00:25:54.889 ************************************ 00:25:54.889 15:20:55 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:54.889 15:20:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:54.889 15:20:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:54.889 15:20:55 -- common/autotest_common.sh@10 -- # set +x 00:25:54.889 ************************************ 00:25:54.889 START TEST nvmf_async_init 00:25:54.889 ************************************ 00:25:55.152 15:20:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:55.153 * Looking for test storage... 00:25:55.153 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:55.153 15:20:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:55.153 15:20:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:55.153 15:20:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:55.153 15:20:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:55.153 15:20:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:55.153 15:20:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:55.153 15:20:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:55.153 15:20:55 -- scripts/common.sh@335 -- # IFS=.-: 00:25:55.153 15:20:55 -- scripts/common.sh@335 -- # read -ra ver1 00:25:55.153 15:20:55 -- scripts/common.sh@336 -- # IFS=.-: 00:25:55.153 15:20:55 -- scripts/common.sh@336 -- # read -ra ver2 00:25:55.153 15:20:55 -- scripts/common.sh@337 -- # local 'op=<' 00:25:55.153 15:20:55 -- scripts/common.sh@339 -- # ver1_l=2 00:25:55.153 15:20:55 -- scripts/common.sh@340 -- # ver2_l=1 00:25:55.153 15:20:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:55.153 15:20:55 -- scripts/common.sh@343 -- # case "$op" in 00:25:55.153 15:20:55 -- scripts/common.sh@344 -- # : 1 00:25:55.153 15:20:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:55.153 15:20:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:55.153 15:20:55 -- scripts/common.sh@364 -- # decimal 1 00:25:55.153 15:20:55 -- scripts/common.sh@352 -- # local d=1 00:25:55.153 15:20:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:55.153 15:20:55 -- scripts/common.sh@354 -- # echo 1 00:25:55.153 15:20:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:55.153 15:20:55 -- scripts/common.sh@365 -- # decimal 2 00:25:55.153 15:20:55 -- scripts/common.sh@352 -- # local d=2 00:25:55.153 15:20:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:55.153 15:20:55 -- scripts/common.sh@354 -- # echo 2 00:25:55.153 15:20:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:55.153 15:20:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:55.153 15:20:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:55.153 15:20:55 -- scripts/common.sh@367 -- # return 0 00:25:55.153 15:20:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:55.153 15:20:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:55.153 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.153 --rc genhtml_branch_coverage=1 00:25:55.153 --rc genhtml_function_coverage=1 00:25:55.153 --rc genhtml_legend=1 00:25:55.153 --rc geninfo_all_blocks=1 00:25:55.153 --rc geninfo_unexecuted_blocks=1 00:25:55.153 00:25:55.153 ' 00:25:55.153 15:20:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:55.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.154 --rc genhtml_branch_coverage=1 00:25:55.154 --rc genhtml_function_coverage=1 00:25:55.154 --rc genhtml_legend=1 00:25:55.154 --rc geninfo_all_blocks=1 00:25:55.154 --rc geninfo_unexecuted_blocks=1 00:25:55.154 00:25:55.154 ' 00:25:55.154 15:20:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:55.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.154 --rc genhtml_branch_coverage=1 00:25:55.154 --rc genhtml_function_coverage=1 00:25:55.154 --rc genhtml_legend=1 00:25:55.154 --rc geninfo_all_blocks=1 00:25:55.154 --rc geninfo_unexecuted_blocks=1 00:25:55.154 00:25:55.154 ' 00:25:55.154 15:20:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:55.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:55.154 --rc genhtml_branch_coverage=1 00:25:55.154 --rc genhtml_function_coverage=1 00:25:55.154 --rc genhtml_legend=1 00:25:55.154 --rc geninfo_all_blocks=1 00:25:55.154 --rc geninfo_unexecuted_blocks=1 00:25:55.154 00:25:55.154 ' 00:25:55.154 15:20:55 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:55.154 15:20:55 -- nvmf/common.sh@7 -- # uname -s 00:25:55.154 15:20:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:55.154 15:20:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:55.154 15:20:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:55.154 15:20:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:55.154 15:20:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:55.154 15:20:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:55.154 15:20:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:55.154 15:20:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:55.154 15:20:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:55.154 15:20:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:55.154 15:20:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:55.154 15:20:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:55.154 15:20:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:55.154 15:20:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:55.154 15:20:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:55.154 15:20:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:55.154 15:20:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:55.154 15:20:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:55.154 15:20:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:55.154 15:20:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.154 15:20:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.154 15:20:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.154 15:20:55 -- paths/export.sh@5 -- # export PATH 00:25:55.154 15:20:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:55.154 15:20:55 -- nvmf/common.sh@46 -- # : 0 00:25:55.154 15:20:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:55.154 15:20:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:55.154 15:20:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:55.154 15:20:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:55.154 15:20:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:55.154 15:20:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:55.154 15:20:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:55.154 15:20:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:55.154 15:20:55 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:55.154 15:20:55 -- host/async_init.sh@14 -- # null_block_size=512 00:25:55.154 15:20:55 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:55.154 15:20:55 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:55.154 15:20:55 -- host/async_init.sh@20 -- # uuidgen 00:25:55.154 15:20:55 -- host/async_init.sh@20 -- # tr -d - 00:25:55.154 15:20:55 -- host/async_init.sh@20 -- # nguid=3f77fad05f39444cb426a9a58f5e375c 00:25:55.154 15:20:55 -- host/async_init.sh@22 -- # nvmftestinit 00:25:55.154 15:20:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:55.154 15:20:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:55.154 15:20:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:55.154 15:20:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:55.154 15:20:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:55.155 15:20:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:55.155 15:20:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:55.155 15:20:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:55.155 15:20:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:55.155 15:20:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:55.155 15:20:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:55.155 15:20:55 -- common/autotest_common.sh@10 -- # set +x 00:25:57.689 15:20:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:57.689 15:20:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:57.689 15:20:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:57.689 15:20:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:57.689 15:20:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:57.689 15:20:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:57.689 15:20:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:57.689 15:20:57 -- nvmf/common.sh@294 -- # net_devs=() 00:25:57.689 15:20:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:57.689 15:20:57 -- nvmf/common.sh@295 -- # e810=() 00:25:57.689 15:20:57 -- nvmf/common.sh@295 -- # local -ga e810 00:25:57.689 15:20:57 -- nvmf/common.sh@296 -- # x722=() 00:25:57.689 15:20:57 -- nvmf/common.sh@296 -- # local -ga x722 00:25:57.689 15:20:57 -- nvmf/common.sh@297 -- # mlx=() 00:25:57.689 15:20:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:57.689 15:20:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:57.689 15:20:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:57.689 15:20:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:57.689 15:20:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:57.689 15:20:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:57.689 15:20:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:57.689 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:57.689 15:20:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:57.689 15:20:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:57.689 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:57.689 15:20:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:57.689 15:20:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:57.689 15:20:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:57.689 15:20:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:57.689 15:20:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:57.689 15:20:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:57.689 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:57.689 15:20:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:57.689 15:20:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:57.689 15:20:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:57.689 15:20:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:57.689 15:20:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:57.689 15:20:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:57.689 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:57.689 15:20:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:57.689 15:20:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:57.689 15:20:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:57.689 15:20:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:57.689 15:20:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:57.689 15:20:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:57.689 15:20:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:57.689 15:20:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:57.690 15:20:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:57.690 15:20:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:57.690 15:20:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:57.690 15:20:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:57.690 15:20:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:57.690 15:20:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:57.690 15:20:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:57.690 15:20:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:57.690 15:20:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:57.690 15:20:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:57.690 15:20:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:57.690 15:20:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:57.690 15:20:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:57.690 15:20:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:57.690 15:20:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:57.690 15:20:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:57.690 15:20:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:57.690 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:57.690 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:25:57.690 00:25:57.690 --- 10.0.0.2 ping statistics --- 00:25:57.690 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:57.690 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:25:57.690 15:20:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:57.690 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:57.690 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.047 ms 00:25:57.690 00:25:57.690 --- 10.0.0.1 ping statistics --- 00:25:57.690 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:57.690 rtt min/avg/max/mdev = 0.047/0.047/0.047/0.000 ms 00:25:57.690 15:20:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:57.690 15:20:57 -- nvmf/common.sh@410 -- # return 0 00:25:57.690 15:20:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:57.690 15:20:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:57.690 15:20:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:57.690 15:20:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:57.690 15:20:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:57.690 15:20:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:57.690 15:20:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:57.690 15:20:57 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:57.690 15:20:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:57.690 15:20:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:57.690 15:20:57 -- common/autotest_common.sh@10 -- # set +x 00:25:57.690 15:20:57 -- nvmf/common.sh@469 -- # nvmfpid=793543 00:25:57.690 15:20:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:57.690 15:20:57 -- nvmf/common.sh@470 -- # waitforlisten 793543 00:25:57.690 15:20:57 -- common/autotest_common.sh@829 -- # '[' -z 793543 ']' 00:25:57.690 15:20:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:57.690 15:20:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:57.690 15:20:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:57.690 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:57.690 15:20:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:57.690 15:20:57 -- common/autotest_common.sh@10 -- # set +x 00:25:57.690 [2024-11-28 15:20:57.498788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:25:57.690 [2024-11-28 15:20:57.498858] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:57.690 EAL: No free 2048 kB hugepages reported on node 1 00:25:57.690 [2024-11-28 15:20:57.560815] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:57.690 [2024-11-28 15:20:57.643464] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:57.690 [2024-11-28 15:20:57.643620] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:57.690 [2024-11-28 15:20:57.643636] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:57.690 [2024-11-28 15:20:57.643648] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:57.690 [2024-11-28 15:20:57.643676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:58.629 15:20:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:58.629 15:20:58 -- common/autotest_common.sh@862 -- # return 0 00:25:58.629 15:20:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:58.629 15:20:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 15:20:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:58.629 15:20:58 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 [2024-11-28 15:20:58.550318] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 null0 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 3f77fad05f39444cb426a9a58f5e375c 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 [2024-11-28 15:20:58.590529] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 nvme0n1 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 [ 00:25:58.629 { 00:25:58.629 "name": "nvme0n1", 00:25:58.629 "aliases": [ 00:25:58.629 "3f77fad0-5f39-444c-b426-a9a58f5e375c" 00:25:58.629 ], 00:25:58.629 "product_name": "NVMe disk", 00:25:58.629 "block_size": 512, 00:25:58.629 "num_blocks": 2097152, 00:25:58.629 "uuid": "3f77fad0-5f39-444c-b426-a9a58f5e375c", 00:25:58.629 "assigned_rate_limits": { 00:25:58.629 "rw_ios_per_sec": 0, 00:25:58.629 "rw_mbytes_per_sec": 0, 00:25:58.629 "r_mbytes_per_sec": 0, 00:25:58.629 "w_mbytes_per_sec": 0 00:25:58.629 }, 00:25:58.629 "claimed": false, 00:25:58.629 "zoned": false, 00:25:58.629 "supported_io_types": { 00:25:58.629 "read": true, 00:25:58.629 "write": true, 00:25:58.629 "unmap": false, 00:25:58.629 "write_zeroes": true, 00:25:58.629 "flush": true, 00:25:58.629 "reset": true, 00:25:58.629 "compare": true, 00:25:58.629 "compare_and_write": true, 00:25:58.629 "abort": true, 00:25:58.629 "nvme_admin": true, 00:25:58.629 "nvme_io": true 00:25:58.629 }, 00:25:58.629 "driver_specific": { 00:25:58.629 "nvme": [ 00:25:58.629 { 00:25:58.629 "trid": { 00:25:58.629 "trtype": "TCP", 00:25:58.629 "adrfam": "IPv4", 00:25:58.629 "traddr": "10.0.0.2", 00:25:58.629 "trsvcid": "4420", 00:25:58.629 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:58.629 }, 00:25:58.629 "ctrlr_data": { 00:25:58.629 "cntlid": 1, 00:25:58.629 "vendor_id": "0x8086", 00:25:58.629 "model_number": "SPDK bdev Controller", 00:25:58.629 "serial_number": "00000000000000000000", 00:25:58.629 "firmware_revision": "24.01.1", 00:25:58.629 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:58.629 "oacs": { 00:25:58.629 "security": 0, 00:25:58.629 "format": 0, 00:25:58.629 "firmware": 0, 00:25:58.629 "ns_manage": 0 00:25:58.629 }, 00:25:58.629 "multi_ctrlr": true, 00:25:58.629 "ana_reporting": false 00:25:58.629 }, 00:25:58.629 "vs": { 00:25:58.629 "nvme_version": "1.3" 00:25:58.629 }, 00:25:58.629 "ns_data": { 00:25:58.629 "id": 1, 00:25:58.629 "can_share": true 00:25:58.629 } 00:25:58.629 } 00:25:58.629 ], 00:25:58.629 "mp_policy": "active_passive" 00:25:58.629 } 00:25:58.629 } 00:25:58.629 ] 00:25:58.629 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.629 15:20:58 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:58.629 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.629 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.629 [2024-11-28 15:20:58.839153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:58.629 [2024-11-28 15:20:58.839231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f42ba0 (9): Bad file descriptor 00:25:58.889 [2024-11-28 15:20:58.971257] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:58.889 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.889 15:20:58 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:58.889 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.889 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.889 [ 00:25:58.889 { 00:25:58.889 "name": "nvme0n1", 00:25:58.889 "aliases": [ 00:25:58.889 "3f77fad0-5f39-444c-b426-a9a58f5e375c" 00:25:58.889 ], 00:25:58.889 "product_name": "NVMe disk", 00:25:58.889 "block_size": 512, 00:25:58.889 "num_blocks": 2097152, 00:25:58.889 "uuid": "3f77fad0-5f39-444c-b426-a9a58f5e375c", 00:25:58.889 "assigned_rate_limits": { 00:25:58.889 "rw_ios_per_sec": 0, 00:25:58.889 "rw_mbytes_per_sec": 0, 00:25:58.889 "r_mbytes_per_sec": 0, 00:25:58.889 "w_mbytes_per_sec": 0 00:25:58.889 }, 00:25:58.889 "claimed": false, 00:25:58.889 "zoned": false, 00:25:58.889 "supported_io_types": { 00:25:58.889 "read": true, 00:25:58.889 "write": true, 00:25:58.889 "unmap": false, 00:25:58.889 "write_zeroes": true, 00:25:58.889 "flush": true, 00:25:58.889 "reset": true, 00:25:58.889 "compare": true, 00:25:58.889 "compare_and_write": true, 00:25:58.889 "abort": true, 00:25:58.889 "nvme_admin": true, 00:25:58.889 "nvme_io": true 00:25:58.889 }, 00:25:58.889 "driver_specific": { 00:25:58.889 "nvme": [ 00:25:58.889 { 00:25:58.889 "trid": { 00:25:58.889 "trtype": "TCP", 00:25:58.889 "adrfam": "IPv4", 00:25:58.889 "traddr": "10.0.0.2", 00:25:58.889 "trsvcid": "4420", 00:25:58.889 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:58.889 }, 00:25:58.889 "ctrlr_data": { 00:25:58.889 "cntlid": 2, 00:25:58.889 "vendor_id": "0x8086", 00:25:58.889 "model_number": "SPDK bdev Controller", 00:25:58.889 "serial_number": "00000000000000000000", 00:25:58.889 "firmware_revision": "24.01.1", 00:25:58.889 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:58.889 "oacs": { 00:25:58.889 "security": 0, 00:25:58.889 "format": 0, 00:25:58.889 "firmware": 0, 00:25:58.889 "ns_manage": 0 00:25:58.889 }, 00:25:58.889 "multi_ctrlr": true, 00:25:58.889 "ana_reporting": false 00:25:58.889 }, 00:25:58.889 "vs": { 00:25:58.889 "nvme_version": "1.3" 00:25:58.889 }, 00:25:58.889 "ns_data": { 00:25:58.889 "id": 1, 00:25:58.889 "can_share": true 00:25:58.889 } 00:25:58.889 } 00:25:58.889 ], 00:25:58.889 "mp_policy": "active_passive" 00:25:58.889 } 00:25:58.889 } 00:25:58.889 ] 00:25:58.889 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.889 15:20:58 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:58.889 15:20:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:58 -- common/autotest_common.sh@10 -- # set +x 00:25:58.890 15:20:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.890 15:20:58 -- host/async_init.sh@53 -- # mktemp 00:25:58.890 15:20:59 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.au98bz4Jd1 00:25:58.890 15:20:59 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:58.890 15:20:59 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.au98bz4Jd1 00:25:58.890 15:20:59 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@10 -- # set +x 00:25:58.890 15:20:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.890 15:20:59 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:58.890 15:20:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@10 -- # set +x 00:25:58.890 [2024-11-28 15:20:59.015761] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:58.890 [2024-11-28 15:20:59.015896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:58.890 15:20:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.890 15:20:59 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.au98bz4Jd1 00:25:58.890 15:20:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@10 -- # set +x 00:25:58.890 15:20:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.890 15:20:59 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.au98bz4Jd1 00:25:58.890 15:20:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@10 -- # set +x 00:25:58.890 [2024-11-28 15:20:59.031796] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:58.890 nvme0n1 00:25:58.890 15:20:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.890 15:20:59 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:58.890 15:20:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@10 -- # set +x 00:25:58.890 [ 00:25:58.890 { 00:25:58.890 "name": "nvme0n1", 00:25:58.890 "aliases": [ 00:25:58.890 "3f77fad0-5f39-444c-b426-a9a58f5e375c" 00:25:58.890 ], 00:25:58.890 "product_name": "NVMe disk", 00:25:58.890 "block_size": 512, 00:25:58.890 "num_blocks": 2097152, 00:25:58.890 "uuid": "3f77fad0-5f39-444c-b426-a9a58f5e375c", 00:25:58.890 "assigned_rate_limits": { 00:25:58.890 "rw_ios_per_sec": 0, 00:25:58.890 "rw_mbytes_per_sec": 0, 00:25:58.890 "r_mbytes_per_sec": 0, 00:25:58.890 "w_mbytes_per_sec": 0 00:25:58.890 }, 00:25:58.890 "claimed": false, 00:25:58.890 "zoned": false, 00:25:58.890 "supported_io_types": { 00:25:58.890 "read": true, 00:25:58.890 "write": true, 00:25:58.890 "unmap": false, 00:25:58.890 "write_zeroes": true, 00:25:58.890 "flush": true, 00:25:58.890 "reset": true, 00:25:58.890 "compare": true, 00:25:58.890 "compare_and_write": true, 00:25:58.890 "abort": true, 00:25:58.890 "nvme_admin": true, 00:25:58.890 "nvme_io": true 00:25:58.890 }, 00:25:58.890 "driver_specific": { 00:25:58.890 "nvme": [ 00:25:58.890 { 00:25:58.890 "trid": { 00:25:58.890 "trtype": "TCP", 00:25:58.890 "adrfam": "IPv4", 00:25:58.890 "traddr": "10.0.0.2", 00:25:58.890 "trsvcid": "4421", 00:25:58.890 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:58.890 }, 00:25:58.890 "ctrlr_data": { 00:25:58.890 "cntlid": 3, 00:25:58.890 "vendor_id": "0x8086", 00:25:58.890 "model_number": "SPDK bdev Controller", 00:25:58.890 "serial_number": "00000000000000000000", 00:25:58.890 "firmware_revision": "24.01.1", 00:25:58.890 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:58.890 "oacs": { 00:25:58.890 "security": 0, 00:25:58.890 "format": 0, 00:25:58.890 "firmware": 0, 00:25:58.890 "ns_manage": 0 00:25:58.890 }, 00:25:58.890 "multi_ctrlr": true, 00:25:58.890 "ana_reporting": false 00:25:58.890 }, 00:25:58.890 "vs": { 00:25:58.890 "nvme_version": "1.3" 00:25:58.890 }, 00:25:58.890 "ns_data": { 00:25:58.890 "id": 1, 00:25:58.890 "can_share": true 00:25:58.890 } 00:25:58.890 } 00:25:58.890 ], 00:25:58.890 "mp_policy": "active_passive" 00:25:58.890 } 00:25:58.890 } 00:25:58.890 ] 00:25:58.890 15:20:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:58.890 15:20:59 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:58.890 15:20:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:58.890 15:20:59 -- common/autotest_common.sh@10 -- # set +x 00:25:59.149 15:20:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:59.149 15:20:59 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.au98bz4Jd1 00:25:59.149 15:20:59 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:59.149 15:20:59 -- host/async_init.sh@78 -- # nvmftestfini 00:25:59.149 15:20:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:59.149 15:20:59 -- nvmf/common.sh@116 -- # sync 00:25:59.149 15:20:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:59.149 15:20:59 -- nvmf/common.sh@119 -- # set +e 00:25:59.149 15:20:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:59.149 15:20:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:59.149 rmmod nvme_tcp 00:25:59.149 rmmod nvme_fabrics 00:25:59.149 rmmod nvme_keyring 00:25:59.149 15:20:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:59.149 15:20:59 -- nvmf/common.sh@123 -- # set -e 00:25:59.149 15:20:59 -- nvmf/common.sh@124 -- # return 0 00:25:59.149 15:20:59 -- nvmf/common.sh@477 -- # '[' -n 793543 ']' 00:25:59.149 15:20:59 -- nvmf/common.sh@478 -- # killprocess 793543 00:25:59.149 15:20:59 -- common/autotest_common.sh@936 -- # '[' -z 793543 ']' 00:25:59.149 15:20:59 -- common/autotest_common.sh@940 -- # kill -0 793543 00:25:59.149 15:20:59 -- common/autotest_common.sh@941 -- # uname 00:25:59.149 15:20:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:59.149 15:20:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 793543 00:25:59.149 15:20:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:59.149 15:20:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:59.149 15:20:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 793543' 00:25:59.149 killing process with pid 793543 00:25:59.150 15:20:59 -- common/autotest_common.sh@955 -- # kill 793543 00:25:59.150 15:20:59 -- common/autotest_common.sh@960 -- # wait 793543 00:25:59.408 15:20:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:59.408 15:20:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:59.408 15:20:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:59.408 15:20:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:59.408 15:20:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:59.408 15:20:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:59.408 15:20:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:59.408 15:20:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.315 15:21:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:01.315 00:26:01.315 real 0m6.343s 00:26:01.315 user 0m3.158s 00:26:01.315 sys 0m1.881s 00:26:01.315 15:21:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:01.315 15:21:01 -- common/autotest_common.sh@10 -- # set +x 00:26:01.315 ************************************ 00:26:01.315 END TEST nvmf_async_init 00:26:01.315 ************************************ 00:26:01.315 15:21:01 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:01.315 15:21:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:01.315 15:21:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:01.315 15:21:01 -- common/autotest_common.sh@10 -- # set +x 00:26:01.315 ************************************ 00:26:01.315 START TEST dma 00:26:01.315 ************************************ 00:26:01.315 15:21:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:26:01.315 * Looking for test storage... 00:26:01.315 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:01.315 15:21:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:01.315 15:21:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:01.315 15:21:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:01.574 15:21:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:01.574 15:21:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:01.574 15:21:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:01.574 15:21:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:01.574 15:21:01 -- scripts/common.sh@335 -- # IFS=.-: 00:26:01.574 15:21:01 -- scripts/common.sh@335 -- # read -ra ver1 00:26:01.574 15:21:01 -- scripts/common.sh@336 -- # IFS=.-: 00:26:01.574 15:21:01 -- scripts/common.sh@336 -- # read -ra ver2 00:26:01.574 15:21:01 -- scripts/common.sh@337 -- # local 'op=<' 00:26:01.574 15:21:01 -- scripts/common.sh@339 -- # ver1_l=2 00:26:01.574 15:21:01 -- scripts/common.sh@340 -- # ver2_l=1 00:26:01.574 15:21:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:01.574 15:21:01 -- scripts/common.sh@343 -- # case "$op" in 00:26:01.574 15:21:01 -- scripts/common.sh@344 -- # : 1 00:26:01.574 15:21:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:01.574 15:21:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:01.574 15:21:01 -- scripts/common.sh@364 -- # decimal 1 00:26:01.574 15:21:01 -- scripts/common.sh@352 -- # local d=1 00:26:01.574 15:21:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:01.574 15:21:01 -- scripts/common.sh@354 -- # echo 1 00:26:01.574 15:21:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:01.574 15:21:01 -- scripts/common.sh@365 -- # decimal 2 00:26:01.574 15:21:01 -- scripts/common.sh@352 -- # local d=2 00:26:01.574 15:21:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:01.574 15:21:01 -- scripts/common.sh@354 -- # echo 2 00:26:01.574 15:21:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:01.574 15:21:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:01.574 15:21:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:01.574 15:21:01 -- scripts/common.sh@367 -- # return 0 00:26:01.574 15:21:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:01.574 15:21:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:01.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.574 --rc genhtml_branch_coverage=1 00:26:01.574 --rc genhtml_function_coverage=1 00:26:01.574 --rc genhtml_legend=1 00:26:01.574 --rc geninfo_all_blocks=1 00:26:01.574 --rc geninfo_unexecuted_blocks=1 00:26:01.574 00:26:01.574 ' 00:26:01.574 15:21:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:01.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.574 --rc genhtml_branch_coverage=1 00:26:01.574 --rc genhtml_function_coverage=1 00:26:01.574 --rc genhtml_legend=1 00:26:01.574 --rc geninfo_all_blocks=1 00:26:01.574 --rc geninfo_unexecuted_blocks=1 00:26:01.574 00:26:01.574 ' 00:26:01.574 15:21:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:01.574 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.574 --rc genhtml_branch_coverage=1 00:26:01.574 --rc genhtml_function_coverage=1 00:26:01.574 --rc genhtml_legend=1 00:26:01.575 --rc geninfo_all_blocks=1 00:26:01.575 --rc geninfo_unexecuted_blocks=1 00:26:01.575 00:26:01.575 ' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:01.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.575 --rc genhtml_branch_coverage=1 00:26:01.575 --rc genhtml_function_coverage=1 00:26:01.575 --rc genhtml_legend=1 00:26:01.575 --rc geninfo_all_blocks=1 00:26:01.575 --rc geninfo_unexecuted_blocks=1 00:26:01.575 00:26:01.575 ' 00:26:01.575 15:21:01 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:01.575 15:21:01 -- nvmf/common.sh@7 -- # uname -s 00:26:01.575 15:21:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:01.575 15:21:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:01.575 15:21:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:01.575 15:21:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:01.575 15:21:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:01.575 15:21:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:01.575 15:21:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:01.575 15:21:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:01.575 15:21:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:01.575 15:21:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:01.575 15:21:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.575 15:21:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.575 15:21:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:01.575 15:21:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:01.575 15:21:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:01.575 15:21:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:01.575 15:21:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:01.575 15:21:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:01.575 15:21:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:01.575 15:21:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.575 15:21:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.575 15:21:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.575 15:21:01 -- paths/export.sh@5 -- # export PATH 00:26:01.575 15:21:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.575 15:21:01 -- nvmf/common.sh@46 -- # : 0 00:26:01.575 15:21:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:01.575 15:21:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:01.575 15:21:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:01.575 15:21:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:01.575 15:21:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:01.575 15:21:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:01.575 15:21:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:01.575 15:21:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:01.575 15:21:01 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:26:01.575 15:21:01 -- host/dma.sh@13 -- # exit 0 00:26:01.575 00:26:01.575 real 0m0.152s 00:26:01.575 user 0m0.096s 00:26:01.575 sys 0m0.065s 00:26:01.575 15:21:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:01.575 15:21:01 -- common/autotest_common.sh@10 -- # set +x 00:26:01.575 ************************************ 00:26:01.575 END TEST dma 00:26:01.575 ************************************ 00:26:01.575 15:21:01 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:01.575 15:21:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:01.575 15:21:01 -- common/autotest_common.sh@10 -- # set +x 00:26:01.575 ************************************ 00:26:01.575 START TEST nvmf_identify 00:26:01.575 ************************************ 00:26:01.575 15:21:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:26:01.575 * Looking for test storage... 00:26:01.575 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:01.575 15:21:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:01.575 15:21:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:01.575 15:21:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:01.575 15:21:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:01.575 15:21:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:01.575 15:21:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:01.575 15:21:01 -- scripts/common.sh@335 -- # IFS=.-: 00:26:01.575 15:21:01 -- scripts/common.sh@335 -- # read -ra ver1 00:26:01.575 15:21:01 -- scripts/common.sh@336 -- # IFS=.-: 00:26:01.575 15:21:01 -- scripts/common.sh@336 -- # read -ra ver2 00:26:01.575 15:21:01 -- scripts/common.sh@337 -- # local 'op=<' 00:26:01.575 15:21:01 -- scripts/common.sh@339 -- # ver1_l=2 00:26:01.575 15:21:01 -- scripts/common.sh@340 -- # ver2_l=1 00:26:01.575 15:21:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:01.575 15:21:01 -- scripts/common.sh@343 -- # case "$op" in 00:26:01.575 15:21:01 -- scripts/common.sh@344 -- # : 1 00:26:01.575 15:21:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:01.575 15:21:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:01.575 15:21:01 -- scripts/common.sh@364 -- # decimal 1 00:26:01.575 15:21:01 -- scripts/common.sh@352 -- # local d=1 00:26:01.575 15:21:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:01.575 15:21:01 -- scripts/common.sh@354 -- # echo 1 00:26:01.575 15:21:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:01.575 15:21:01 -- scripts/common.sh@365 -- # decimal 2 00:26:01.575 15:21:01 -- scripts/common.sh@352 -- # local d=2 00:26:01.575 15:21:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:01.575 15:21:01 -- scripts/common.sh@354 -- # echo 2 00:26:01.575 15:21:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:01.575 15:21:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:01.575 15:21:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:01.575 15:21:01 -- scripts/common.sh@367 -- # return 0 00:26:01.575 15:21:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:01.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.575 --rc genhtml_branch_coverage=1 00:26:01.575 --rc genhtml_function_coverage=1 00:26:01.575 --rc genhtml_legend=1 00:26:01.575 --rc geninfo_all_blocks=1 00:26:01.575 --rc geninfo_unexecuted_blocks=1 00:26:01.575 00:26:01.575 ' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:01.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.575 --rc genhtml_branch_coverage=1 00:26:01.575 --rc genhtml_function_coverage=1 00:26:01.575 --rc genhtml_legend=1 00:26:01.575 --rc geninfo_all_blocks=1 00:26:01.575 --rc geninfo_unexecuted_blocks=1 00:26:01.575 00:26:01.575 ' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:01.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.575 --rc genhtml_branch_coverage=1 00:26:01.575 --rc genhtml_function_coverage=1 00:26:01.575 --rc genhtml_legend=1 00:26:01.575 --rc geninfo_all_blocks=1 00:26:01.575 --rc geninfo_unexecuted_blocks=1 00:26:01.575 00:26:01.575 ' 00:26:01.575 15:21:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:01.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:01.575 --rc genhtml_branch_coverage=1 00:26:01.575 --rc genhtml_function_coverage=1 00:26:01.575 --rc genhtml_legend=1 00:26:01.575 --rc geninfo_all_blocks=1 00:26:01.575 --rc geninfo_unexecuted_blocks=1 00:26:01.575 00:26:01.575 ' 00:26:01.575 15:21:01 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:01.575 15:21:01 -- nvmf/common.sh@7 -- # uname -s 00:26:01.575 15:21:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:01.575 15:21:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:01.575 15:21:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:01.575 15:21:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:01.575 15:21:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:01.575 15:21:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:01.575 15:21:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:01.575 15:21:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:01.575 15:21:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:01.575 15:21:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:01.835 15:21:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.835 15:21:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:01.835 15:21:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:01.835 15:21:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:01.835 15:21:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:01.835 15:21:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:01.835 15:21:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:01.835 15:21:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:01.835 15:21:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:01.835 15:21:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.835 15:21:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.835 15:21:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.835 15:21:01 -- paths/export.sh@5 -- # export PATH 00:26:01.835 15:21:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:01.835 15:21:01 -- nvmf/common.sh@46 -- # : 0 00:26:01.835 15:21:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:01.835 15:21:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:01.835 15:21:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:01.835 15:21:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:01.835 15:21:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:01.835 15:21:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:01.835 15:21:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:01.835 15:21:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:01.835 15:21:01 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:26:01.835 15:21:01 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:26:01.835 15:21:01 -- host/identify.sh@14 -- # nvmftestinit 00:26:01.835 15:21:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:01.835 15:21:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:01.835 15:21:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:01.835 15:21:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:01.835 15:21:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:01.835 15:21:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:01.835 15:21:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:01.836 15:21:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:01.836 15:21:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:01.836 15:21:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:01.836 15:21:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:01.836 15:21:01 -- common/autotest_common.sh@10 -- # set +x 00:26:03.742 15:21:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:03.742 15:21:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:03.742 15:21:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:03.742 15:21:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:03.742 15:21:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:03.742 15:21:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:03.742 15:21:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:03.742 15:21:03 -- nvmf/common.sh@294 -- # net_devs=() 00:26:03.742 15:21:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:03.742 15:21:03 -- nvmf/common.sh@295 -- # e810=() 00:26:03.742 15:21:03 -- nvmf/common.sh@295 -- # local -ga e810 00:26:03.742 15:21:03 -- nvmf/common.sh@296 -- # x722=() 00:26:03.742 15:21:03 -- nvmf/common.sh@296 -- # local -ga x722 00:26:03.742 15:21:03 -- nvmf/common.sh@297 -- # mlx=() 00:26:03.742 15:21:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:03.742 15:21:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:03.742 15:21:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:03.742 15:21:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:03.742 15:21:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:03.742 15:21:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.742 15:21:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:03.742 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:03.742 15:21:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:03.742 15:21:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:03.742 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:03.742 15:21:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:03.742 15:21:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.742 15:21:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.742 15:21:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.742 15:21:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.742 15:21:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:03.742 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:03.742 15:21:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.742 15:21:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:03.742 15:21:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:03.742 15:21:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:03.742 15:21:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:03.742 15:21:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:03.742 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:03.742 15:21:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:03.742 15:21:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:03.742 15:21:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:03.742 15:21:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:03.742 15:21:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:03.742 15:21:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:03.742 15:21:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:03.742 15:21:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:03.742 15:21:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:03.742 15:21:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:03.742 15:21:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:03.742 15:21:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:03.742 15:21:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:03.742 15:21:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:03.742 15:21:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:03.742 15:21:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:03.742 15:21:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:03.742 15:21:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:03.742 15:21:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:03.742 15:21:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:03.742 15:21:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:03.742 15:21:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:03.742 15:21:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:03.742 15:21:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:03.742 15:21:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:03.742 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:03.742 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.323 ms 00:26:03.742 00:26:03.742 --- 10.0.0.2 ping statistics --- 00:26:03.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.742 rtt min/avg/max/mdev = 0.323/0.323/0.323/0.000 ms 00:26:03.742 15:21:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:03.742 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:03.742 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:26:03.742 00:26:03.742 --- 10.0.0.1 ping statistics --- 00:26:03.742 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:03.742 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:26:03.742 15:21:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:03.742 15:21:03 -- nvmf/common.sh@410 -- # return 0 00:26:03.743 15:21:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:03.743 15:21:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:03.743 15:21:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:03.743 15:21:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:03.743 15:21:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:03.743 15:21:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:03.743 15:21:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:03.743 15:21:03 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:03.743 15:21:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:03.743 15:21:03 -- common/autotest_common.sh@10 -- # set +x 00:26:04.002 15:21:03 -- host/identify.sh@19 -- # nvmfpid=795910 00:26:04.002 15:21:03 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:04.002 15:21:03 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:04.002 15:21:03 -- host/identify.sh@23 -- # waitforlisten 795910 00:26:04.002 15:21:03 -- common/autotest_common.sh@829 -- # '[' -z 795910 ']' 00:26:04.002 15:21:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:04.002 15:21:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:04.002 15:21:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:04.002 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:04.002 15:21:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:04.002 15:21:03 -- common/autotest_common.sh@10 -- # set +x 00:26:04.002 [2024-11-28 15:21:04.020953] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:04.002 [2024-11-28 15:21:04.021024] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:04.002 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.002 [2024-11-28 15:21:04.087622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:04.002 [2024-11-28 15:21:04.179465] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:04.002 [2024-11-28 15:21:04.179606] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:04.003 [2024-11-28 15:21:04.179623] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:04.003 [2024-11-28 15:21:04.179635] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:04.003 [2024-11-28 15:21:04.179696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:04.003 [2024-11-28 15:21:04.179755] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:04.003 [2024-11-28 15:21:04.179823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:04.003 [2024-11-28 15:21:04.179826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:04.939 15:21:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.939 15:21:05 -- common/autotest_common.sh@862 -- # return 0 00:26:04.939 15:21:05 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 [2024-11-28 15:21:05.013758] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:04.939 15:21:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 15:21:05 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 Malloc0 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 [2024-11-28 15:21:05.085481] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:04.939 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:04.939 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:04.939 [2024-11-28 15:21:05.101203] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:04.939 [ 00:26:04.939 { 00:26:04.939 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:04.939 "subtype": "Discovery", 00:26:04.939 "listen_addresses": [ 00:26:04.939 { 00:26:04.939 "transport": "TCP", 00:26:04.939 "trtype": "TCP", 00:26:04.939 "adrfam": "IPv4", 00:26:04.939 "traddr": "10.0.0.2", 00:26:04.939 "trsvcid": "4420" 00:26:04.939 } 00:26:04.939 ], 00:26:04.939 "allow_any_host": true, 00:26:04.939 "hosts": [] 00:26:04.939 }, 00:26:04.939 { 00:26:04.939 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:04.939 "subtype": "NVMe", 00:26:04.939 "listen_addresses": [ 00:26:04.939 { 00:26:04.939 "transport": "TCP", 00:26:04.939 "trtype": "TCP", 00:26:04.939 "adrfam": "IPv4", 00:26:04.939 "traddr": "10.0.0.2", 00:26:04.939 "trsvcid": "4420" 00:26:04.939 } 00:26:04.939 ], 00:26:04.939 "allow_any_host": true, 00:26:04.939 "hosts": [], 00:26:04.939 "serial_number": "SPDK00000000000001", 00:26:04.939 "model_number": "SPDK bdev Controller", 00:26:04.939 "max_namespaces": 32, 00:26:04.939 "min_cntlid": 1, 00:26:04.939 "max_cntlid": 65519, 00:26:04.939 "namespaces": [ 00:26:04.939 { 00:26:04.939 "nsid": 1, 00:26:04.939 "bdev_name": "Malloc0", 00:26:04.939 "name": "Malloc0", 00:26:04.939 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:04.939 "eui64": "ABCDEF0123456789", 00:26:04.939 "uuid": "fd574fc9-41cc-4a6b-be26-277728f4ffde" 00:26:04.939 } 00:26:04.939 ] 00:26:04.939 } 00:26:04.939 ] 00:26:04.939 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:04.939 15:21:05 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:04.939 [2024-11-28 15:21:05.124700] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:04.939 [2024-11-28 15:21:05.124751] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid796086 ] 00:26:04.939 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.939 [2024-11-28 15:21:05.156786] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:04.939 [2024-11-28 15:21:05.156844] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:04.939 [2024-11-28 15:21:05.156854] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:04.939 [2024-11-28 15:21:05.156870] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:04.939 [2024-11-28 15:21:05.156883] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:04.939 [2024-11-28 15:21:05.160157] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:04.939 [2024-11-28 15:21:05.160217] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xef52f0 0 00:26:04.939 [2024-11-28 15:21:05.168109] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:04.939 [2024-11-28 15:21:05.168145] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:04.940 [2024-11-28 15:21:05.168155] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:04.940 [2024-11-28 15:21:05.168162] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:04.940 [2024-11-28 15:21:05.168213] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:04.940 [2024-11-28 15:21:05.168228] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:04.940 [2024-11-28 15:21:05.168236] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:04.940 [2024-11-28 15:21:05.168255] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:04.940 [2024-11-28 15:21:05.168283] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.202 [2024-11-28 15:21:05.174109] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.202 [2024-11-28 15:21:05.174128] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.202 [2024-11-28 15:21:05.174161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174169] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.202 [2024-11-28 15:21:05.174191] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:05.202 [2024-11-28 15:21:05.174202] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:05.202 [2024-11-28 15:21:05.174212] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:05.202 [2024-11-28 15:21:05.174232] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174241] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174248] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.202 [2024-11-28 15:21:05.174260] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.202 [2024-11-28 15:21:05.174284] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.202 [2024-11-28 15:21:05.174424] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.202 [2024-11-28 15:21:05.174448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.202 [2024-11-28 15:21:05.174455] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174462] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.202 [2024-11-28 15:21:05.174473] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:05.202 [2024-11-28 15:21:05.174492] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:05.202 [2024-11-28 15:21:05.174506] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174514] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174520] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.202 [2024-11-28 15:21:05.174531] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.202 [2024-11-28 15:21:05.174552] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.202 [2024-11-28 15:21:05.174640] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.202 [2024-11-28 15:21:05.174655] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.202 [2024-11-28 15:21:05.174662] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174669] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.202 [2024-11-28 15:21:05.174678] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:05.202 [2024-11-28 15:21:05.174692] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:05.202 [2024-11-28 15:21:05.174704] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174711] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174717] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.202 [2024-11-28 15:21:05.174728] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.202 [2024-11-28 15:21:05.174748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.202 [2024-11-28 15:21:05.174822] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.202 [2024-11-28 15:21:05.174836] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.202 [2024-11-28 15:21:05.174843] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174850] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.202 [2024-11-28 15:21:05.174859] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:05.202 [2024-11-28 15:21:05.174876] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174885] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.174892] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.202 [2024-11-28 15:21:05.174902] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.202 [2024-11-28 15:21:05.174922] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.202 [2024-11-28 15:21:05.174999] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.202 [2024-11-28 15:21:05.175013] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.202 [2024-11-28 15:21:05.175020] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.175026] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.202 [2024-11-28 15:21:05.175036] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:05.202 [2024-11-28 15:21:05.175044] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:05.202 [2024-11-28 15:21:05.175062] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:05.202 [2024-11-28 15:21:05.175173] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:05.202 [2024-11-28 15:21:05.175183] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:05.202 [2024-11-28 15:21:05.175199] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.175206] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.175213] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.202 [2024-11-28 15:21:05.175223] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.202 [2024-11-28 15:21:05.175245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.202 [2024-11-28 15:21:05.175362] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.202 [2024-11-28 15:21:05.175376] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.202 [2024-11-28 15:21:05.175383] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.175389] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.202 [2024-11-28 15:21:05.175398] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:05.202 [2024-11-28 15:21:05.175414] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.202 [2024-11-28 15:21:05.175423] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175430] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.175440] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.203 [2024-11-28 15:21:05.175460] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.203 [2024-11-28 15:21:05.175537] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.203 [2024-11-28 15:21:05.175551] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.203 [2024-11-28 15:21:05.175558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175565] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.203 [2024-11-28 15:21:05.175573] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:05.203 [2024-11-28 15:21:05.175582] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:05.203 [2024-11-28 15:21:05.175595] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:05.203 [2024-11-28 15:21:05.175610] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:05.203 [2024-11-28 15:21:05.175625] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175633] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175639] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.175650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.203 [2024-11-28 15:21:05.175671] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.203 [2024-11-28 15:21:05.175811] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.203 [2024-11-28 15:21:05.175824] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.203 [2024-11-28 15:21:05.175831] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175839] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xef52f0): datao=0, datal=4096, cccid=0 00:26:05.203 [2024-11-28 15:21:05.175847] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf4dec0) on tqpair(0xef52f0): expected_datao=0, payload_size=4096 00:26:05.203 [2024-11-28 15:21:05.175860] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175869] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.203 [2024-11-28 15:21:05.175892] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.203 [2024-11-28 15:21:05.175898] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.175905] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.203 [2024-11-28 15:21:05.175917] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:05.203 [2024-11-28 15:21:05.175927] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:05.203 [2024-11-28 15:21:05.175934] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:05.203 [2024-11-28 15:21:05.175943] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:05.203 [2024-11-28 15:21:05.175951] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:05.203 [2024-11-28 15:21:05.175959] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:05.203 [2024-11-28 15:21:05.175983] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:05.203 [2024-11-28 15:21:05.175997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176005] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176011] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176022] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:05.203 [2024-11-28 15:21:05.176050] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.203 [2024-11-28 15:21:05.176149] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.203 [2024-11-28 15:21:05.176163] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.203 [2024-11-28 15:21:05.176170] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176176] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4dec0) on tqpair=0xef52f0 00:26:05.203 [2024-11-28 15:21:05.176190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176198] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176204] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176214] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.203 [2024-11-28 15:21:05.176224] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176231] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176238] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.203 [2024-11-28 15:21:05.176260] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176268] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176274] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176283] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.203 [2024-11-28 15:21:05.176294] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176300] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176307] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176315] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.203 [2024-11-28 15:21:05.176324] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:05.203 [2024-11-28 15:21:05.176344] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:05.203 [2024-11-28 15:21:05.176356] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176363] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176369] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176379] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.203 [2024-11-28 15:21:05.176403] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4dec0, cid 0, qid 0 00:26:05.203 [2024-11-28 15:21:05.176414] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e020, cid 1, qid 0 00:26:05.203 [2024-11-28 15:21:05.176423] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e180, cid 2, qid 0 00:26:05.203 [2024-11-28 15:21:05.176431] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.203 [2024-11-28 15:21:05.176438] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e440, cid 4, qid 0 00:26:05.203 [2024-11-28 15:21:05.176573] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.203 [2024-11-28 15:21:05.176587] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.203 [2024-11-28 15:21:05.176594] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176601] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e440) on tqpair=0xef52f0 00:26:05.203 [2024-11-28 15:21:05.176610] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:05.203 [2024-11-28 15:21:05.176619] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:05.203 [2024-11-28 15:21:05.176636] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176645] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176651] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.176662] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.203 [2024-11-28 15:21:05.176682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e440, cid 4, qid 0 00:26:05.203 [2024-11-28 15:21:05.176776] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.203 [2024-11-28 15:21:05.176790] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.203 [2024-11-28 15:21:05.176797] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176808] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xef52f0): datao=0, datal=4096, cccid=4 00:26:05.203 [2024-11-28 15:21:05.176816] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf4e440) on tqpair(0xef52f0): expected_datao=0, payload_size=4096 00:26:05.203 [2024-11-28 15:21:05.176834] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.176843] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.217215] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.203 [2024-11-28 15:21:05.217234] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.203 [2024-11-28 15:21:05.217241] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.217248] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e440) on tqpair=0xef52f0 00:26:05.203 [2024-11-28 15:21:05.217268] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:05.203 [2024-11-28 15:21:05.217307] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.217318] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.217324] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xef52f0) 00:26:05.203 [2024-11-28 15:21:05.217336] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.203 [2024-11-28 15:21:05.217351] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.217358] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.203 [2024-11-28 15:21:05.217364] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xef52f0) 00:26:05.204 [2024-11-28 15:21:05.217373] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.204 [2024-11-28 15:21:05.217400] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e440, cid 4, qid 0 00:26:05.204 [2024-11-28 15:21:05.217412] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e5a0, cid 5, qid 0 00:26:05.204 [2024-11-28 15:21:05.217580] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.204 [2024-11-28 15:21:05.217593] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.204 [2024-11-28 15:21:05.217599] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.217606] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xef52f0): datao=0, datal=1024, cccid=4 00:26:05.204 [2024-11-28 15:21:05.217613] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf4e440) on tqpair(0xef52f0): expected_datao=0, payload_size=1024 00:26:05.204 [2024-11-28 15:21:05.217624] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.217631] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.217640] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.204 [2024-11-28 15:21:05.217649] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.204 [2024-11-28 15:21:05.217655] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.217662] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e5a0) on tqpair=0xef52f0 00:26:05.204 [2024-11-28 15:21:05.262107] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.204 [2024-11-28 15:21:05.262126] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.204 [2024-11-28 15:21:05.262133] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262140] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e440) on tqpair=0xef52f0 00:26:05.204 [2024-11-28 15:21:05.262158] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262178] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xef52f0) 00:26:05.204 [2024-11-28 15:21:05.262189] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.204 [2024-11-28 15:21:05.262234] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e440, cid 4, qid 0 00:26:05.204 [2024-11-28 15:21:05.262375] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.204 [2024-11-28 15:21:05.262388] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.204 [2024-11-28 15:21:05.262394] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262401] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xef52f0): datao=0, datal=3072, cccid=4 00:26:05.204 [2024-11-28 15:21:05.262408] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf4e440) on tqpair(0xef52f0): expected_datao=0, payload_size=3072 00:26:05.204 [2024-11-28 15:21:05.262419] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262427] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262438] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.204 [2024-11-28 15:21:05.262448] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.204 [2024-11-28 15:21:05.262454] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262461] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e440) on tqpair=0xef52f0 00:26:05.204 [2024-11-28 15:21:05.262476] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262484] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262491] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xef52f0) 00:26:05.204 [2024-11-28 15:21:05.262501] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.204 [2024-11-28 15:21:05.262529] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e440, cid 4, qid 0 00:26:05.204 [2024-11-28 15:21:05.262620] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.204 [2024-11-28 15:21:05.262632] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.204 [2024-11-28 15:21:05.262638] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262645] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xef52f0): datao=0, datal=8, cccid=4 00:26:05.204 [2024-11-28 15:21:05.262652] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf4e440) on tqpair(0xef52f0): expected_datao=0, payload_size=8 00:26:05.204 [2024-11-28 15:21:05.262662] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.262669] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.304192] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.204 [2024-11-28 15:21:05.304211] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.204 [2024-11-28 15:21:05.304218] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.204 [2024-11-28 15:21:05.304225] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e440) on tqpair=0xef52f0 00:26:05.204 ===================================================== 00:26:05.204 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:05.204 ===================================================== 00:26:05.204 Controller Capabilities/Features 00:26:05.204 ================================ 00:26:05.204 Vendor ID: 0000 00:26:05.204 Subsystem Vendor ID: 0000 00:26:05.204 Serial Number: .................... 00:26:05.204 Model Number: ........................................ 00:26:05.204 Firmware Version: 24.01.1 00:26:05.204 Recommended Arb Burst: 0 00:26:05.204 IEEE OUI Identifier: 00 00 00 00:26:05.204 Multi-path I/O 00:26:05.204 May have multiple subsystem ports: No 00:26:05.204 May have multiple controllers: No 00:26:05.204 Associated with SR-IOV VF: No 00:26:05.204 Max Data Transfer Size: 131072 00:26:05.204 Max Number of Namespaces: 0 00:26:05.204 Max Number of I/O Queues: 1024 00:26:05.204 NVMe Specification Version (VS): 1.3 00:26:05.204 NVMe Specification Version (Identify): 1.3 00:26:05.204 Maximum Queue Entries: 128 00:26:05.204 Contiguous Queues Required: Yes 00:26:05.204 Arbitration Mechanisms Supported 00:26:05.204 Weighted Round Robin: Not Supported 00:26:05.204 Vendor Specific: Not Supported 00:26:05.204 Reset Timeout: 15000 ms 00:26:05.204 Doorbell Stride: 4 bytes 00:26:05.204 NVM Subsystem Reset: Not Supported 00:26:05.204 Command Sets Supported 00:26:05.204 NVM Command Set: Supported 00:26:05.204 Boot Partition: Not Supported 00:26:05.204 Memory Page Size Minimum: 4096 bytes 00:26:05.204 Memory Page Size Maximum: 4096 bytes 00:26:05.204 Persistent Memory Region: Not Supported 00:26:05.204 Optional Asynchronous Events Supported 00:26:05.204 Namespace Attribute Notices: Not Supported 00:26:05.204 Firmware Activation Notices: Not Supported 00:26:05.204 ANA Change Notices: Not Supported 00:26:05.204 PLE Aggregate Log Change Notices: Not Supported 00:26:05.204 LBA Status Info Alert Notices: Not Supported 00:26:05.204 EGE Aggregate Log Change Notices: Not Supported 00:26:05.204 Normal NVM Subsystem Shutdown event: Not Supported 00:26:05.204 Zone Descriptor Change Notices: Not Supported 00:26:05.204 Discovery Log Change Notices: Supported 00:26:05.204 Controller Attributes 00:26:05.204 128-bit Host Identifier: Not Supported 00:26:05.204 Non-Operational Permissive Mode: Not Supported 00:26:05.204 NVM Sets: Not Supported 00:26:05.204 Read Recovery Levels: Not Supported 00:26:05.204 Endurance Groups: Not Supported 00:26:05.204 Predictable Latency Mode: Not Supported 00:26:05.204 Traffic Based Keep ALive: Not Supported 00:26:05.204 Namespace Granularity: Not Supported 00:26:05.204 SQ Associations: Not Supported 00:26:05.204 UUID List: Not Supported 00:26:05.204 Multi-Domain Subsystem: Not Supported 00:26:05.204 Fixed Capacity Management: Not Supported 00:26:05.204 Variable Capacity Management: Not Supported 00:26:05.204 Delete Endurance Group: Not Supported 00:26:05.204 Delete NVM Set: Not Supported 00:26:05.204 Extended LBA Formats Supported: Not Supported 00:26:05.204 Flexible Data Placement Supported: Not Supported 00:26:05.204 00:26:05.204 Controller Memory Buffer Support 00:26:05.204 ================================ 00:26:05.204 Supported: No 00:26:05.204 00:26:05.204 Persistent Memory Region Support 00:26:05.204 ================================ 00:26:05.204 Supported: No 00:26:05.204 00:26:05.204 Admin Command Set Attributes 00:26:05.204 ============================ 00:26:05.204 Security Send/Receive: Not Supported 00:26:05.204 Format NVM: Not Supported 00:26:05.204 Firmware Activate/Download: Not Supported 00:26:05.204 Namespace Management: Not Supported 00:26:05.204 Device Self-Test: Not Supported 00:26:05.204 Directives: Not Supported 00:26:05.204 NVMe-MI: Not Supported 00:26:05.204 Virtualization Management: Not Supported 00:26:05.204 Doorbell Buffer Config: Not Supported 00:26:05.204 Get LBA Status Capability: Not Supported 00:26:05.204 Command & Feature Lockdown Capability: Not Supported 00:26:05.204 Abort Command Limit: 1 00:26:05.204 Async Event Request Limit: 4 00:26:05.204 Number of Firmware Slots: N/A 00:26:05.204 Firmware Slot 1 Read-Only: N/A 00:26:05.204 Firmware Activation Without Reset: N/A 00:26:05.204 Multiple Update Detection Support: N/A 00:26:05.204 Firmware Update Granularity: No Information Provided 00:26:05.204 Per-Namespace SMART Log: No 00:26:05.204 Asymmetric Namespace Access Log Page: Not Supported 00:26:05.204 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:05.204 Command Effects Log Page: Not Supported 00:26:05.204 Get Log Page Extended Data: Supported 00:26:05.204 Telemetry Log Pages: Not Supported 00:26:05.204 Persistent Event Log Pages: Not Supported 00:26:05.204 Supported Log Pages Log Page: May Support 00:26:05.204 Commands Supported & Effects Log Page: Not Supported 00:26:05.204 Feature Identifiers & Effects Log Page:May Support 00:26:05.204 NVMe-MI Commands & Effects Log Page: May Support 00:26:05.204 Data Area 4 for Telemetry Log: Not Supported 00:26:05.205 Error Log Page Entries Supported: 128 00:26:05.205 Keep Alive: Not Supported 00:26:05.205 00:26:05.205 NVM Command Set Attributes 00:26:05.205 ========================== 00:26:05.205 Submission Queue Entry Size 00:26:05.205 Max: 1 00:26:05.205 Min: 1 00:26:05.205 Completion Queue Entry Size 00:26:05.205 Max: 1 00:26:05.205 Min: 1 00:26:05.205 Number of Namespaces: 0 00:26:05.205 Compare Command: Not Supported 00:26:05.205 Write Uncorrectable Command: Not Supported 00:26:05.205 Dataset Management Command: Not Supported 00:26:05.205 Write Zeroes Command: Not Supported 00:26:05.205 Set Features Save Field: Not Supported 00:26:05.205 Reservations: Not Supported 00:26:05.205 Timestamp: Not Supported 00:26:05.205 Copy: Not Supported 00:26:05.205 Volatile Write Cache: Not Present 00:26:05.205 Atomic Write Unit (Normal): 1 00:26:05.205 Atomic Write Unit (PFail): 1 00:26:05.205 Atomic Compare & Write Unit: 1 00:26:05.205 Fused Compare & Write: Supported 00:26:05.205 Scatter-Gather List 00:26:05.205 SGL Command Set: Supported 00:26:05.205 SGL Keyed: Supported 00:26:05.205 SGL Bit Bucket Descriptor: Not Supported 00:26:05.205 SGL Metadata Pointer: Not Supported 00:26:05.205 Oversized SGL: Not Supported 00:26:05.205 SGL Metadata Address: Not Supported 00:26:05.205 SGL Offset: Supported 00:26:05.205 Transport SGL Data Block: Not Supported 00:26:05.205 Replay Protected Memory Block: Not Supported 00:26:05.205 00:26:05.205 Firmware Slot Information 00:26:05.205 ========================= 00:26:05.205 Active slot: 0 00:26:05.205 00:26:05.205 00:26:05.205 Error Log 00:26:05.205 ========= 00:26:05.205 00:26:05.205 Active Namespaces 00:26:05.205 ================= 00:26:05.205 Discovery Log Page 00:26:05.205 ================== 00:26:05.205 Generation Counter: 2 00:26:05.205 Number of Records: 2 00:26:05.205 Record Format: 0 00:26:05.205 00:26:05.205 Discovery Log Entry 0 00:26:05.205 ---------------------- 00:26:05.205 Transport Type: 3 (TCP) 00:26:05.205 Address Family: 1 (IPv4) 00:26:05.205 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:05.205 Entry Flags: 00:26:05.205 Duplicate Returned Information: 1 00:26:05.205 Explicit Persistent Connection Support for Discovery: 1 00:26:05.205 Transport Requirements: 00:26:05.205 Secure Channel: Not Required 00:26:05.205 Port ID: 0 (0x0000) 00:26:05.205 Controller ID: 65535 (0xffff) 00:26:05.205 Admin Max SQ Size: 128 00:26:05.205 Transport Service Identifier: 4420 00:26:05.205 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:05.205 Transport Address: 10.0.0.2 00:26:05.205 Discovery Log Entry 1 00:26:05.205 ---------------------- 00:26:05.205 Transport Type: 3 (TCP) 00:26:05.205 Address Family: 1 (IPv4) 00:26:05.205 Subsystem Type: 2 (NVM Subsystem) 00:26:05.205 Entry Flags: 00:26:05.205 Duplicate Returned Information: 0 00:26:05.205 Explicit Persistent Connection Support for Discovery: 0 00:26:05.205 Transport Requirements: 00:26:05.205 Secure Channel: Not Required 00:26:05.205 Port ID: 0 (0x0000) 00:26:05.205 Controller ID: 65535 (0xffff) 00:26:05.205 Admin Max SQ Size: 128 00:26:05.205 Transport Service Identifier: 4420 00:26:05.205 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:05.205 Transport Address: 10.0.0.2 [2024-11-28 15:21:05.304340] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:05.205 [2024-11-28 15:21:05.304367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.205 [2024-11-28 15:21:05.304380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.205 [2024-11-28 15:21:05.304389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.205 [2024-11-28 15:21:05.304399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.205 [2024-11-28 15:21:05.304416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304424] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304431] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.205 [2024-11-28 15:21:05.304442] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.205 [2024-11-28 15:21:05.304468] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.205 [2024-11-28 15:21:05.304580] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.205 [2024-11-28 15:21:05.304592] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.205 [2024-11-28 15:21:05.304599] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304605] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.205 [2024-11-28 15:21:05.304618] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304625] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304632] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.205 [2024-11-28 15:21:05.304642] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.205 [2024-11-28 15:21:05.304668] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.205 [2024-11-28 15:21:05.304778] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.205 [2024-11-28 15:21:05.304792] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.205 [2024-11-28 15:21:05.304799] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304806] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.205 [2024-11-28 15:21:05.304814] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:05.205 [2024-11-28 15:21:05.304823] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:05.205 [2024-11-28 15:21:05.304839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304847] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.205 [2024-11-28 15:21:05.304864] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.205 [2024-11-28 15:21:05.304884] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.205 [2024-11-28 15:21:05.304965] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.205 [2024-11-28 15:21:05.304980] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.205 [2024-11-28 15:21:05.304986] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.304993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.205 [2024-11-28 15:21:05.305010] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305019] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305025] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.205 [2024-11-28 15:21:05.305036] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.205 [2024-11-28 15:21:05.305056] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.205 [2024-11-28 15:21:05.305140] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.205 [2024-11-28 15:21:05.305155] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.205 [2024-11-28 15:21:05.305166] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305173] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.205 [2024-11-28 15:21:05.305190] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305199] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305206] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.205 [2024-11-28 15:21:05.305216] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.205 [2024-11-28 15:21:05.305237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.205 [2024-11-28 15:21:05.305311] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.205 [2024-11-28 15:21:05.305323] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.205 [2024-11-28 15:21:05.305330] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305336] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.205 [2024-11-28 15:21:05.305352] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305361] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305367] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.205 [2024-11-28 15:21:05.305378] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.205 [2024-11-28 15:21:05.305398] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.205 [2024-11-28 15:21:05.305471] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.205 [2024-11-28 15:21:05.305485] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.205 [2024-11-28 15:21:05.305491] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305498] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.205 [2024-11-28 15:21:05.305514] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.205 [2024-11-28 15:21:05.305523] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305529] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.206 [2024-11-28 15:21:05.305540] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.305560] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.206 [2024-11-28 15:21:05.305633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.305645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.305652] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305659] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.206 [2024-11-28 15:21:05.305674] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305683] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305689] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.206 [2024-11-28 15:21:05.305700] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.305720] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.206 [2024-11-28 15:21:05.305795] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.305809] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.305815] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305826] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.206 [2024-11-28 15:21:05.305843] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305851] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.206 [2024-11-28 15:21:05.305868] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.305889] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.206 [2024-11-28 15:21:05.305964] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.305978] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.305984] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.305991] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.206 [2024-11-28 15:21:05.306007] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.306016] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.306022] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.206 [2024-11-28 15:21:05.306033] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.306053] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.206 [2024-11-28 15:21:05.310107] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.310123] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.310130] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.310136] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.206 [2024-11-28 15:21:05.310153] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.310178] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.310184] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xef52f0) 00:26:05.206 [2024-11-28 15:21:05.310195] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.310217] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf4e2e0, cid 3, qid 0 00:26:05.206 [2024-11-28 15:21:05.310331] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.310343] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.310349] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.310356] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf4e2e0) on tqpair=0xef52f0 00:26:05.206 [2024-11-28 15:21:05.310369] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 5 milliseconds 00:26:05.206 00:26:05.206 15:21:05 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:05.206 [2024-11-28 15:21:05.342526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:05.206 [2024-11-28 15:21:05.342571] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid796101 ] 00:26:05.206 EAL: No free 2048 kB hugepages reported on node 1 00:26:05.206 [2024-11-28 15:21:05.376024] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:05.206 [2024-11-28 15:21:05.376087] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:05.206 [2024-11-28 15:21:05.376106] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:05.206 [2024-11-28 15:21:05.376121] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:05.206 [2024-11-28 15:21:05.376133] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:05.206 [2024-11-28 15:21:05.376304] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:05.206 [2024-11-28 15:21:05.376351] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x137f2f0 0 00:26:05.206 [2024-11-28 15:21:05.383120] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:05.206 [2024-11-28 15:21:05.383138] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:05.206 [2024-11-28 15:21:05.383145] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:05.206 [2024-11-28 15:21:05.383151] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:05.206 [2024-11-28 15:21:05.383204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.383216] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.383222] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.206 [2024-11-28 15:21:05.383236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:05.206 [2024-11-28 15:21:05.383263] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.206 [2024-11-28 15:21:05.391108] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.391125] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.391133] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.391139] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.206 [2024-11-28 15:21:05.391154] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:05.206 [2024-11-28 15:21:05.391163] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:05.206 [2024-11-28 15:21:05.391172] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:05.206 [2024-11-28 15:21:05.391188] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.391196] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.391203] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.206 [2024-11-28 15:21:05.391213] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.391236] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.206 [2024-11-28 15:21:05.391385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.206 [2024-11-28 15:21:05.391399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.206 [2024-11-28 15:21:05.391406] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.391412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.206 [2024-11-28 15:21:05.391422] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:05.206 [2024-11-28 15:21:05.391435] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:05.206 [2024-11-28 15:21:05.391452] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.391460] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.206 [2024-11-28 15:21:05.391466] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.206 [2024-11-28 15:21:05.391476] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.206 [2024-11-28 15:21:05.391498] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.206 [2024-11-28 15:21:05.391588] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.207 [2024-11-28 15:21:05.391599] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.207 [2024-11-28 15:21:05.391606] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.391612] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.207 [2024-11-28 15:21:05.391621] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:05.207 [2024-11-28 15:21:05.391634] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:05.207 [2024-11-28 15:21:05.391646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.391653] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.391659] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.207 [2024-11-28 15:21:05.391669] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.207 [2024-11-28 15:21:05.391690] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.207 [2024-11-28 15:21:05.391820] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.207 [2024-11-28 15:21:05.391834] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.207 [2024-11-28 15:21:05.391841] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.391847] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.207 [2024-11-28 15:21:05.391856] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:05.207 [2024-11-28 15:21:05.391873] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.391881] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.391888] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.207 [2024-11-28 15:21:05.391898] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.207 [2024-11-28 15:21:05.391918] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.207 [2024-11-28 15:21:05.391997] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.207 [2024-11-28 15:21:05.392011] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.207 [2024-11-28 15:21:05.392017] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392023] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.207 [2024-11-28 15:21:05.392032] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:05.207 [2024-11-28 15:21:05.392040] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:05.207 [2024-11-28 15:21:05.392053] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:05.207 [2024-11-28 15:21:05.392162] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:05.207 [2024-11-28 15:21:05.392174] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:05.207 [2024-11-28 15:21:05.392187] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392194] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.207 [2024-11-28 15:21:05.392210] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.207 [2024-11-28 15:21:05.392232] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.207 [2024-11-28 15:21:05.392362] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.207 [2024-11-28 15:21:05.392375] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.207 [2024-11-28 15:21:05.392382] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392388] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.207 [2024-11-28 15:21:05.392397] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:05.207 [2024-11-28 15:21:05.392414] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392422] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392428] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.207 [2024-11-28 15:21:05.392438] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.207 [2024-11-28 15:21:05.392459] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.207 [2024-11-28 15:21:05.392564] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.207 [2024-11-28 15:21:05.392578] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.207 [2024-11-28 15:21:05.392584] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392591] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.207 [2024-11-28 15:21:05.392599] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:05.207 [2024-11-28 15:21:05.392607] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:05.207 [2024-11-28 15:21:05.392620] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:05.207 [2024-11-28 15:21:05.392633] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:05.207 [2024-11-28 15:21:05.392646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392653] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392659] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.207 [2024-11-28 15:21:05.392669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.207 [2024-11-28 15:21:05.392690] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.207 [2024-11-28 15:21:05.392813] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.207 [2024-11-28 15:21:05.392828] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.207 [2024-11-28 15:21:05.392835] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392841] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=4096, cccid=0 00:26:05.207 [2024-11-28 15:21:05.392852] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d7ec0) on tqpair(0x137f2f0): expected_datao=0, payload_size=4096 00:26:05.207 [2024-11-28 15:21:05.392871] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.207 [2024-11-28 15:21:05.392880] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434185] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.471 [2024-11-28 15:21:05.434204] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.471 [2024-11-28 15:21:05.434211] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434218] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.471 [2024-11-28 15:21:05.434230] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:05.471 [2024-11-28 15:21:05.434239] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:05.471 [2024-11-28 15:21:05.434246] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:05.471 [2024-11-28 15:21:05.434253] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:05.471 [2024-11-28 15:21:05.434260] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:05.471 [2024-11-28 15:21:05.434268] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:05.471 [2024-11-28 15:21:05.434287] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:05.471 [2024-11-28 15:21:05.434300] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434308] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434314] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.471 [2024-11-28 15:21:05.434325] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:05.471 [2024-11-28 15:21:05.434348] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.471 [2024-11-28 15:21:05.434430] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.471 [2024-11-28 15:21:05.434444] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.471 [2024-11-28 15:21:05.434450] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434457] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d7ec0) on tqpair=0x137f2f0 00:26:05.471 [2024-11-28 15:21:05.434468] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434475] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434481] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x137f2f0) 00:26:05.471 [2024-11-28 15:21:05.434491] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.471 [2024-11-28 15:21:05.434501] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434513] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x137f2f0) 00:26:05.471 [2024-11-28 15:21:05.434522] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.471 [2024-11-28 15:21:05.434531] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434537] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434543] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x137f2f0) 00:26:05.471 [2024-11-28 15:21:05.434556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.471 [2024-11-28 15:21:05.434566] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.471 [2024-11-28 15:21:05.434587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.471 [2024-11-28 15:21:05.434595] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:05.471 [2024-11-28 15:21:05.434613] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:05.471 [2024-11-28 15:21:05.434625] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434632] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.471 [2024-11-28 15:21:05.434638] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.471 [2024-11-28 15:21:05.434649] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.471 [2024-11-28 15:21:05.434671] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d7ec0, cid 0, qid 0 00:26:05.471 [2024-11-28 15:21:05.434682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8020, cid 1, qid 0 00:26:05.471 [2024-11-28 15:21:05.434690] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8180, cid 2, qid 0 00:26:05.472 [2024-11-28 15:21:05.434697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.472 [2024-11-28 15:21:05.434704] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.472 [2024-11-28 15:21:05.434846] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.434860] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.434866] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.434873] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.472 [2024-11-28 15:21:05.434881] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:05.472 [2024-11-28 15:21:05.434890] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.434904] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.434920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.434932] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.434938] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.434945] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.472 [2024-11-28 15:21:05.434955] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:05.472 [2024-11-28 15:21:05.434976] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.472 [2024-11-28 15:21:05.435111] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.435124] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.435131] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435137] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.472 [2024-11-28 15:21:05.435207] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.435226] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.435240] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435247] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435253] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.472 [2024-11-28 15:21:05.435263] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.472 [2024-11-28 15:21:05.435284] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.472 [2024-11-28 15:21:05.435419] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.472 [2024-11-28 15:21:05.435434] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.472 [2024-11-28 15:21:05.435440] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435447] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=4096, cccid=4 00:26:05.472 [2024-11-28 15:21:05.435454] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d8440) on tqpair(0x137f2f0): expected_datao=0, payload_size=4096 00:26:05.472 [2024-11-28 15:21:05.435465] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435472] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435484] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.435493] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.435499] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435506] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.472 [2024-11-28 15:21:05.435534] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:05.472 [2024-11-28 15:21:05.435551] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.435568] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.435580] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435588] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435593] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.472 [2024-11-28 15:21:05.435604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.472 [2024-11-28 15:21:05.435625] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.472 [2024-11-28 15:21:05.435732] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.472 [2024-11-28 15:21:05.435747] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.472 [2024-11-28 15:21:05.435753] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435760] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=4096, cccid=4 00:26:05.472 [2024-11-28 15:21:05.435767] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d8440) on tqpair(0x137f2f0): expected_datao=0, payload_size=4096 00:26:05.472 [2024-11-28 15:21:05.435778] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435785] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435803] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.435817] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.435824] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435831] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.472 [2024-11-28 15:21:05.435856] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.435875] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.435888] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435895] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.435901] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.472 [2024-11-28 15:21:05.435912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.472 [2024-11-28 15:21:05.435933] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.472 [2024-11-28 15:21:05.436030] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.472 [2024-11-28 15:21:05.436044] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.472 [2024-11-28 15:21:05.436051] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436057] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=4096, cccid=4 00:26:05.472 [2024-11-28 15:21:05.436064] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d8440) on tqpair(0x137f2f0): expected_datao=0, payload_size=4096 00:26:05.472 [2024-11-28 15:21:05.436075] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436082] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436108] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.436120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.436127] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436133] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.472 [2024-11-28 15:21:05.436147] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.436161] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.436177] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.436189] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.436197] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.436206] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:05.472 [2024-11-28 15:21:05.436214] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:05.472 [2024-11-28 15:21:05.436222] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:05.472 [2024-11-28 15:21:05.436240] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436248] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436254] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.472 [2024-11-28 15:21:05.436268] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.472 [2024-11-28 15:21:05.436279] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436287] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436293] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x137f2f0) 00:26:05.472 [2024-11-28 15:21:05.436301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:05.472 [2024-11-28 15:21:05.436340] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.472 [2024-11-28 15:21:05.436353] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d85a0, cid 5, qid 0 00:26:05.472 [2024-11-28 15:21:05.436527] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.436539] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.436545] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.472 [2024-11-28 15:21:05.436552] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.472 [2024-11-28 15:21:05.436563] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.472 [2024-11-28 15:21:05.436571] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.472 [2024-11-28 15:21:05.436578] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436584] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d85a0) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.436599] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436607] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436613] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.436623] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.436644] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d85a0, cid 5, qid 0 00:26:05.473 [2024-11-28 15:21:05.436733] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.436746] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.436753] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436759] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d85a0) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.436775] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436784] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436790] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.436800] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.436820] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d85a0, cid 5, qid 0 00:26:05.473 [2024-11-28 15:21:05.436895] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.436909] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.436916] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436922] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d85a0) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.436939] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436947] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.436953] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.436967] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.436988] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d85a0, cid 5, qid 0 00:26:05.473 [2024-11-28 15:21:05.437080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.441100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.441114] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441121] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d85a0) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.441143] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441153] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441159] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.441169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.441181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441188] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441194] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.441203] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.441214] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441221] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441227] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.441236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.441247] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441254] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441260] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x137f2f0) 00:26:05.473 [2024-11-28 15:21:05.441269] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.473 [2024-11-28 15:21:05.441292] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d85a0, cid 5, qid 0 00:26:05.473 [2024-11-28 15:21:05.441303] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8440, cid 4, qid 0 00:26:05.473 [2024-11-28 15:21:05.441311] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8700, cid 6, qid 0 00:26:05.473 [2024-11-28 15:21:05.441318] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8860, cid 7, qid 0 00:26:05.473 [2024-11-28 15:21:05.441490] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.473 [2024-11-28 15:21:05.441505] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.473 [2024-11-28 15:21:05.441512] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441518] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=8192, cccid=5 00:26:05.473 [2024-11-28 15:21:05.441525] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d85a0) on tqpair(0x137f2f0): expected_datao=0, payload_size=8192 00:26:05.473 [2024-11-28 15:21:05.441565] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441575] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441583] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.473 [2024-11-28 15:21:05.441596] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.473 [2024-11-28 15:21:05.441603] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441609] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=512, cccid=4 00:26:05.473 [2024-11-28 15:21:05.441616] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d8440) on tqpair(0x137f2f0): expected_datao=0, payload_size=512 00:26:05.473 [2024-11-28 15:21:05.441626] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441633] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.473 [2024-11-28 15:21:05.441649] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.473 [2024-11-28 15:21:05.441655] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441661] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=512, cccid=6 00:26:05.473 [2024-11-28 15:21:05.441668] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d8700) on tqpair(0x137f2f0): expected_datao=0, payload_size=512 00:26:05.473 [2024-11-28 15:21:05.441678] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441685] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441693] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:05.473 [2024-11-28 15:21:05.441701] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:05.473 [2024-11-28 15:21:05.441707] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441713] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x137f2f0): datao=0, datal=4096, cccid=7 00:26:05.473 [2024-11-28 15:21:05.441721] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x13d8860) on tqpair(0x137f2f0): expected_datao=0, payload_size=4096 00:26:05.473 [2024-11-28 15:21:05.441731] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441738] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441749] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.441758] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.441764] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441770] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d85a0) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.441790] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.441802] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.441808] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441814] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8440) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.441829] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.441839] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.441845] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441851] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8700) on tqpair=0x137f2f0 00:26:05.473 [2024-11-28 15:21:05.441863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.473 [2024-11-28 15:21:05.441886] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.473 [2024-11-28 15:21:05.441893] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.473 [2024-11-28 15:21:05.441899] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8860) on tqpair=0x137f2f0 00:26:05.473 ===================================================== 00:26:05.473 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:05.473 ===================================================== 00:26:05.473 Controller Capabilities/Features 00:26:05.473 ================================ 00:26:05.473 Vendor ID: 8086 00:26:05.473 Subsystem Vendor ID: 8086 00:26:05.473 Serial Number: SPDK00000000000001 00:26:05.473 Model Number: SPDK bdev Controller 00:26:05.473 Firmware Version: 24.01.1 00:26:05.473 Recommended Arb Burst: 6 00:26:05.473 IEEE OUI Identifier: e4 d2 5c 00:26:05.473 Multi-path I/O 00:26:05.473 May have multiple subsystem ports: Yes 00:26:05.473 May have multiple controllers: Yes 00:26:05.473 Associated with SR-IOV VF: No 00:26:05.473 Max Data Transfer Size: 131072 00:26:05.473 Max Number of Namespaces: 32 00:26:05.473 Max Number of I/O Queues: 127 00:26:05.474 NVMe Specification Version (VS): 1.3 00:26:05.474 NVMe Specification Version (Identify): 1.3 00:26:05.474 Maximum Queue Entries: 128 00:26:05.474 Contiguous Queues Required: Yes 00:26:05.474 Arbitration Mechanisms Supported 00:26:05.474 Weighted Round Robin: Not Supported 00:26:05.474 Vendor Specific: Not Supported 00:26:05.474 Reset Timeout: 15000 ms 00:26:05.474 Doorbell Stride: 4 bytes 00:26:05.474 NVM Subsystem Reset: Not Supported 00:26:05.474 Command Sets Supported 00:26:05.474 NVM Command Set: Supported 00:26:05.474 Boot Partition: Not Supported 00:26:05.474 Memory Page Size Minimum: 4096 bytes 00:26:05.474 Memory Page Size Maximum: 4096 bytes 00:26:05.474 Persistent Memory Region: Not Supported 00:26:05.474 Optional Asynchronous Events Supported 00:26:05.474 Namespace Attribute Notices: Supported 00:26:05.474 Firmware Activation Notices: Not Supported 00:26:05.474 ANA Change Notices: Not Supported 00:26:05.474 PLE Aggregate Log Change Notices: Not Supported 00:26:05.474 LBA Status Info Alert Notices: Not Supported 00:26:05.474 EGE Aggregate Log Change Notices: Not Supported 00:26:05.474 Normal NVM Subsystem Shutdown event: Not Supported 00:26:05.474 Zone Descriptor Change Notices: Not Supported 00:26:05.474 Discovery Log Change Notices: Not Supported 00:26:05.474 Controller Attributes 00:26:05.474 128-bit Host Identifier: Supported 00:26:05.474 Non-Operational Permissive Mode: Not Supported 00:26:05.474 NVM Sets: Not Supported 00:26:05.474 Read Recovery Levels: Not Supported 00:26:05.474 Endurance Groups: Not Supported 00:26:05.474 Predictable Latency Mode: Not Supported 00:26:05.474 Traffic Based Keep ALive: Not Supported 00:26:05.474 Namespace Granularity: Not Supported 00:26:05.474 SQ Associations: Not Supported 00:26:05.474 UUID List: Not Supported 00:26:05.474 Multi-Domain Subsystem: Not Supported 00:26:05.474 Fixed Capacity Management: Not Supported 00:26:05.474 Variable Capacity Management: Not Supported 00:26:05.474 Delete Endurance Group: Not Supported 00:26:05.474 Delete NVM Set: Not Supported 00:26:05.474 Extended LBA Formats Supported: Not Supported 00:26:05.474 Flexible Data Placement Supported: Not Supported 00:26:05.474 00:26:05.474 Controller Memory Buffer Support 00:26:05.474 ================================ 00:26:05.474 Supported: No 00:26:05.474 00:26:05.474 Persistent Memory Region Support 00:26:05.474 ================================ 00:26:05.474 Supported: No 00:26:05.474 00:26:05.474 Admin Command Set Attributes 00:26:05.474 ============================ 00:26:05.474 Security Send/Receive: Not Supported 00:26:05.474 Format NVM: Not Supported 00:26:05.474 Firmware Activate/Download: Not Supported 00:26:05.474 Namespace Management: Not Supported 00:26:05.474 Device Self-Test: Not Supported 00:26:05.474 Directives: Not Supported 00:26:05.474 NVMe-MI: Not Supported 00:26:05.474 Virtualization Management: Not Supported 00:26:05.474 Doorbell Buffer Config: Not Supported 00:26:05.474 Get LBA Status Capability: Not Supported 00:26:05.474 Command & Feature Lockdown Capability: Not Supported 00:26:05.474 Abort Command Limit: 4 00:26:05.474 Async Event Request Limit: 4 00:26:05.474 Number of Firmware Slots: N/A 00:26:05.474 Firmware Slot 1 Read-Only: N/A 00:26:05.474 Firmware Activation Without Reset: N/A 00:26:05.474 Multiple Update Detection Support: N/A 00:26:05.474 Firmware Update Granularity: No Information Provided 00:26:05.474 Per-Namespace SMART Log: No 00:26:05.474 Asymmetric Namespace Access Log Page: Not Supported 00:26:05.474 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:05.474 Command Effects Log Page: Supported 00:26:05.474 Get Log Page Extended Data: Supported 00:26:05.474 Telemetry Log Pages: Not Supported 00:26:05.474 Persistent Event Log Pages: Not Supported 00:26:05.474 Supported Log Pages Log Page: May Support 00:26:05.474 Commands Supported & Effects Log Page: Not Supported 00:26:05.474 Feature Identifiers & Effects Log Page:May Support 00:26:05.474 NVMe-MI Commands & Effects Log Page: May Support 00:26:05.474 Data Area 4 for Telemetry Log: Not Supported 00:26:05.474 Error Log Page Entries Supported: 128 00:26:05.474 Keep Alive: Supported 00:26:05.474 Keep Alive Granularity: 10000 ms 00:26:05.474 00:26:05.474 NVM Command Set Attributes 00:26:05.474 ========================== 00:26:05.474 Submission Queue Entry Size 00:26:05.474 Max: 64 00:26:05.474 Min: 64 00:26:05.474 Completion Queue Entry Size 00:26:05.474 Max: 16 00:26:05.474 Min: 16 00:26:05.474 Number of Namespaces: 32 00:26:05.474 Compare Command: Supported 00:26:05.474 Write Uncorrectable Command: Not Supported 00:26:05.474 Dataset Management Command: Supported 00:26:05.474 Write Zeroes Command: Supported 00:26:05.474 Set Features Save Field: Not Supported 00:26:05.474 Reservations: Supported 00:26:05.474 Timestamp: Not Supported 00:26:05.474 Copy: Supported 00:26:05.474 Volatile Write Cache: Present 00:26:05.474 Atomic Write Unit (Normal): 1 00:26:05.474 Atomic Write Unit (PFail): 1 00:26:05.474 Atomic Compare & Write Unit: 1 00:26:05.474 Fused Compare & Write: Supported 00:26:05.474 Scatter-Gather List 00:26:05.474 SGL Command Set: Supported 00:26:05.474 SGL Keyed: Supported 00:26:05.474 SGL Bit Bucket Descriptor: Not Supported 00:26:05.474 SGL Metadata Pointer: Not Supported 00:26:05.474 Oversized SGL: Not Supported 00:26:05.474 SGL Metadata Address: Not Supported 00:26:05.474 SGL Offset: Supported 00:26:05.474 Transport SGL Data Block: Not Supported 00:26:05.474 Replay Protected Memory Block: Not Supported 00:26:05.474 00:26:05.474 Firmware Slot Information 00:26:05.474 ========================= 00:26:05.474 Active slot: 1 00:26:05.474 Slot 1 Firmware Revision: 24.01.1 00:26:05.474 00:26:05.474 00:26:05.474 Commands Supported and Effects 00:26:05.474 ============================== 00:26:05.474 Admin Commands 00:26:05.474 -------------- 00:26:05.474 Get Log Page (02h): Supported 00:26:05.474 Identify (06h): Supported 00:26:05.474 Abort (08h): Supported 00:26:05.474 Set Features (09h): Supported 00:26:05.474 Get Features (0Ah): Supported 00:26:05.474 Asynchronous Event Request (0Ch): Supported 00:26:05.474 Keep Alive (18h): Supported 00:26:05.474 I/O Commands 00:26:05.474 ------------ 00:26:05.474 Flush (00h): Supported LBA-Change 00:26:05.474 Write (01h): Supported LBA-Change 00:26:05.474 Read (02h): Supported 00:26:05.474 Compare (05h): Supported 00:26:05.474 Write Zeroes (08h): Supported LBA-Change 00:26:05.474 Dataset Management (09h): Supported LBA-Change 00:26:05.474 Copy (19h): Supported LBA-Change 00:26:05.474 Unknown (79h): Supported LBA-Change 00:26:05.474 Unknown (7Ah): Supported 00:26:05.474 00:26:05.474 Error Log 00:26:05.474 ========= 00:26:05.474 00:26:05.474 Arbitration 00:26:05.474 =========== 00:26:05.474 Arbitration Burst: 1 00:26:05.474 00:26:05.474 Power Management 00:26:05.474 ================ 00:26:05.474 Number of Power States: 1 00:26:05.474 Current Power State: Power State #0 00:26:05.474 Power State #0: 00:26:05.474 Max Power: 0.00 W 00:26:05.474 Non-Operational State: Operational 00:26:05.474 Entry Latency: Not Reported 00:26:05.474 Exit Latency: Not Reported 00:26:05.474 Relative Read Throughput: 0 00:26:05.474 Relative Read Latency: 0 00:26:05.474 Relative Write Throughput: 0 00:26:05.474 Relative Write Latency: 0 00:26:05.474 Idle Power: Not Reported 00:26:05.474 Active Power: Not Reported 00:26:05.474 Non-Operational Permissive Mode: Not Supported 00:26:05.474 00:26:05.474 Health Information 00:26:05.474 ================== 00:26:05.474 Critical Warnings: 00:26:05.474 Available Spare Space: OK 00:26:05.474 Temperature: OK 00:26:05.474 Device Reliability: OK 00:26:05.474 Read Only: No 00:26:05.474 Volatile Memory Backup: OK 00:26:05.474 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:05.474 Temperature Threshold: [2024-11-28 15:21:05.442015] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.474 [2024-11-28 15:21:05.442026] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.474 [2024-11-28 15:21:05.442035] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x137f2f0) 00:26:05.474 [2024-11-28 15:21:05.442045] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.474 [2024-11-28 15:21:05.442066] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d8860, cid 7, qid 0 00:26:05.474 [2024-11-28 15:21:05.442219] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.474 [2024-11-28 15:21:05.442234] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.474 [2024-11-28 15:21:05.442241] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.474 [2024-11-28 15:21:05.442247] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d8860) on tqpair=0x137f2f0 00:26:05.474 [2024-11-28 15:21:05.442288] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:05.474 [2024-11-28 15:21:05.442309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.474 [2024-11-28 15:21:05.442321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.475 [2024-11-28 15:21:05.442330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.475 [2024-11-28 15:21:05.442339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:05.475 [2024-11-28 15:21:05.442352] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442359] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442365] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.442376] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.442397] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.442526] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.442540] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.442547] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442553] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.442565] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.442589] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.442614] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.442729] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.442740] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.442746] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442753] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.442761] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:05.475 [2024-11-28 15:21:05.442769] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:05.475 [2024-11-28 15:21:05.442784] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442792] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442802] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.442813] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.442833] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.442912] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.442925] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.442932] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442938] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.442955] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442964] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.442970] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.442980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.443000] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.443080] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.443100] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.443108] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443115] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.443132] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443141] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443147] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.443157] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.443178] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.443280] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.443292] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.443298] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443305] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.443321] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443329] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443335] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.443345] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.443365] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.443439] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.443451] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.443457] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443463] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.443480] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443488] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443494] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.443508] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.443529] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.443609] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.443623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.443630] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443636] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.443653] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443661] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443667] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.443677] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.443697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.443804] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.443816] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.443822] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443828] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.443845] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443853] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443859] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.443869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.443889] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.443967] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.443980] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.443987] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.443993] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.444010] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444018] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444024] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.444035] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.444054] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.444168] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.444181] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.444188] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444194] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.444211] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444219] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.475 [2024-11-28 15:21:05.444236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.475 [2024-11-28 15:21:05.444260] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.475 [2024-11-28 15:21:05.444340] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.475 [2024-11-28 15:21:05.444353] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.475 [2024-11-28 15:21:05.444360] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444366] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.475 [2024-11-28 15:21:05.444382] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.475 [2024-11-28 15:21:05.444391] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444397] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.476 [2024-11-28 15:21:05.444407] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.476 [2024-11-28 15:21:05.444427] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.476 [2024-11-28 15:21:05.444505] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.476 [2024-11-28 15:21:05.444518] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.476 [2024-11-28 15:21:05.444525] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444531] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.476 [2024-11-28 15:21:05.444548] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444556] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444562] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.476 [2024-11-28 15:21:05.444572] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.476 [2024-11-28 15:21:05.444592] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.476 [2024-11-28 15:21:05.444715] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.476 [2024-11-28 15:21:05.444727] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.476 [2024-11-28 15:21:05.444734] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444740] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.476 [2024-11-28 15:21:05.444756] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444764] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444770] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.476 [2024-11-28 15:21:05.444780] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.476 [2024-11-28 15:21:05.444800] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.476 [2024-11-28 15:21:05.444878] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.476 [2024-11-28 15:21:05.444891] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.476 [2024-11-28 15:21:05.444897] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444903] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.476 [2024-11-28 15:21:05.444920] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444929] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.444935] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.476 [2024-11-28 15:21:05.444945] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.476 [2024-11-28 15:21:05.444969] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.476 [2024-11-28 15:21:05.445051] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.476 [2024-11-28 15:21:05.445064] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.476 [2024-11-28 15:21:05.445071] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.445077] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.476 [2024-11-28 15:21:05.449102] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.449117] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.449123] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x137f2f0) 00:26:05.476 [2024-11-28 15:21:05.449134] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:05.476 [2024-11-28 15:21:05.449156] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x13d82e0, cid 3, qid 0 00:26:05.476 [2024-11-28 15:21:05.449299] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:05.476 [2024-11-28 15:21:05.449311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:05.476 [2024-11-28 15:21:05.449318] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:05.476 [2024-11-28 15:21:05.449324] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x13d82e0) on tqpair=0x137f2f0 00:26:05.476 [2024-11-28 15:21:05.449338] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 6 milliseconds 00:26:05.476 0 Kelvin (-273 Celsius) 00:26:05.476 Available Spare: 0% 00:26:05.476 Available Spare Threshold: 0% 00:26:05.476 Life Percentage Used: 0% 00:26:05.476 Data Units Read: 0 00:26:05.476 Data Units Written: 0 00:26:05.476 Host Read Commands: 0 00:26:05.476 Host Write Commands: 0 00:26:05.476 Controller Busy Time: 0 minutes 00:26:05.476 Power Cycles: 0 00:26:05.476 Power On Hours: 0 hours 00:26:05.476 Unsafe Shutdowns: 0 00:26:05.476 Unrecoverable Media Errors: 0 00:26:05.476 Lifetime Error Log Entries: 0 00:26:05.476 Warning Temperature Time: 0 minutes 00:26:05.476 Critical Temperature Time: 0 minutes 00:26:05.476 00:26:05.476 Number of Queues 00:26:05.476 ================ 00:26:05.476 Number of I/O Submission Queues: 127 00:26:05.476 Number of I/O Completion Queues: 127 00:26:05.476 00:26:05.476 Active Namespaces 00:26:05.476 ================= 00:26:05.476 Namespace ID:1 00:26:05.476 Error Recovery Timeout: Unlimited 00:26:05.476 Command Set Identifier: NVM (00h) 00:26:05.476 Deallocate: Supported 00:26:05.476 Deallocated/Unwritten Error: Not Supported 00:26:05.476 Deallocated Read Value: Unknown 00:26:05.476 Deallocate in Write Zeroes: Not Supported 00:26:05.476 Deallocated Guard Field: 0xFFFF 00:26:05.476 Flush: Supported 00:26:05.476 Reservation: Supported 00:26:05.476 Namespace Sharing Capabilities: Multiple Controllers 00:26:05.476 Size (in LBAs): 131072 (0GiB) 00:26:05.476 Capacity (in LBAs): 131072 (0GiB) 00:26:05.476 Utilization (in LBAs): 131072 (0GiB) 00:26:05.476 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:05.476 EUI64: ABCDEF0123456789 00:26:05.476 UUID: fd574fc9-41cc-4a6b-be26-277728f4ffde 00:26:05.476 Thin Provisioning: Not Supported 00:26:05.476 Per-NS Atomic Units: Yes 00:26:05.476 Atomic Boundary Size (Normal): 0 00:26:05.476 Atomic Boundary Size (PFail): 0 00:26:05.476 Atomic Boundary Offset: 0 00:26:05.476 Maximum Single Source Range Length: 65535 00:26:05.476 Maximum Copy Length: 65535 00:26:05.476 Maximum Source Range Count: 1 00:26:05.476 NGUID/EUI64 Never Reused: No 00:26:05.476 Namespace Write Protected: No 00:26:05.476 Number of LBA Formats: 1 00:26:05.476 Current LBA Format: LBA Format #00 00:26:05.476 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:05.476 00:26:05.476 15:21:05 -- host/identify.sh@51 -- # sync 00:26:05.476 15:21:05 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:05.476 15:21:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:05.476 15:21:05 -- common/autotest_common.sh@10 -- # set +x 00:26:05.476 15:21:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:05.476 15:21:05 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:05.476 15:21:05 -- host/identify.sh@56 -- # nvmftestfini 00:26:05.476 15:21:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:05.476 15:21:05 -- nvmf/common.sh@116 -- # sync 00:26:05.476 15:21:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:05.476 15:21:05 -- nvmf/common.sh@119 -- # set +e 00:26:05.476 15:21:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:05.476 15:21:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:05.476 rmmod nvme_tcp 00:26:05.476 rmmod nvme_fabrics 00:26:05.476 rmmod nvme_keyring 00:26:05.476 15:21:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:05.476 15:21:05 -- nvmf/common.sh@123 -- # set -e 00:26:05.476 15:21:05 -- nvmf/common.sh@124 -- # return 0 00:26:05.476 15:21:05 -- nvmf/common.sh@477 -- # '[' -n 795910 ']' 00:26:05.476 15:21:05 -- nvmf/common.sh@478 -- # killprocess 795910 00:26:05.476 15:21:05 -- common/autotest_common.sh@936 -- # '[' -z 795910 ']' 00:26:05.476 15:21:05 -- common/autotest_common.sh@940 -- # kill -0 795910 00:26:05.476 15:21:05 -- common/autotest_common.sh@941 -- # uname 00:26:05.476 15:21:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:05.477 15:21:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 795910 00:26:05.477 15:21:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:05.477 15:21:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:05.477 15:21:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 795910' 00:26:05.477 killing process with pid 795910 00:26:05.477 15:21:05 -- common/autotest_common.sh@955 -- # kill 795910 00:26:05.477 [2024-11-28 15:21:05.582479] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:05.477 15:21:05 -- common/autotest_common.sh@960 -- # wait 795910 00:26:05.737 15:21:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:05.737 15:21:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:05.737 15:21:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:05.737 15:21:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:05.737 15:21:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:05.737 15:21:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:05.737 15:21:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:05.737 15:21:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:08.271 15:21:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:08.271 00:26:08.271 real 0m6.219s 00:26:08.271 user 0m7.499s 00:26:08.271 sys 0m1.928s 00:26:08.271 15:21:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:08.271 15:21:07 -- common/autotest_common.sh@10 -- # set +x 00:26:08.271 ************************************ 00:26:08.271 END TEST nvmf_identify 00:26:08.271 ************************************ 00:26:08.271 15:21:07 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:08.271 15:21:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:08.271 15:21:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:08.271 15:21:07 -- common/autotest_common.sh@10 -- # set +x 00:26:08.271 ************************************ 00:26:08.271 START TEST nvmf_perf 00:26:08.271 ************************************ 00:26:08.271 15:21:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:08.271 * Looking for test storage... 00:26:08.271 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:08.271 15:21:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:08.271 15:21:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:08.271 15:21:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:08.271 15:21:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:08.271 15:21:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:08.271 15:21:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:08.271 15:21:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:08.271 15:21:08 -- scripts/common.sh@335 -- # IFS=.-: 00:26:08.271 15:21:08 -- scripts/common.sh@335 -- # read -ra ver1 00:26:08.271 15:21:08 -- scripts/common.sh@336 -- # IFS=.-: 00:26:08.271 15:21:08 -- scripts/common.sh@336 -- # read -ra ver2 00:26:08.271 15:21:08 -- scripts/common.sh@337 -- # local 'op=<' 00:26:08.271 15:21:08 -- scripts/common.sh@339 -- # ver1_l=2 00:26:08.271 15:21:08 -- scripts/common.sh@340 -- # ver2_l=1 00:26:08.271 15:21:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:08.271 15:21:08 -- scripts/common.sh@343 -- # case "$op" in 00:26:08.271 15:21:08 -- scripts/common.sh@344 -- # : 1 00:26:08.271 15:21:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:08.271 15:21:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:08.271 15:21:08 -- scripts/common.sh@364 -- # decimal 1 00:26:08.271 15:21:08 -- scripts/common.sh@352 -- # local d=1 00:26:08.271 15:21:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:08.271 15:21:08 -- scripts/common.sh@354 -- # echo 1 00:26:08.271 15:21:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:08.271 15:21:08 -- scripts/common.sh@365 -- # decimal 2 00:26:08.271 15:21:08 -- scripts/common.sh@352 -- # local d=2 00:26:08.271 15:21:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:08.271 15:21:08 -- scripts/common.sh@354 -- # echo 2 00:26:08.271 15:21:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:08.271 15:21:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:08.271 15:21:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:08.271 15:21:08 -- scripts/common.sh@367 -- # return 0 00:26:08.271 15:21:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:08.271 15:21:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:08.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:08.271 --rc genhtml_branch_coverage=1 00:26:08.271 --rc genhtml_function_coverage=1 00:26:08.271 --rc genhtml_legend=1 00:26:08.271 --rc geninfo_all_blocks=1 00:26:08.271 --rc geninfo_unexecuted_blocks=1 00:26:08.271 00:26:08.271 ' 00:26:08.271 15:21:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:08.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:08.271 --rc genhtml_branch_coverage=1 00:26:08.271 --rc genhtml_function_coverage=1 00:26:08.271 --rc genhtml_legend=1 00:26:08.271 --rc geninfo_all_blocks=1 00:26:08.271 --rc geninfo_unexecuted_blocks=1 00:26:08.271 00:26:08.271 ' 00:26:08.271 15:21:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:08.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:08.271 --rc genhtml_branch_coverage=1 00:26:08.271 --rc genhtml_function_coverage=1 00:26:08.271 --rc genhtml_legend=1 00:26:08.271 --rc geninfo_all_blocks=1 00:26:08.271 --rc geninfo_unexecuted_blocks=1 00:26:08.271 00:26:08.271 ' 00:26:08.271 15:21:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:08.271 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:08.271 --rc genhtml_branch_coverage=1 00:26:08.271 --rc genhtml_function_coverage=1 00:26:08.271 --rc genhtml_legend=1 00:26:08.271 --rc geninfo_all_blocks=1 00:26:08.271 --rc geninfo_unexecuted_blocks=1 00:26:08.271 00:26:08.271 ' 00:26:08.271 15:21:08 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:08.271 15:21:08 -- nvmf/common.sh@7 -- # uname -s 00:26:08.271 15:21:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:08.271 15:21:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:08.271 15:21:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:08.271 15:21:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:08.271 15:21:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:08.271 15:21:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:08.271 15:21:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:08.271 15:21:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:08.271 15:21:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:08.271 15:21:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:08.271 15:21:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:08.271 15:21:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:08.271 15:21:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:08.271 15:21:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:08.271 15:21:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:08.272 15:21:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:08.272 15:21:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:08.272 15:21:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:08.272 15:21:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:08.272 15:21:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:08.272 15:21:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:08.272 15:21:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:08.272 15:21:08 -- paths/export.sh@5 -- # export PATH 00:26:08.272 15:21:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:08.272 15:21:08 -- nvmf/common.sh@46 -- # : 0 00:26:08.272 15:21:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:08.272 15:21:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:08.272 15:21:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:08.272 15:21:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:08.272 15:21:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:08.272 15:21:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:08.272 15:21:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:08.272 15:21:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:08.272 15:21:08 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:08.272 15:21:08 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:08.272 15:21:08 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:08.272 15:21:08 -- host/perf.sh@17 -- # nvmftestinit 00:26:08.272 15:21:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:08.272 15:21:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:08.272 15:21:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:08.272 15:21:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:08.272 15:21:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:08.272 15:21:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:08.272 15:21:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:08.272 15:21:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:08.272 15:21:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:08.272 15:21:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:08.272 15:21:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:08.272 15:21:08 -- common/autotest_common.sh@10 -- # set +x 00:26:10.177 15:21:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:10.177 15:21:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:10.177 15:21:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:10.177 15:21:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:10.177 15:21:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:10.177 15:21:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:10.177 15:21:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:10.177 15:21:09 -- nvmf/common.sh@294 -- # net_devs=() 00:26:10.177 15:21:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:10.177 15:21:09 -- nvmf/common.sh@295 -- # e810=() 00:26:10.177 15:21:09 -- nvmf/common.sh@295 -- # local -ga e810 00:26:10.177 15:21:09 -- nvmf/common.sh@296 -- # x722=() 00:26:10.177 15:21:09 -- nvmf/common.sh@296 -- # local -ga x722 00:26:10.177 15:21:09 -- nvmf/common.sh@297 -- # mlx=() 00:26:10.177 15:21:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:10.177 15:21:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:10.177 15:21:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:10.178 15:21:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:10.178 15:21:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:10.178 15:21:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:10.178 15:21:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:10.178 15:21:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:10.178 15:21:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:10.178 15:21:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:10.178 15:21:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:10.178 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:10.178 15:21:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:10.178 15:21:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:10.178 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:10.178 15:21:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:10.178 15:21:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:10.178 15:21:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:10.178 15:21:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:10.178 15:21:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:10.178 15:21:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:10.178 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:10.178 15:21:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:10.178 15:21:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:10.178 15:21:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:10.178 15:21:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:10.178 15:21:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:10.178 15:21:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:10.178 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:10.178 15:21:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:10.178 15:21:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:10.178 15:21:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:10.178 15:21:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:10.178 15:21:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:10.178 15:21:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:10.178 15:21:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:10.178 15:21:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:10.178 15:21:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:10.178 15:21:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:10.178 15:21:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:10.178 15:21:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:10.178 15:21:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:10.178 15:21:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:10.178 15:21:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:10.178 15:21:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:10.178 15:21:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:10.178 15:21:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:10.178 15:21:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:10.178 15:21:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:10.178 15:21:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:10.178 15:21:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:10.178 15:21:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:10.178 15:21:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:10.178 15:21:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:10.178 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:10.178 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.228 ms 00:26:10.178 00:26:10.178 --- 10.0.0.2 ping statistics --- 00:26:10.178 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:10.178 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:26:10.178 15:21:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:10.178 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:10.178 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:26:10.178 00:26:10.178 --- 10.0.0.1 ping statistics --- 00:26:10.178 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:10.178 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:26:10.178 15:21:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:10.178 15:21:10 -- nvmf/common.sh@410 -- # return 0 00:26:10.178 15:21:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:10.178 15:21:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:10.178 15:21:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:10.178 15:21:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:10.178 15:21:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:10.178 15:21:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:10.178 15:21:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:10.178 15:21:10 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:10.178 15:21:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:10.178 15:21:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:10.178 15:21:10 -- common/autotest_common.sh@10 -- # set +x 00:26:10.178 15:21:10 -- nvmf/common.sh@469 -- # nvmfpid=798554 00:26:10.178 15:21:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:10.178 15:21:10 -- nvmf/common.sh@470 -- # waitforlisten 798554 00:26:10.178 15:21:10 -- common/autotest_common.sh@829 -- # '[' -z 798554 ']' 00:26:10.178 15:21:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:10.178 15:21:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:10.178 15:21:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:10.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:10.178 15:21:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:10.178 15:21:10 -- common/autotest_common.sh@10 -- # set +x 00:26:10.178 [2024-11-28 15:21:10.205152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:26:10.178 [2024-11-28 15:21:10.205241] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:10.178 EAL: No free 2048 kB hugepages reported on node 1 00:26:10.178 [2024-11-28 15:21:10.277998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:10.178 [2024-11-28 15:21:10.369904] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:10.178 [2024-11-28 15:21:10.370065] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:10.178 [2024-11-28 15:21:10.370102] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:10.178 [2024-11-28 15:21:10.370121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:10.178 [2024-11-28 15:21:10.370177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:10.178 [2024-11-28 15:21:10.370232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:10.178 [2024-11-28 15:21:10.370269] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:10.178 [2024-11-28 15:21:10.370274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:11.116 15:21:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:11.116 15:21:11 -- common/autotest_common.sh@862 -- # return 0 00:26:11.116 15:21:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:11.116 15:21:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:11.116 15:21:11 -- common/autotest_common.sh@10 -- # set +x 00:26:11.116 15:21:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:11.116 15:21:11 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:11.116 15:21:11 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:14.428 15:21:14 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:14.428 15:21:14 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:14.428 15:21:14 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:14.428 15:21:14 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:14.686 15:21:14 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:14.686 15:21:14 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:14.686 15:21:14 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:14.686 15:21:14 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:14.686 15:21:14 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:14.943 [2024-11-28 15:21:15.088736] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:14.943 15:21:15 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:15.201 15:21:15 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:15.201 15:21:15 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:15.459 15:21:15 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:15.459 15:21:15 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:15.746 15:21:15 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:16.057 [2024-11-28 15:21:16.156701] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:16.057 15:21:16 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:16.317 15:21:16 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:16.317 15:21:16 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:16.317 15:21:16 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:16.317 15:21:16 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:17.694 Initializing NVMe Controllers 00:26:17.694 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:17.694 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:17.694 Initialization complete. Launching workers. 00:26:17.694 ======================================================== 00:26:17.694 Latency(us) 00:26:17.694 Device Information : IOPS MiB/s Average min max 00:26:17.694 PCIE (0000:88:00.0) NSID 1 from core 0: 85870.32 335.43 372.28 21.22 7256.31 00:26:17.694 ======================================================== 00:26:17.694 Total : 85870.32 335.43 372.28 21.22 7256.31 00:26:17.694 00:26:17.694 15:21:17 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:17.694 EAL: No free 2048 kB hugepages reported on node 1 00:26:19.074 Initializing NVMe Controllers 00:26:19.074 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:19.074 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:19.074 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:19.074 Initialization complete. Launching workers. 00:26:19.074 ======================================================== 00:26:19.074 Latency(us) 00:26:19.074 Device Information : IOPS MiB/s Average min max 00:26:19.074 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 85.95 0.34 12029.18 136.19 45796.06 00:26:19.074 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 60.97 0.24 16532.06 7937.22 50887.59 00:26:19.074 ======================================================== 00:26:19.074 Total : 146.92 0.57 13897.72 136.19 50887.59 00:26:19.074 00:26:19.074 15:21:18 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:19.074 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.453 Initializing NVMe Controllers 00:26:20.453 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:20.453 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:20.453 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:20.453 Initialization complete. Launching workers. 00:26:20.453 ======================================================== 00:26:20.453 Latency(us) 00:26:20.453 Device Information : IOPS MiB/s Average min max 00:26:20.453 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8669.98 33.87 3702.59 542.79 7513.73 00:26:20.453 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3905.99 15.26 8229.63 6599.96 15948.78 00:26:20.453 ======================================================== 00:26:20.453 Total : 12575.97 49.12 5108.65 542.79 15948.78 00:26:20.453 00:26:20.453 15:21:20 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:20.453 15:21:20 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:20.453 15:21:20 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:20.453 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.983 Initializing NVMe Controllers 00:26:22.983 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:22.983 Controller IO queue size 128, less than required. 00:26:22.983 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:22.983 Controller IO queue size 128, less than required. 00:26:22.983 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:22.983 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:22.983 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:22.983 Initialization complete. Launching workers. 00:26:22.983 ======================================================== 00:26:22.983 Latency(us) 00:26:22.983 Device Information : IOPS MiB/s Average min max 00:26:22.983 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1739.98 434.99 74459.58 46500.69 109626.21 00:26:22.983 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 568.99 142.25 234673.94 113247.38 364572.09 00:26:22.983 ======================================================== 00:26:22.983 Total : 2308.97 577.24 113940.73 46500.69 364572.09 00:26:22.983 00:26:22.983 15:21:22 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:22.983 EAL: No free 2048 kB hugepages reported on node 1 00:26:22.984 No valid NVMe controllers or AIO or URING devices found 00:26:22.984 Initializing NVMe Controllers 00:26:22.984 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:22.984 Controller IO queue size 128, less than required. 00:26:22.984 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:22.984 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:22.984 Controller IO queue size 128, less than required. 00:26:22.984 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:22.984 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:22.984 WARNING: Some requested NVMe devices were skipped 00:26:22.984 15:21:22 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:22.984 EAL: No free 2048 kB hugepages reported on node 1 00:26:25.516 Initializing NVMe Controllers 00:26:25.516 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:25.516 Controller IO queue size 128, less than required. 00:26:25.516 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:25.516 Controller IO queue size 128, less than required. 00:26:25.516 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:25.516 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:25.516 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:25.516 Initialization complete. Launching workers. 00:26:25.516 00:26:25.516 ==================== 00:26:25.516 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:25.516 TCP transport: 00:26:25.516 polls: 9087 00:26:25.516 idle_polls: 5746 00:26:25.517 sock_completions: 3341 00:26:25.517 nvme_completions: 5840 00:26:25.517 submitted_requests: 8959 00:26:25.517 queued_requests: 1 00:26:25.517 00:26:25.517 ==================== 00:26:25.517 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:25.517 TCP transport: 00:26:25.517 polls: 9434 00:26:25.517 idle_polls: 6318 00:26:25.517 sock_completions: 3116 00:26:25.517 nvme_completions: 5645 00:26:25.517 submitted_requests: 8666 00:26:25.517 queued_requests: 1 00:26:25.517 ======================================================== 00:26:25.517 Latency(us) 00:26:25.517 Device Information : IOPS MiB/s Average min max 00:26:25.517 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1523.38 380.84 85778.24 56039.04 134984.68 00:26:25.517 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1474.88 368.72 88591.50 42702.59 151201.35 00:26:25.517 ======================================================== 00:26:25.517 Total : 2998.26 749.56 87162.12 42702.59 151201.35 00:26:25.517 00:26:25.517 15:21:25 -- host/perf.sh@66 -- # sync 00:26:25.517 15:21:25 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:25.775 15:21:25 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:25.775 15:21:25 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:25.775 15:21:25 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:29.066 15:21:29 -- host/perf.sh@72 -- # ls_guid=796b3faf-6d0a-4521-b734-fab1dc6b8454 00:26:29.066 15:21:29 -- host/perf.sh@73 -- # get_lvs_free_mb 796b3faf-6d0a-4521-b734-fab1dc6b8454 00:26:29.066 15:21:29 -- common/autotest_common.sh@1353 -- # local lvs_uuid=796b3faf-6d0a-4521-b734-fab1dc6b8454 00:26:29.066 15:21:29 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:29.066 15:21:29 -- common/autotest_common.sh@1355 -- # local fc 00:26:29.066 15:21:29 -- common/autotest_common.sh@1356 -- # local cs 00:26:29.066 15:21:29 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:29.324 15:21:29 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:29.324 { 00:26:29.324 "uuid": "796b3faf-6d0a-4521-b734-fab1dc6b8454", 00:26:29.324 "name": "lvs_0", 00:26:29.324 "base_bdev": "Nvme0n1", 00:26:29.324 "total_data_clusters": 238234, 00:26:29.324 "free_clusters": 238234, 00:26:29.324 "block_size": 512, 00:26:29.324 "cluster_size": 4194304 00:26:29.324 } 00:26:29.324 ]' 00:26:29.324 15:21:29 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="796b3faf-6d0a-4521-b734-fab1dc6b8454") .free_clusters' 00:26:29.324 15:21:29 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:29.324 15:21:29 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="796b3faf-6d0a-4521-b734-fab1dc6b8454") .cluster_size' 00:26:29.324 15:21:29 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:29.324 15:21:29 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:29.324 15:21:29 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:29.324 952936 00:26:29.324 15:21:29 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:29.324 15:21:29 -- host/perf.sh@78 -- # free_mb=20480 00:26:29.324 15:21:29 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 796b3faf-6d0a-4521-b734-fab1dc6b8454 lbd_0 20480 00:26:29.890 15:21:29 -- host/perf.sh@80 -- # lb_guid=e7693176-23b3-4acc-900b-e9983a6e1eed 00:26:29.890 15:21:29 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore e7693176-23b3-4acc-900b-e9983a6e1eed lvs_n_0 00:26:30.826 15:21:30 -- host/perf.sh@83 -- # ls_nested_guid=bad8769d-d50e-4177-8ad2-fb288d4ea4c9 00:26:30.826 15:21:30 -- host/perf.sh@84 -- # get_lvs_free_mb bad8769d-d50e-4177-8ad2-fb288d4ea4c9 00:26:30.826 15:21:30 -- common/autotest_common.sh@1353 -- # local lvs_uuid=bad8769d-d50e-4177-8ad2-fb288d4ea4c9 00:26:30.826 15:21:30 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:30.826 15:21:30 -- common/autotest_common.sh@1355 -- # local fc 00:26:30.826 15:21:30 -- common/autotest_common.sh@1356 -- # local cs 00:26:30.826 15:21:30 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:31.085 15:21:31 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:31.085 { 00:26:31.085 "uuid": "796b3faf-6d0a-4521-b734-fab1dc6b8454", 00:26:31.085 "name": "lvs_0", 00:26:31.085 "base_bdev": "Nvme0n1", 00:26:31.085 "total_data_clusters": 238234, 00:26:31.085 "free_clusters": 233114, 00:26:31.085 "block_size": 512, 00:26:31.085 "cluster_size": 4194304 00:26:31.085 }, 00:26:31.085 { 00:26:31.085 "uuid": "bad8769d-d50e-4177-8ad2-fb288d4ea4c9", 00:26:31.085 "name": "lvs_n_0", 00:26:31.085 "base_bdev": "e7693176-23b3-4acc-900b-e9983a6e1eed", 00:26:31.085 "total_data_clusters": 5114, 00:26:31.085 "free_clusters": 5114, 00:26:31.085 "block_size": 512, 00:26:31.085 "cluster_size": 4194304 00:26:31.085 } 00:26:31.085 ]' 00:26:31.085 15:21:31 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="bad8769d-d50e-4177-8ad2-fb288d4ea4c9") .free_clusters' 00:26:31.085 15:21:31 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:31.085 15:21:31 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="bad8769d-d50e-4177-8ad2-fb288d4ea4c9") .cluster_size' 00:26:31.085 15:21:31 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:31.085 15:21:31 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:31.085 15:21:31 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:31.085 20456 00:26:31.085 15:21:31 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:31.085 15:21:31 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u bad8769d-d50e-4177-8ad2-fb288d4ea4c9 lbd_nest_0 20456 00:26:31.343 15:21:31 -- host/perf.sh@88 -- # lb_nested_guid=03023cee-b89e-4118-bd5c-331e91021f6b 00:26:31.343 15:21:31 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:31.600 15:21:31 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:31.600 15:21:31 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 03023cee-b89e-4118-bd5c-331e91021f6b 00:26:31.859 15:21:31 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:32.117 15:21:32 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:32.117 15:21:32 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:32.117 15:21:32 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:32.117 15:21:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:32.117 15:21:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:32.117 EAL: No free 2048 kB hugepages reported on node 1 00:26:44.331 Initializing NVMe Controllers 00:26:44.331 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:44.331 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:44.332 Initialization complete. Launching workers. 00:26:44.332 ======================================================== 00:26:44.332 Latency(us) 00:26:44.332 Device Information : IOPS MiB/s Average min max 00:26:44.332 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 50.59 0.02 19767.30 162.67 45277.42 00:26:44.332 ======================================================== 00:26:44.332 Total : 50.59 0.02 19767.30 162.67 45277.42 00:26:44.332 00:26:44.332 15:21:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:44.332 15:21:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:44.332 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.306 Initializing NVMe Controllers 00:26:54.306 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:54.306 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:54.306 Initialization complete. Launching workers. 00:26:54.306 ======================================================== 00:26:54.306 Latency(us) 00:26:54.306 Device Information : IOPS MiB/s Average min max 00:26:54.306 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 75.90 9.49 13195.06 4998.54 47900.96 00:26:54.306 ======================================================== 00:26:54.306 Total : 75.90 9.49 13195.06 4998.54 47900.96 00:26:54.306 00:26:54.306 15:21:52 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:54.306 15:21:52 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:54.306 15:21:52 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:54.306 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.289 Initializing NVMe Controllers 00:27:04.289 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:04.289 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:04.289 Initialization complete. Launching workers. 00:27:04.289 ======================================================== 00:27:04.289 Latency(us) 00:27:04.289 Device Information : IOPS MiB/s Average min max 00:27:04.289 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7879.43 3.85 4068.69 290.56 43036.33 00:27:04.289 ======================================================== 00:27:04.289 Total : 7879.43 3.85 4068.69 290.56 43036.33 00:27:04.289 00:27:04.289 15:22:03 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:04.289 15:22:03 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:04.289 EAL: No free 2048 kB hugepages reported on node 1 00:27:14.329 Initializing NVMe Controllers 00:27:14.329 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:14.329 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:14.329 Initialization complete. Launching workers. 00:27:14.329 ======================================================== 00:27:14.329 Latency(us) 00:27:14.329 Device Information : IOPS MiB/s Average min max 00:27:14.329 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4041.80 505.22 7920.08 570.38 17811.33 00:27:14.329 ======================================================== 00:27:14.329 Total : 4041.80 505.22 7920.08 570.38 17811.33 00:27:14.329 00:27:14.329 15:22:13 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:14.329 15:22:13 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:14.329 15:22:13 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:14.329 EAL: No free 2048 kB hugepages reported on node 1 00:27:24.342 Initializing NVMe Controllers 00:27:24.342 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:24.342 Controller IO queue size 128, less than required. 00:27:24.342 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:24.342 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:24.342 Initialization complete. Launching workers. 00:27:24.342 ======================================================== 00:27:24.342 Latency(us) 00:27:24.342 Device Information : IOPS MiB/s Average min max 00:27:24.342 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12111.80 5.91 10574.73 1810.92 24167.66 00:27:24.342 ======================================================== 00:27:24.342 Total : 12111.80 5.91 10574.73 1810.92 24167.66 00:27:24.342 00:27:24.342 15:22:24 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:24.342 15:22:24 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:24.342 EAL: No free 2048 kB hugepages reported on node 1 00:27:34.320 Initializing NVMe Controllers 00:27:34.320 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:34.320 Controller IO queue size 128, less than required. 00:27:34.320 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:34.320 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:34.320 Initialization complete. Launching workers. 00:27:34.320 ======================================================== 00:27:34.320 Latency(us) 00:27:34.320 Device Information : IOPS MiB/s Average min max 00:27:34.320 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1197.40 149.67 107605.19 16021.89 207525.87 00:27:34.320 ======================================================== 00:27:34.320 Total : 1197.40 149.67 107605.19 16021.89 207525.87 00:27:34.320 00:27:34.320 15:22:34 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:34.579 15:22:34 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 03023cee-b89e-4118-bd5c-331e91021f6b 00:27:35.515 15:22:35 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:35.515 15:22:35 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete e7693176-23b3-4acc-900b-e9983a6e1eed 00:27:36.082 15:22:36 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:36.082 15:22:36 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:36.082 15:22:36 -- host/perf.sh@114 -- # nvmftestfini 00:27:36.082 15:22:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:36.082 15:22:36 -- nvmf/common.sh@116 -- # sync 00:27:36.082 15:22:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:36.082 15:22:36 -- nvmf/common.sh@119 -- # set +e 00:27:36.082 15:22:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:36.082 15:22:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:36.082 rmmod nvme_tcp 00:27:36.082 rmmod nvme_fabrics 00:27:36.342 rmmod nvme_keyring 00:27:36.342 15:22:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:36.342 15:22:36 -- nvmf/common.sh@123 -- # set -e 00:27:36.342 15:22:36 -- nvmf/common.sh@124 -- # return 0 00:27:36.342 15:22:36 -- nvmf/common.sh@477 -- # '[' -n 798554 ']' 00:27:36.342 15:22:36 -- nvmf/common.sh@478 -- # killprocess 798554 00:27:36.342 15:22:36 -- common/autotest_common.sh@936 -- # '[' -z 798554 ']' 00:27:36.342 15:22:36 -- common/autotest_common.sh@940 -- # kill -0 798554 00:27:36.342 15:22:36 -- common/autotest_common.sh@941 -- # uname 00:27:36.342 15:22:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:36.342 15:22:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 798554 00:27:36.342 15:22:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:36.342 15:22:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:36.342 15:22:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 798554' 00:27:36.342 killing process with pid 798554 00:27:36.342 15:22:36 -- common/autotest_common.sh@955 -- # kill 798554 00:27:36.342 15:22:36 -- common/autotest_common.sh@960 -- # wait 798554 00:27:38.248 15:22:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:38.248 15:22:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:38.248 15:22:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:38.248 15:22:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:38.248 15:22:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:38.248 15:22:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:38.248 15:22:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:38.248 15:22:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:40.152 15:22:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:40.152 00:27:40.152 real 1m32.108s 00:27:40.152 user 5m41.286s 00:27:40.152 sys 0m15.502s 00:27:40.152 15:22:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:40.152 15:22:40 -- common/autotest_common.sh@10 -- # set +x 00:27:40.152 ************************************ 00:27:40.152 END TEST nvmf_perf 00:27:40.152 ************************************ 00:27:40.152 15:22:40 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:40.152 15:22:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:40.152 15:22:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:40.152 15:22:40 -- common/autotest_common.sh@10 -- # set +x 00:27:40.152 ************************************ 00:27:40.152 START TEST nvmf_fio_host 00:27:40.152 ************************************ 00:27:40.152 15:22:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:40.152 * Looking for test storage... 00:27:40.152 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:40.152 15:22:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:40.152 15:22:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:40.152 15:22:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:40.152 15:22:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:40.152 15:22:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:40.152 15:22:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:40.152 15:22:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:40.152 15:22:40 -- scripts/common.sh@335 -- # IFS=.-: 00:27:40.152 15:22:40 -- scripts/common.sh@335 -- # read -ra ver1 00:27:40.152 15:22:40 -- scripts/common.sh@336 -- # IFS=.-: 00:27:40.152 15:22:40 -- scripts/common.sh@336 -- # read -ra ver2 00:27:40.152 15:22:40 -- scripts/common.sh@337 -- # local 'op=<' 00:27:40.152 15:22:40 -- scripts/common.sh@339 -- # ver1_l=2 00:27:40.152 15:22:40 -- scripts/common.sh@340 -- # ver2_l=1 00:27:40.152 15:22:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:40.152 15:22:40 -- scripts/common.sh@343 -- # case "$op" in 00:27:40.152 15:22:40 -- scripts/common.sh@344 -- # : 1 00:27:40.152 15:22:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:40.152 15:22:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:40.152 15:22:40 -- scripts/common.sh@364 -- # decimal 1 00:27:40.152 15:22:40 -- scripts/common.sh@352 -- # local d=1 00:27:40.152 15:22:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:40.152 15:22:40 -- scripts/common.sh@354 -- # echo 1 00:27:40.152 15:22:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:40.152 15:22:40 -- scripts/common.sh@365 -- # decimal 2 00:27:40.152 15:22:40 -- scripts/common.sh@352 -- # local d=2 00:27:40.152 15:22:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:40.152 15:22:40 -- scripts/common.sh@354 -- # echo 2 00:27:40.152 15:22:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:40.152 15:22:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:40.152 15:22:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:40.152 15:22:40 -- scripts/common.sh@367 -- # return 0 00:27:40.152 15:22:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:40.152 15:22:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:40.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.152 --rc genhtml_branch_coverage=1 00:27:40.152 --rc genhtml_function_coverage=1 00:27:40.152 --rc genhtml_legend=1 00:27:40.152 --rc geninfo_all_blocks=1 00:27:40.152 --rc geninfo_unexecuted_blocks=1 00:27:40.152 00:27:40.152 ' 00:27:40.152 15:22:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:40.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.152 --rc genhtml_branch_coverage=1 00:27:40.152 --rc genhtml_function_coverage=1 00:27:40.152 --rc genhtml_legend=1 00:27:40.153 --rc geninfo_all_blocks=1 00:27:40.153 --rc geninfo_unexecuted_blocks=1 00:27:40.153 00:27:40.153 ' 00:27:40.153 15:22:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:40.153 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.153 --rc genhtml_branch_coverage=1 00:27:40.153 --rc genhtml_function_coverage=1 00:27:40.153 --rc genhtml_legend=1 00:27:40.153 --rc geninfo_all_blocks=1 00:27:40.153 --rc geninfo_unexecuted_blocks=1 00:27:40.153 00:27:40.153 ' 00:27:40.153 15:22:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:40.153 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:40.153 --rc genhtml_branch_coverage=1 00:27:40.153 --rc genhtml_function_coverage=1 00:27:40.153 --rc genhtml_legend=1 00:27:40.153 --rc geninfo_all_blocks=1 00:27:40.153 --rc geninfo_unexecuted_blocks=1 00:27:40.153 00:27:40.153 ' 00:27:40.153 15:22:40 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:40.153 15:22:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:40.153 15:22:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:40.153 15:22:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:40.153 15:22:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- paths/export.sh@5 -- # export PATH 00:27:40.153 15:22:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:40.153 15:22:40 -- nvmf/common.sh@7 -- # uname -s 00:27:40.153 15:22:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:40.153 15:22:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:40.153 15:22:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:40.153 15:22:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:40.153 15:22:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:40.153 15:22:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:40.153 15:22:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:40.153 15:22:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:40.153 15:22:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:40.153 15:22:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:40.153 15:22:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:40.153 15:22:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:40.153 15:22:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:40.153 15:22:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:40.153 15:22:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:40.153 15:22:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:40.153 15:22:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:40.153 15:22:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:40.153 15:22:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:40.153 15:22:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- paths/export.sh@5 -- # export PATH 00:27:40.153 15:22:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:40.153 15:22:40 -- nvmf/common.sh@46 -- # : 0 00:27:40.153 15:22:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:40.153 15:22:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:40.153 15:22:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:40.153 15:22:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:40.153 15:22:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:40.153 15:22:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:40.153 15:22:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:40.153 15:22:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:40.153 15:22:40 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:40.153 15:22:40 -- host/fio.sh@14 -- # nvmftestinit 00:27:40.153 15:22:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:40.153 15:22:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:40.153 15:22:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:40.153 15:22:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:40.153 15:22:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:40.153 15:22:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:40.153 15:22:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:40.153 15:22:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:40.153 15:22:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:40.153 15:22:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:40.153 15:22:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:40.153 15:22:40 -- common/autotest_common.sh@10 -- # set +x 00:27:42.062 15:22:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:42.062 15:22:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:42.062 15:22:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:42.062 15:22:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:42.063 15:22:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:42.063 15:22:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:42.063 15:22:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:42.063 15:22:42 -- nvmf/common.sh@294 -- # net_devs=() 00:27:42.063 15:22:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:42.063 15:22:42 -- nvmf/common.sh@295 -- # e810=() 00:27:42.063 15:22:42 -- nvmf/common.sh@295 -- # local -ga e810 00:27:42.063 15:22:42 -- nvmf/common.sh@296 -- # x722=() 00:27:42.063 15:22:42 -- nvmf/common.sh@296 -- # local -ga x722 00:27:42.063 15:22:42 -- nvmf/common.sh@297 -- # mlx=() 00:27:42.063 15:22:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:42.063 15:22:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:42.063 15:22:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:42.063 15:22:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:42.063 15:22:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:42.063 15:22:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:42.063 15:22:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:42.063 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:42.063 15:22:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:42.063 15:22:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:42.063 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:42.063 15:22:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:42.063 15:22:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:42.063 15:22:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:42.063 15:22:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:42.063 15:22:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:42.063 15:22:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:42.063 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:42.063 15:22:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:42.063 15:22:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:42.063 15:22:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:42.063 15:22:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:42.063 15:22:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:42.063 15:22:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:42.063 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:42.063 15:22:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:42.063 15:22:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:42.063 15:22:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:42.063 15:22:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:42.063 15:22:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:42.063 15:22:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:42.063 15:22:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:42.063 15:22:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:42.063 15:22:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:42.063 15:22:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:42.063 15:22:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:42.063 15:22:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:42.063 15:22:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:42.063 15:22:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:42.063 15:22:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:42.063 15:22:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:42.063 15:22:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:42.063 15:22:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:42.063 15:22:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:42.063 15:22:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:42.063 15:22:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:42.063 15:22:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:42.063 15:22:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:42.063 15:22:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:42.063 15:22:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:42.063 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:42.063 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:27:42.063 00:27:42.063 --- 10.0.0.2 ping statistics --- 00:27:42.063 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:42.063 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:27:42.063 15:22:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:42.324 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:42.324 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.051 ms 00:27:42.324 00:27:42.324 --- 10.0.0.1 ping statistics --- 00:27:42.324 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:42.324 rtt min/avg/max/mdev = 0.051/0.051/0.051/0.000 ms 00:27:42.324 15:22:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:42.324 15:22:42 -- nvmf/common.sh@410 -- # return 0 00:27:42.325 15:22:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:42.325 15:22:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:42.325 15:22:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:42.325 15:22:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:42.325 15:22:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:42.325 15:22:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:42.325 15:22:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:42.325 15:22:42 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:42.325 15:22:42 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:42.325 15:22:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:42.325 15:22:42 -- common/autotest_common.sh@10 -- # set +x 00:27:42.325 15:22:42 -- host/fio.sh@24 -- # nvmfpid=811001 00:27:42.325 15:22:42 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:42.325 15:22:42 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:42.325 15:22:42 -- host/fio.sh@28 -- # waitforlisten 811001 00:27:42.325 15:22:42 -- common/autotest_common.sh@829 -- # '[' -z 811001 ']' 00:27:42.325 15:22:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:42.325 15:22:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:42.325 15:22:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:42.325 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:42.325 15:22:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:42.325 15:22:42 -- common/autotest_common.sh@10 -- # set +x 00:27:42.325 [2024-11-28 15:22:42.366139] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:27:42.325 [2024-11-28 15:22:42.366211] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:42.325 EAL: No free 2048 kB hugepages reported on node 1 00:27:42.325 [2024-11-28 15:22:42.431262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:42.325 [2024-11-28 15:22:42.519950] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:42.325 [2024-11-28 15:22:42.520122] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:42.325 [2024-11-28 15:22:42.520141] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:42.325 [2024-11-28 15:22:42.520153] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:42.325 [2024-11-28 15:22:42.520291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:42.325 [2024-11-28 15:22:42.520330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:42.325 [2024-11-28 15:22:42.520423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:42.325 [2024-11-28 15:22:42.520426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:43.261 15:22:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:43.261 15:22:43 -- common/autotest_common.sh@862 -- # return 0 00:27:43.261 15:22:43 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:43.520 [2024-11-28 15:22:43.593576] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:43.520 15:22:43 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:43.520 15:22:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:43.520 15:22:43 -- common/autotest_common.sh@10 -- # set +x 00:27:43.520 15:22:43 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:43.779 Malloc1 00:27:43.779 15:22:43 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:44.036 15:22:44 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:44.295 15:22:44 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:44.554 [2024-11-28 15:22:44.632343] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:44.554 15:22:44 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:44.812 15:22:44 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:44.812 15:22:44 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:44.812 15:22:44 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:44.812 15:22:44 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:44.812 15:22:44 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:44.812 15:22:44 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:44.813 15:22:44 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:44.813 15:22:44 -- common/autotest_common.sh@1330 -- # shift 00:27:44.813 15:22:44 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:44.813 15:22:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:44.813 15:22:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:44.813 15:22:44 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:44.813 15:22:44 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:44.813 15:22:44 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:44.813 15:22:44 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:44.813 15:22:44 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:45.070 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:45.070 fio-3.35 00:27:45.070 Starting 1 thread 00:27:45.070 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.603 00:27:47.603 test: (groupid=0, jobs=1): err= 0: pid=811499: Thu Nov 28 15:22:47 2024 00:27:47.603 read: IOPS=9609, BW=37.5MiB/s (39.4MB/s)(75.3MiB/2006msec) 00:27:47.603 slat (nsec): min=1842, max=116580, avg=2464.56, stdev=1520.45 00:27:47.603 clat (usec): min=2152, max=12468, avg=7320.84, stdev=555.46 00:27:47.603 lat (usec): min=2169, max=12470, avg=7323.30, stdev=555.36 00:27:47.603 clat percentiles (usec): 00:27:47.603 | 1.00th=[ 5997], 5.00th=[ 6456], 10.00th=[ 6652], 20.00th=[ 6915], 00:27:47.603 | 30.00th=[ 7046], 40.00th=[ 7177], 50.00th=[ 7308], 60.00th=[ 7439], 00:27:47.603 | 70.00th=[ 7570], 80.00th=[ 7767], 90.00th=[ 7963], 95.00th=[ 8160], 00:27:47.603 | 99.00th=[ 8586], 99.50th=[ 8717], 99.90th=[10159], 99.95th=[11731], 00:27:47.603 | 99.99th=[12387] 00:27:47.603 bw ( KiB/s): min=37480, max=39160, per=99.92%, avg=38408.00, stdev=720.50, samples=4 00:27:47.603 iops : min= 9370, max= 9790, avg=9602.00, stdev=180.13, samples=4 00:27:47.603 write: IOPS=9611, BW=37.5MiB/s (39.4MB/s)(75.3MiB/2006msec); 0 zone resets 00:27:47.603 slat (nsec): min=1979, max=109488, avg=2548.68, stdev=1353.94 00:27:47.603 clat (usec): min=945, max=11775, avg=5937.23, stdev=474.47 00:27:47.603 lat (usec): min=960, max=11778, avg=5939.78, stdev=474.43 00:27:47.604 clat percentiles (usec): 00:27:47.604 | 1.00th=[ 4883], 5.00th=[ 5211], 10.00th=[ 5407], 20.00th=[ 5604], 00:27:47.604 | 30.00th=[ 5735], 40.00th=[ 5800], 50.00th=[ 5932], 60.00th=[ 6063], 00:27:47.604 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6456], 95.00th=[ 6652], 00:27:47.604 | 99.00th=[ 6915], 99.50th=[ 7046], 99.90th=[ 8848], 99.95th=[10552], 00:27:47.604 | 99.99th=[11731] 00:27:47.604 bw ( KiB/s): min=38216, max=38784, per=100.00%, avg=38452.00, stdev=238.44, samples=4 00:27:47.604 iops : min= 9554, max= 9696, avg=9613.00, stdev=59.61, samples=4 00:27:47.604 lat (usec) : 1000=0.01% 00:27:47.604 lat (msec) : 2=0.02%, 4=0.10%, 10=99.78%, 20=0.09% 00:27:47.604 cpu : usr=64.04%, sys=34.26%, ctx=75, majf=0, minf=36 00:27:47.604 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:47.604 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:47.604 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:47.604 issued rwts: total=19277,19280,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:47.604 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:47.604 00:27:47.604 Run status group 0 (all jobs): 00:27:47.604 READ: bw=37.5MiB/s (39.4MB/s), 37.5MiB/s-37.5MiB/s (39.4MB/s-39.4MB/s), io=75.3MiB (79.0MB), run=2006-2006msec 00:27:47.604 WRITE: bw=37.5MiB/s (39.4MB/s), 37.5MiB/s-37.5MiB/s (39.4MB/s-39.4MB/s), io=75.3MiB (79.0MB), run=2006-2006msec 00:27:47.604 15:22:47 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:47.604 15:22:47 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:47.604 15:22:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:47.604 15:22:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:47.604 15:22:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:47.604 15:22:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:47.604 15:22:47 -- common/autotest_common.sh@1330 -- # shift 00:27:47.604 15:22:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:47.604 15:22:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:47.604 15:22:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:47.604 15:22:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:47.604 15:22:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:47.604 15:22:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:47.604 15:22:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:47.604 15:22:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:47.604 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:47.604 fio-3.35 00:27:47.604 Starting 1 thread 00:27:47.604 EAL: No free 2048 kB hugepages reported on node 1 00:27:50.134 00:27:50.134 test: (groupid=0, jobs=1): err= 0: pid=811836: Thu Nov 28 15:22:49 2024 00:27:50.135 read: IOPS=9041, BW=141MiB/s (148MB/s)(284MiB/2007msec) 00:27:50.135 slat (usec): min=2, max=120, avg= 3.69, stdev= 2.03 00:27:50.135 clat (usec): min=1729, max=17739, avg=8211.66, stdev=1973.62 00:27:50.135 lat (usec): min=1733, max=17742, avg=8215.36, stdev=1973.72 00:27:50.135 clat percentiles (usec): 00:27:50.135 | 1.00th=[ 4293], 5.00th=[ 5276], 10.00th=[ 5800], 20.00th=[ 6587], 00:27:50.135 | 30.00th=[ 7046], 40.00th=[ 7570], 50.00th=[ 8094], 60.00th=[ 8586], 00:27:50.135 | 70.00th=[ 9110], 80.00th=[ 9765], 90.00th=[10683], 95.00th=[11600], 00:27:50.135 | 99.00th=[13566], 99.50th=[14746], 99.90th=[15664], 99.95th=[15926], 00:27:50.135 | 99.99th=[16057] 00:27:50.135 bw ( KiB/s): min=66080, max=77440, per=49.19%, avg=71160.00, stdev=5133.94, samples=4 00:27:50.135 iops : min= 4130, max= 4840, avg=4447.50, stdev=320.87, samples=4 00:27:50.135 write: IOPS=5195, BW=81.2MiB/s (85.1MB/s)(145MiB/1791msec); 0 zone resets 00:27:50.135 slat (usec): min=30, max=180, avg=34.02, stdev= 6.34 00:27:50.135 clat (usec): min=4038, max=17743, avg=10608.11, stdev=1843.21 00:27:50.135 lat (usec): min=4069, max=17776, avg=10642.14, stdev=1844.08 00:27:50.135 clat percentiles (usec): 00:27:50.135 | 1.00th=[ 6783], 5.00th=[ 7832], 10.00th=[ 8455], 20.00th=[ 9110], 00:27:50.135 | 30.00th=[ 9634], 40.00th=[10028], 50.00th=[10421], 60.00th=[10945], 00:27:50.135 | 70.00th=[11338], 80.00th=[11994], 90.00th=[13042], 95.00th=[14091], 00:27:50.135 | 99.00th=[15533], 99.50th=[16057], 99.90th=[16909], 99.95th=[16909], 00:27:50.135 | 99.99th=[17695] 00:27:50.135 bw ( KiB/s): min=68448, max=79520, per=88.99%, avg=73976.00, stdev=5101.26, samples=4 00:27:50.135 iops : min= 4278, max= 4970, avg=4623.50, stdev=318.83, samples=4 00:27:50.135 lat (msec) : 2=0.02%, 4=0.39%, 10=68.80%, 20=30.79% 00:27:50.135 cpu : usr=77.82%, sys=20.89%, ctx=28, majf=0, minf=56 00:27:50.135 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:27:50.135 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:50.135 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:50.135 issued rwts: total=18146,9305,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:50.135 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:50.135 00:27:50.135 Run status group 0 (all jobs): 00:27:50.135 READ: bw=141MiB/s (148MB/s), 141MiB/s-141MiB/s (148MB/s-148MB/s), io=284MiB (297MB), run=2007-2007msec 00:27:50.135 WRITE: bw=81.2MiB/s (85.1MB/s), 81.2MiB/s-81.2MiB/s (85.1MB/s-85.1MB/s), io=145MiB (152MB), run=1791-1791msec 00:27:50.135 15:22:49 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:50.135 15:22:50 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:50.135 15:22:50 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:50.135 15:22:50 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:50.135 15:22:50 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:50.135 15:22:50 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:50.135 15:22:50 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:50.135 15:22:50 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:50.135 15:22:50 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:50.135 15:22:50 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:50.135 15:22:50 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:50.135 15:22:50 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:53.421 Nvme0n1 00:27:53.421 15:22:53 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:56.704 15:22:56 -- host/fio.sh@53 -- # ls_guid=2b4d50bc-c3d3-4d54-ad49-e5f88133e15d 00:27:56.704 15:22:56 -- host/fio.sh@54 -- # get_lvs_free_mb 2b4d50bc-c3d3-4d54-ad49-e5f88133e15d 00:27:56.704 15:22:56 -- common/autotest_common.sh@1353 -- # local lvs_uuid=2b4d50bc-c3d3-4d54-ad49-e5f88133e15d 00:27:56.704 15:22:56 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:56.704 15:22:56 -- common/autotest_common.sh@1355 -- # local fc 00:27:56.704 15:22:56 -- common/autotest_common.sh@1356 -- # local cs 00:27:56.704 15:22:56 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:56.704 15:22:56 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:56.704 { 00:27:56.704 "uuid": "2b4d50bc-c3d3-4d54-ad49-e5f88133e15d", 00:27:56.704 "name": "lvs_0", 00:27:56.704 "base_bdev": "Nvme0n1", 00:27:56.704 "total_data_clusters": 930, 00:27:56.704 "free_clusters": 930, 00:27:56.704 "block_size": 512, 00:27:56.704 "cluster_size": 1073741824 00:27:56.704 } 00:27:56.704 ]' 00:27:56.704 15:22:56 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="2b4d50bc-c3d3-4d54-ad49-e5f88133e15d") .free_clusters' 00:27:56.704 15:22:56 -- common/autotest_common.sh@1358 -- # fc=930 00:27:56.704 15:22:56 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="2b4d50bc-c3d3-4d54-ad49-e5f88133e15d") .cluster_size' 00:27:56.704 15:22:56 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:56.704 15:22:56 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:56.704 15:22:56 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:56.704 952320 00:27:56.704 15:22:56 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:56.704 3b17e36c-def5-4ecf-8227-c116100c0de7 00:27:56.962 15:22:56 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:57.219 15:22:57 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:57.477 15:22:57 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:57.735 15:22:57 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:57.735 15:22:57 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:57.735 15:22:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:57.735 15:22:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:57.735 15:22:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:57.735 15:22:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:57.735 15:22:57 -- common/autotest_common.sh@1330 -- # shift 00:27:57.735 15:22:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:57.735 15:22:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:57.735 15:22:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:57.735 15:22:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:57.735 15:22:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:57.735 15:22:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:57.735 15:22:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:57.735 15:22:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:57.735 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:57.735 fio-3.35 00:27:57.735 Starting 1 thread 00:27:57.992 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.523 [2024-11-28 15:23:00.269227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1422540 is same with the state(5) to be set 00:28:00.523 [2024-11-28 15:23:00.269299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1422540 is same with the state(5) to be set 00:28:00.523 [2024-11-28 15:23:00.269316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1422540 is same with the state(5) to be set 00:28:00.523 [2024-11-28 15:23:00.269329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1422540 is same with the state(5) to be set 00:28:00.523 [2024-11-28 15:23:00.269342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1422540 is same with the state(5) to be set 00:28:00.523 00:28:00.523 test: (groupid=0, jobs=1): err= 0: pid=813159: Thu Nov 28 15:23:00 2024 00:28:00.523 read: IOPS=6415, BW=25.1MiB/s (26.3MB/s)(50.3MiB/2007msec) 00:28:00.523 slat (nsec): min=1852, max=176351, avg=2535.97, stdev=2213.97 00:28:00.523 clat (usec): min=1238, max=170855, avg=10894.86, stdev=11322.16 00:28:00.523 lat (usec): min=1241, max=170900, avg=10897.40, stdev=11322.54 00:28:00.523 clat percentiles (msec): 00:28:00.523 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:28:00.523 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:28:00.523 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:28:00.523 | 99.00th=[ 14], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:28:00.523 | 99.99th=[ 171] 00:28:00.523 bw ( KiB/s): min=18328, max=28400, per=99.79%, avg=25608.00, stdev=4877.87, samples=4 00:28:00.523 iops : min= 4582, max= 7100, avg=6402.00, stdev=1219.47, samples=4 00:28:00.523 write: IOPS=6415, BW=25.1MiB/s (26.3MB/s)(50.3MiB/2007msec); 0 zone resets 00:28:00.523 slat (nsec): min=1962, max=134681, avg=2639.79, stdev=1625.78 00:28:00.523 clat (usec): min=330, max=168727, avg=8933.47, stdev=10593.95 00:28:00.523 lat (usec): min=333, max=168737, avg=8936.11, stdev=10594.28 00:28:00.523 clat percentiles (msec): 00:28:00.523 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], 00:28:00.523 | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:28:00.523 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 10], 95.00th=[ 10], 00:28:00.523 | 99.00th=[ 12], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:28:00.523 | 99.99th=[ 169] 00:28:00.524 bw ( KiB/s): min=19304, max=27968, per=99.92%, avg=25642.00, stdev=4230.93, samples=4 00:28:00.524 iops : min= 4826, max= 6992, avg=6410.50, stdev=1057.73, samples=4 00:28:00.524 lat (usec) : 500=0.01%, 750=0.01% 00:28:00.524 lat (msec) : 2=0.03%, 4=0.13%, 10=72.35%, 20=26.97%, 250=0.50% 00:28:00.524 cpu : usr=62.16%, sys=36.34%, ctx=146, majf=0, minf=36 00:28:00.524 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:28:00.524 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:00.524 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:00.524 issued rwts: total=12876,12876,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:00.524 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:00.524 00:28:00.524 Run status group 0 (all jobs): 00:28:00.524 READ: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.3MiB (52.7MB), run=2007-2007msec 00:28:00.524 WRITE: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.3MiB (52.7MB), run=2007-2007msec 00:28:00.524 15:23:00 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:28:00.524 15:23:00 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:28:01.904 15:23:01 -- host/fio.sh@64 -- # ls_nested_guid=4732e324-85ec-405c-9eee-913609e6ef22 00:28:01.904 15:23:01 -- host/fio.sh@65 -- # get_lvs_free_mb 4732e324-85ec-405c-9eee-913609e6ef22 00:28:01.904 15:23:01 -- common/autotest_common.sh@1353 -- # local lvs_uuid=4732e324-85ec-405c-9eee-913609e6ef22 00:28:01.904 15:23:01 -- common/autotest_common.sh@1354 -- # local lvs_info 00:28:01.904 15:23:01 -- common/autotest_common.sh@1355 -- # local fc 00:28:01.904 15:23:01 -- common/autotest_common.sh@1356 -- # local cs 00:28:01.904 15:23:01 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:28:01.904 15:23:01 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:28:01.904 { 00:28:01.904 "uuid": "2b4d50bc-c3d3-4d54-ad49-e5f88133e15d", 00:28:01.904 "name": "lvs_0", 00:28:01.904 "base_bdev": "Nvme0n1", 00:28:01.904 "total_data_clusters": 930, 00:28:01.904 "free_clusters": 0, 00:28:01.904 "block_size": 512, 00:28:01.904 "cluster_size": 1073741824 00:28:01.904 }, 00:28:01.904 { 00:28:01.904 "uuid": "4732e324-85ec-405c-9eee-913609e6ef22", 00:28:01.904 "name": "lvs_n_0", 00:28:01.904 "base_bdev": "3b17e36c-def5-4ecf-8227-c116100c0de7", 00:28:01.904 "total_data_clusters": 237847, 00:28:01.904 "free_clusters": 237847, 00:28:01.904 "block_size": 512, 00:28:01.904 "cluster_size": 4194304 00:28:01.904 } 00:28:01.904 ]' 00:28:01.904 15:23:01 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="4732e324-85ec-405c-9eee-913609e6ef22") .free_clusters' 00:28:01.905 15:23:02 -- common/autotest_common.sh@1358 -- # fc=237847 00:28:01.905 15:23:02 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="4732e324-85ec-405c-9eee-913609e6ef22") .cluster_size' 00:28:01.905 15:23:02 -- common/autotest_common.sh@1359 -- # cs=4194304 00:28:01.905 15:23:02 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:28:01.905 15:23:02 -- common/autotest_common.sh@1363 -- # echo 951388 00:28:01.905 951388 00:28:01.905 15:23:02 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:02.844 e7925965-cd4e-4a85-acc8-74f2b13463b7 00:28:02.844 15:23:02 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:02.844 15:23:02 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:03.102 15:23:03 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:03.359 15:23:03 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:03.359 15:23:03 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:03.359 15:23:03 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:03.359 15:23:03 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:03.359 15:23:03 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:03.359 15:23:03 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:03.359 15:23:03 -- common/autotest_common.sh@1330 -- # shift 00:28:03.359 15:23:03 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:03.359 15:23:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:03.359 15:23:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:03.359 15:23:03 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:03.359 15:23:03 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:03.360 15:23:03 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:03.360 15:23:03 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:03.360 15:23:03 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:03.360 15:23:03 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:03.619 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:03.619 fio-3.35 00:28:03.619 Starting 1 thread 00:28:03.619 EAL: No free 2048 kB hugepages reported on node 1 00:28:06.149 00:28:06.149 test: (groupid=0, jobs=1): err= 0: pid=813913: Thu Nov 28 15:23:06 2024 00:28:06.149 read: IOPS=6114, BW=23.9MiB/s (25.0MB/s)(48.0MiB/2009msec) 00:28:06.149 slat (nsec): min=1882, max=152940, avg=2621.39, stdev=2245.86 00:28:06.149 clat (usec): min=4329, max=18053, avg=11497.18, stdev=1027.56 00:28:06.149 lat (usec): min=4339, max=18055, avg=11499.81, stdev=1027.48 00:28:06.149 clat percentiles (usec): 00:28:06.149 | 1.00th=[ 8979], 5.00th=[ 9896], 10.00th=[10159], 20.00th=[10683], 00:28:06.149 | 30.00th=[10945], 40.00th=[11338], 50.00th=[11469], 60.00th=[11731], 00:28:06.149 | 70.00th=[11994], 80.00th=[12256], 90.00th=[12780], 95.00th=[13042], 00:28:06.149 | 99.00th=[13698], 99.50th=[14091], 99.90th=[16581], 99.95th=[17695], 00:28:06.149 | 99.99th=[17957] 00:28:06.149 bw ( KiB/s): min=23096, max=24936, per=99.92%, avg=24438.00, stdev=897.53, samples=4 00:28:06.149 iops : min= 5774, max= 6234, avg=6109.50, stdev=224.38, samples=4 00:28:06.149 write: IOPS=6096, BW=23.8MiB/s (25.0MB/s)(47.8MiB/2009msec); 0 zone resets 00:28:06.149 slat (usec): min=2, max=102, avg= 2.68, stdev= 1.59 00:28:06.149 clat (usec): min=2078, max=16876, avg=9311.36, stdev=873.10 00:28:06.149 lat (usec): min=2084, max=16878, avg=9314.04, stdev=873.07 00:28:06.149 clat percentiles (usec): 00:28:06.149 | 1.00th=[ 7373], 5.00th=[ 7963], 10.00th=[ 8291], 20.00th=[ 8717], 00:28:06.149 | 30.00th=[ 8979], 40.00th=[ 9110], 50.00th=[ 9372], 60.00th=[ 9503], 00:28:06.149 | 70.00th=[ 9765], 80.00th=[10028], 90.00th=[10290], 95.00th=[10683], 00:28:06.149 | 99.00th=[11207], 99.50th=[11469], 99.90th=[15795], 99.95th=[16581], 00:28:06.149 | 99.99th=[16909] 00:28:06.149 bw ( KiB/s): min=24080, max=24632, per=99.94%, avg=24372.00, stdev=231.36, samples=4 00:28:06.149 iops : min= 6020, max= 6158, avg=6093.00, stdev=57.84, samples=4 00:28:06.149 lat (msec) : 4=0.04%, 10=43.80%, 20=56.16% 00:28:06.149 cpu : usr=58.62%, sys=39.94%, ctx=77, majf=0, minf=36 00:28:06.149 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:06.149 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:06.149 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:06.149 issued rwts: total=12284,12248,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:06.149 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:06.149 00:28:06.149 Run status group 0 (all jobs): 00:28:06.149 READ: bw=23.9MiB/s (25.0MB/s), 23.9MiB/s-23.9MiB/s (25.0MB/s-25.0MB/s), io=48.0MiB (50.3MB), run=2009-2009msec 00:28:06.149 WRITE: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.8MiB (50.2MB), run=2009-2009msec 00:28:06.149 15:23:06 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:06.149 15:23:06 -- host/fio.sh@74 -- # sync 00:28:06.149 15:23:06 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:10.391 15:23:10 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:10.391 15:23:10 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:13.678 15:23:13 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:13.678 15:23:13 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:15.590 15:23:15 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:15.590 15:23:15 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:15.590 15:23:15 -- host/fio.sh@86 -- # nvmftestfini 00:28:15.590 15:23:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:15.590 15:23:15 -- nvmf/common.sh@116 -- # sync 00:28:15.590 15:23:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:15.590 15:23:15 -- nvmf/common.sh@119 -- # set +e 00:28:15.590 15:23:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:15.590 15:23:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:15.590 rmmod nvme_tcp 00:28:15.590 rmmod nvme_fabrics 00:28:15.590 rmmod nvme_keyring 00:28:15.590 15:23:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:15.590 15:23:15 -- nvmf/common.sh@123 -- # set -e 00:28:15.590 15:23:15 -- nvmf/common.sh@124 -- # return 0 00:28:15.590 15:23:15 -- nvmf/common.sh@477 -- # '[' -n 811001 ']' 00:28:15.590 15:23:15 -- nvmf/common.sh@478 -- # killprocess 811001 00:28:15.590 15:23:15 -- common/autotest_common.sh@936 -- # '[' -z 811001 ']' 00:28:15.590 15:23:15 -- common/autotest_common.sh@940 -- # kill -0 811001 00:28:15.590 15:23:15 -- common/autotest_common.sh@941 -- # uname 00:28:15.590 15:23:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:15.590 15:23:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 811001 00:28:15.590 15:23:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:15.590 15:23:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:15.590 15:23:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 811001' 00:28:15.590 killing process with pid 811001 00:28:15.590 15:23:15 -- common/autotest_common.sh@955 -- # kill 811001 00:28:15.590 15:23:15 -- common/autotest_common.sh@960 -- # wait 811001 00:28:15.590 15:23:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:15.590 15:23:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:15.590 15:23:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:15.590 15:23:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:15.590 15:23:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:15.590 15:23:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:15.590 15:23:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:15.590 15:23:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:18.132 15:23:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:18.132 00:28:18.132 real 0m37.774s 00:28:18.132 user 2m25.366s 00:28:18.132 sys 0m6.791s 00:28:18.132 15:23:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:18.132 15:23:17 -- common/autotest_common.sh@10 -- # set +x 00:28:18.132 ************************************ 00:28:18.132 END TEST nvmf_fio_host 00:28:18.132 ************************************ 00:28:18.132 15:23:17 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:18.132 15:23:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:18.132 15:23:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:18.132 15:23:17 -- common/autotest_common.sh@10 -- # set +x 00:28:18.132 ************************************ 00:28:18.132 START TEST nvmf_failover 00:28:18.132 ************************************ 00:28:18.132 15:23:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:18.132 * Looking for test storage... 00:28:18.132 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:18.132 15:23:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:18.132 15:23:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:18.132 15:23:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:18.132 15:23:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:18.132 15:23:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:18.132 15:23:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:18.132 15:23:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:18.132 15:23:17 -- scripts/common.sh@335 -- # IFS=.-: 00:28:18.132 15:23:17 -- scripts/common.sh@335 -- # read -ra ver1 00:28:18.132 15:23:17 -- scripts/common.sh@336 -- # IFS=.-: 00:28:18.132 15:23:17 -- scripts/common.sh@336 -- # read -ra ver2 00:28:18.132 15:23:17 -- scripts/common.sh@337 -- # local 'op=<' 00:28:18.132 15:23:17 -- scripts/common.sh@339 -- # ver1_l=2 00:28:18.132 15:23:17 -- scripts/common.sh@340 -- # ver2_l=1 00:28:18.132 15:23:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:18.132 15:23:17 -- scripts/common.sh@343 -- # case "$op" in 00:28:18.132 15:23:17 -- scripts/common.sh@344 -- # : 1 00:28:18.132 15:23:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:18.132 15:23:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:18.132 15:23:17 -- scripts/common.sh@364 -- # decimal 1 00:28:18.132 15:23:17 -- scripts/common.sh@352 -- # local d=1 00:28:18.132 15:23:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:18.132 15:23:17 -- scripts/common.sh@354 -- # echo 1 00:28:18.132 15:23:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:18.132 15:23:17 -- scripts/common.sh@365 -- # decimal 2 00:28:18.132 15:23:17 -- scripts/common.sh@352 -- # local d=2 00:28:18.132 15:23:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:18.133 15:23:17 -- scripts/common.sh@354 -- # echo 2 00:28:18.133 15:23:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:18.133 15:23:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:18.133 15:23:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:18.133 15:23:17 -- scripts/common.sh@367 -- # return 0 00:28:18.133 15:23:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:18.133 15:23:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:18.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:18.133 --rc genhtml_branch_coverage=1 00:28:18.133 --rc genhtml_function_coverage=1 00:28:18.133 --rc genhtml_legend=1 00:28:18.133 --rc geninfo_all_blocks=1 00:28:18.133 --rc geninfo_unexecuted_blocks=1 00:28:18.133 00:28:18.133 ' 00:28:18.133 15:23:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:18.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:18.133 --rc genhtml_branch_coverage=1 00:28:18.133 --rc genhtml_function_coverage=1 00:28:18.133 --rc genhtml_legend=1 00:28:18.133 --rc geninfo_all_blocks=1 00:28:18.133 --rc geninfo_unexecuted_blocks=1 00:28:18.133 00:28:18.133 ' 00:28:18.133 15:23:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:18.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:18.133 --rc genhtml_branch_coverage=1 00:28:18.133 --rc genhtml_function_coverage=1 00:28:18.133 --rc genhtml_legend=1 00:28:18.133 --rc geninfo_all_blocks=1 00:28:18.133 --rc geninfo_unexecuted_blocks=1 00:28:18.133 00:28:18.133 ' 00:28:18.133 15:23:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:18.133 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:18.133 --rc genhtml_branch_coverage=1 00:28:18.133 --rc genhtml_function_coverage=1 00:28:18.133 --rc genhtml_legend=1 00:28:18.133 --rc geninfo_all_blocks=1 00:28:18.133 --rc geninfo_unexecuted_blocks=1 00:28:18.133 00:28:18.133 ' 00:28:18.133 15:23:17 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:18.133 15:23:17 -- nvmf/common.sh@7 -- # uname -s 00:28:18.133 15:23:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:18.133 15:23:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:18.133 15:23:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:18.133 15:23:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:18.133 15:23:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:18.133 15:23:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:18.133 15:23:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:18.133 15:23:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:18.133 15:23:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:18.133 15:23:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:18.133 15:23:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:18.133 15:23:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:18.133 15:23:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:18.133 15:23:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:18.133 15:23:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:18.133 15:23:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:18.133 15:23:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:18.133 15:23:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:18.133 15:23:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:18.133 15:23:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.133 15:23:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.133 15:23:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.133 15:23:18 -- paths/export.sh@5 -- # export PATH 00:28:18.133 15:23:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:18.133 15:23:18 -- nvmf/common.sh@46 -- # : 0 00:28:18.133 15:23:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:18.133 15:23:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:18.133 15:23:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:18.133 15:23:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:18.133 15:23:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:18.133 15:23:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:18.133 15:23:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:18.133 15:23:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:18.133 15:23:18 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:18.133 15:23:18 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:18.133 15:23:18 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:18.133 15:23:18 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:18.133 15:23:18 -- host/failover.sh@18 -- # nvmftestinit 00:28:18.133 15:23:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:18.133 15:23:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:18.133 15:23:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:18.133 15:23:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:18.133 15:23:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:18.133 15:23:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:18.133 15:23:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:18.133 15:23:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:18.133 15:23:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:18.133 15:23:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:18.133 15:23:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:18.133 15:23:18 -- common/autotest_common.sh@10 -- # set +x 00:28:20.041 15:23:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:20.042 15:23:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:20.042 15:23:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:20.042 15:23:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:20.042 15:23:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:20.042 15:23:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:20.042 15:23:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:20.042 15:23:20 -- nvmf/common.sh@294 -- # net_devs=() 00:28:20.042 15:23:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:20.042 15:23:20 -- nvmf/common.sh@295 -- # e810=() 00:28:20.042 15:23:20 -- nvmf/common.sh@295 -- # local -ga e810 00:28:20.042 15:23:20 -- nvmf/common.sh@296 -- # x722=() 00:28:20.042 15:23:20 -- nvmf/common.sh@296 -- # local -ga x722 00:28:20.042 15:23:20 -- nvmf/common.sh@297 -- # mlx=() 00:28:20.042 15:23:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:20.042 15:23:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:20.042 15:23:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:20.042 15:23:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:20.042 15:23:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:20.042 15:23:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:20.042 15:23:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:20.042 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:20.042 15:23:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:20.042 15:23:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:20.042 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:20.042 15:23:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:20.042 15:23:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:20.042 15:23:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:20.042 15:23:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:20.042 15:23:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:20.042 15:23:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:20.042 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:20.042 15:23:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:20.042 15:23:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:20.042 15:23:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:20.042 15:23:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:20.042 15:23:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:20.042 15:23:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:20.042 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:20.042 15:23:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:20.042 15:23:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:20.042 15:23:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:20.042 15:23:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:20.042 15:23:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:20.042 15:23:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:20.042 15:23:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:20.042 15:23:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:20.042 15:23:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:20.042 15:23:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:20.042 15:23:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:20.042 15:23:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:20.042 15:23:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:20.042 15:23:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:20.042 15:23:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:20.042 15:23:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:20.042 15:23:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:20.042 15:23:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:20.042 15:23:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:20.042 15:23:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:20.042 15:23:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:20.042 15:23:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:20.042 15:23:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:20.042 15:23:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:20.042 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:20.042 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:28:20.042 00:28:20.042 --- 10.0.0.2 ping statistics --- 00:28:20.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:20.042 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:28:20.042 15:23:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:20.042 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:20.042 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.049 ms 00:28:20.042 00:28:20.042 --- 10.0.0.1 ping statistics --- 00:28:20.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:20.042 rtt min/avg/max/mdev = 0.049/0.049/0.049/0.000 ms 00:28:20.042 15:23:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:20.042 15:23:20 -- nvmf/common.sh@410 -- # return 0 00:28:20.042 15:23:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:20.042 15:23:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:20.042 15:23:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:20.042 15:23:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:20.042 15:23:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:20.042 15:23:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:20.042 15:23:20 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:20.042 15:23:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:20.042 15:23:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:20.042 15:23:20 -- common/autotest_common.sh@10 -- # set +x 00:28:20.042 15:23:20 -- nvmf/common.sh@469 -- # nvmfpid=817360 00:28:20.042 15:23:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:20.043 15:23:20 -- nvmf/common.sh@470 -- # waitforlisten 817360 00:28:20.043 15:23:20 -- common/autotest_common.sh@829 -- # '[' -z 817360 ']' 00:28:20.043 15:23:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:20.043 15:23:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:20.043 15:23:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:20.043 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:20.043 15:23:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:20.043 15:23:20 -- common/autotest_common.sh@10 -- # set +x 00:28:20.043 [2024-11-28 15:23:20.251476] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:20.043 [2024-11-28 15:23:20.251556] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:20.303 EAL: No free 2048 kB hugepages reported on node 1 00:28:20.303 [2024-11-28 15:23:20.321542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:20.303 [2024-11-28 15:23:20.411292] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:20.303 [2024-11-28 15:23:20.411457] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:20.303 [2024-11-28 15:23:20.411476] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:20.303 [2024-11-28 15:23:20.411490] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:20.303 [2024-11-28 15:23:20.411566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:20.303 [2024-11-28 15:23:20.411685] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:20.303 [2024-11-28 15:23:20.411688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:21.239 15:23:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:21.240 15:23:21 -- common/autotest_common.sh@862 -- # return 0 00:28:21.240 15:23:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:21.240 15:23:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:21.240 15:23:21 -- common/autotest_common.sh@10 -- # set +x 00:28:21.240 15:23:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:21.240 15:23:21 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:21.498 [2024-11-28 15:23:21.526779] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:21.498 15:23:21 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:21.756 Malloc0 00:28:21.756 15:23:21 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:22.014 15:23:22 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:22.272 15:23:22 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:22.529 [2024-11-28 15:23:22.574194] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:22.529 15:23:22 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:22.787 [2024-11-28 15:23:22.822941] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:22.787 15:23:22 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:23.046 [2024-11-28 15:23:23.071811] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:23.046 15:23:23 -- host/failover.sh@31 -- # bdevperf_pid=817669 00:28:23.046 15:23:23 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:23.046 15:23:23 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:23.046 15:23:23 -- host/failover.sh@34 -- # waitforlisten 817669 /var/tmp/bdevperf.sock 00:28:23.046 15:23:23 -- common/autotest_common.sh@829 -- # '[' -z 817669 ']' 00:28:23.046 15:23:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:23.046 15:23:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:23.046 15:23:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:23.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:23.046 15:23:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:23.046 15:23:23 -- common/autotest_common.sh@10 -- # set +x 00:28:23.984 15:23:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:23.984 15:23:24 -- common/autotest_common.sh@862 -- # return 0 00:28:23.984 15:23:24 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:24.241 NVMe0n1 00:28:24.241 15:23:24 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:24.499 00:28:24.757 15:23:24 -- host/failover.sh@39 -- # run_test_pid=817943 00:28:24.757 15:23:24 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:24.757 15:23:24 -- host/failover.sh@41 -- # sleep 1 00:28:25.693 15:23:25 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:25.951 [2024-11-28 15:23:25.979271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979364] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 [2024-11-28 15:23:25.979674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185e180 is same with the state(5) to be set 00:28:25.951 15:23:25 -- host/failover.sh@45 -- # sleep 3 00:28:29.252 15:23:28 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:29.252 00:28:29.252 15:23:29 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:29.509 [2024-11-28 15:23:29.682281] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682371] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682394] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.509 [2024-11-28 15:23:29.682485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682577] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 [2024-11-28 15:23:29.682633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x185f530 is same with the state(5) to be set 00:28:29.510 15:23:29 -- host/failover.sh@50 -- # sleep 3 00:28:32.793 15:23:32 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:32.793 [2024-11-28 15:23:32.994669] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:32.793 15:23:33 -- host/failover.sh@55 -- # sleep 1 00:28:34.172 15:23:34 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:34.172 [2024-11-28 15:23:34.256077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256238] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256250] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256274] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 [2024-11-28 15:23:34.256297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1a155e0 is same with the state(5) to be set 00:28:34.172 15:23:34 -- host/failover.sh@59 -- # wait 817943 00:28:40.759 0 00:28:40.759 15:23:39 -- host/failover.sh@61 -- # killprocess 817669 00:28:40.759 15:23:39 -- common/autotest_common.sh@936 -- # '[' -z 817669 ']' 00:28:40.759 15:23:39 -- common/autotest_common.sh@940 -- # kill -0 817669 00:28:40.759 15:23:39 -- common/autotest_common.sh@941 -- # uname 00:28:40.759 15:23:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:40.759 15:23:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 817669 00:28:40.759 15:23:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:40.759 15:23:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:40.759 15:23:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 817669' 00:28:40.759 killing process with pid 817669 00:28:40.759 15:23:39 -- common/autotest_common.sh@955 -- # kill 817669 00:28:40.759 15:23:39 -- common/autotest_common.sh@960 -- # wait 817669 00:28:40.759 15:23:40 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:40.759 [2024-11-28 15:23:23.128430] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:40.759 [2024-11-28 15:23:23.128518] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid817669 ] 00:28:40.759 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.759 [2024-11-28 15:23:23.188040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:40.759 [2024-11-28 15:23:23.273642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:40.759 Running I/O for 15 seconds... 00:28:40.759 [2024-11-28 15:23:25.979949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:116144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.979991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:116160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:116168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:115352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:115368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:115376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:115392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:115408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:115416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:115424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:115456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:115488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:115504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:115512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:115520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:115536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:115552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:115624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:115632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.759 [2024-11-28 15:23:25.980558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.759 [2024-11-28 15:23:25.980572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:116184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:116208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:116224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:116232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:116256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:116264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:116320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:116352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.980809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:116360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.980836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:116368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.980864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:116376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:116384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.980918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:116392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.980947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:116400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.980975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.980989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:116408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:116416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:116424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:116432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.981117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:116440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.981145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:116448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.981173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:116456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:116464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.981229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:115640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:115648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:115656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:115688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:115696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:115704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:115728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:115744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:115784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:115800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:115808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:115832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:115840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:115848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:115856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:115872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.760 [2024-11-28 15:23:25.981715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:116472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.760 [2024-11-28 15:23:25.981745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.760 [2024-11-28 15:23:25.981759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:116480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.981772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:116488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.981800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:116496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.981833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:116504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.981860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:116512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.981889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:116520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.981917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:116528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.981945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:116536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.981972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.981987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:116544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:116552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:116560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:116568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:116576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:115880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:115896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:115920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:115928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:115944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:115968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:115976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:115992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:116008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:116024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:116032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:116040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:116064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:116072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:116088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:116112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:116584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:116592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:116600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:116608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:116616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:116624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:116632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:116640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.761 [2024-11-28 15:23:25.982801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:116136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:116152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.761 [2024-11-28 15:23:25.982872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:116176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.761 [2024-11-28 15:23:25.982885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.982903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:116192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.982917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.982932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:116200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.982945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.982960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:116216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.982973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.982987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:116240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:116248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:116648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:116656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:116664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:116672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:116680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:116688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:116696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:116704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:116712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:116720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:116728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:116736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:116744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:116752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:116760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.762 [2024-11-28 15:23:25.983477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:116768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:116272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:116280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:116296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:116304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:116312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:116328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:116336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:25.983714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15cec70 is same with the state(5) to be set 00:28:40.762 [2024-11-28 15:23:25.983746] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:40.762 [2024-11-28 15:23:25.983764] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:40.762 [2024-11-28 15:23:25.983776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:116344 len:8 PRP1 0x0 PRP2 0x0 00:28:40.762 [2024-11-28 15:23:25.983789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983857] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15cec70 was disconnected and freed. reset controller. 00:28:40.762 [2024-11-28 15:23:25.983885] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:40.762 [2024-11-28 15:23:25.983922] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.762 [2024-11-28 15:23:25.983941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983956] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.762 [2024-11-28 15:23:25.983969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.983982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.762 [2024-11-28 15:23:25.983994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.984007] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.762 [2024-11-28 15:23:25.984020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:25.984033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:40.762 [2024-11-28 15:23:25.986121] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:40.762 [2024-11-28 15:23:25.986161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15af600 (9): Bad file descriptor 00:28:40.762 [2024-11-28 15:23:26.061520] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:40.762 [2024-11-28 15:23:29.682782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:129184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:29.682830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:29.682871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:129192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.762 [2024-11-28 15:23:29.682888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.762 [2024-11-28 15:23:29.682905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:129200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.682918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.682933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:129208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.682946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.682961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:129216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.682975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.682990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:129224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:129232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:129240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:129256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:129264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:129288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:129312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:129320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:129328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:129336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:129344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:129352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:129376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:129384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:129392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:129400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:129408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:129416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:129472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:129480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:129488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:129512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.763 [2024-11-28 15:23:29.683656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:128752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:128760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:128768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:128784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:128800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:128856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:128864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.763 [2024-11-28 15:23:29.683847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.763 [2024-11-28 15:23:29.683862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:128880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.683874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.683889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:128904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.683902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.683916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:128912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.683929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.683943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:128928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.683956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.683970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:128952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.683987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:128960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:128976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:128992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:129000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:129520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:129528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:129536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:129544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:129552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:129560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:129568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:129576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:129584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:129592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:129600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:129608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:129616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:129624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:129632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:129640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:129648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:129656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:129664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:129672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:129680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:129688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:129696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:129704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:129712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:129720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:129728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:129736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.764 [2024-11-28 15:23:29.684925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.764 [2024-11-28 15:23:29.684939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:129744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.764 [2024-11-28 15:23:29.684951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.684965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:129752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.684979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.684993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:129760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:129768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:129776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:129784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:129792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:129800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:129808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:129816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:129824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:129832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:129840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:129848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:129024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:129040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:129064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:129088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:129096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:129112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:129136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:129168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:129856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:129864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:129872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:129880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:129888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:129896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:129904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:129912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:129920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:129928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.685867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:129176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:129248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:129272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:129280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.685977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.685991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:129296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.686003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.686018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:129304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.686031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.686045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:129360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.686058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.686087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:129368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.765 [2024-11-28 15:23:29.686109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.765 [2024-11-28 15:23:29.686125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:129936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.765 [2024-11-28 15:23:29.686139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:129944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.766 [2024-11-28 15:23:29.686167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:129952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:129960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.766 [2024-11-28 15:23:29.686229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:129968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.766 [2024-11-28 15:23:29.686257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:129976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.766 [2024-11-28 15:23:29.686286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:129984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:129992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:130000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:129424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:129432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:129440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:129448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:129456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:129464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:129496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:29.686579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15bba90 is same with the state(5) to be set 00:28:40.766 [2024-11-28 15:23:29.686612] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:40.766 [2024-11-28 15:23:29.686624] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:40.766 [2024-11-28 15:23:29.686635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:129504 len:8 PRP1 0x0 PRP2 0x0 00:28:40.766 [2024-11-28 15:23:29.686647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686728] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15bba90 was disconnected and freed. reset controller. 00:28:40.766 [2024-11-28 15:23:29.686748] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:40.766 [2024-11-28 15:23:29.686783] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.766 [2024-11-28 15:23:29.686801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686815] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.766 [2024-11-28 15:23:29.686828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686842] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.766 [2024-11-28 15:23:29.686854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686868] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.766 [2024-11-28 15:23:29.686880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:29.686893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:40.766 [2024-11-28 15:23:29.689050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:40.766 [2024-11-28 15:23:29.689100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15af600 (9): Bad file descriptor 00:28:40.766 [2024-11-28 15:23:29.719161] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:40.766 [2024-11-28 15:23:34.256434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:85336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:85360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:85368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:85384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:85416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:85440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:85464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:85472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:85488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:85512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:85528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:85544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:85552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.766 [2024-11-28 15:23:34.256835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:84856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:84864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.766 [2024-11-28 15:23:34.256904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:84888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.766 [2024-11-28 15:23:34.256917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.256932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:84904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.256948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.256965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:84936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.256979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.256993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:85000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:85008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:85016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:85560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:85568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:85576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:85584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:85592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:85600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:85608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:85616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:85624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:85632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:85640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:85648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:85656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:85664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:85032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:85048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:85072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:85088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:85104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:85128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:85160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:85168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:85672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:85680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:85688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:85696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:85704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:85712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:85720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.257921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:85728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:85736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.257976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.257991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:85744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.258004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.258018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:85752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.258032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.258049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:85760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.767 [2024-11-28 15:23:34.258063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.767 [2024-11-28 15:23:34.258101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:85768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.767 [2024-11-28 15:23:34.258117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:85776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:85784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:85792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:85800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:85808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:85816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:85824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:85832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:85840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:85848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:85216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:85232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:85248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:85256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:85264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:85272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:85280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:85320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:85856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:85864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:85872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:85880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:85888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:85896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:85904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:85912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:85920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:85928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.258931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:85936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:85944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.768 [2024-11-28 15:23:34.258985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.258999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:85952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.259012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.259026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:85960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.259039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.768 [2024-11-28 15:23:34.259053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:85968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.768 [2024-11-28 15:23:34.259066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:85976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:85984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:85992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:86000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:86008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:86016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:86024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:86032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:86040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:86048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:86056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:86064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:86072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:86080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:86088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:86096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:86104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:86112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:86120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:86128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:40.769 [2024-11-28 15:23:34.259667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:86136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:86144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:86152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:85328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:85344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:85352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:85376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:85392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:85400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.769 [2024-11-28 15:23:34.259940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:85408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.769 [2024-11-28 15:23:34.259953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.259967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:85424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.259980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.259995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:85432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:85448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:85456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:85480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:85496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:85504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:85520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:40.770 [2024-11-28 15:23:34.260197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15d0c50 is same with the state(5) to be set 00:28:40.770 [2024-11-28 15:23:34.260228] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:40.770 [2024-11-28 15:23:34.260244] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:40.770 [2024-11-28 15:23:34.260257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:85536 len:8 PRP1 0x0 PRP2 0x0 00:28:40.770 [2024-11-28 15:23:34.260270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260329] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15d0c50 was disconnected and freed. reset controller. 00:28:40.770 [2024-11-28 15:23:34.260347] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:40.770 [2024-11-28 15:23:34.260386] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.770 [2024-11-28 15:23:34.260404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.770 [2024-11-28 15:23:34.260446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260462] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.770 [2024-11-28 15:23:34.260475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260488] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:40.770 [2024-11-28 15:23:34.260501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:40.770 [2024-11-28 15:23:34.260514] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:40.770 [2024-11-28 15:23:34.262766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:40.770 [2024-11-28 15:23:34.262806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15af600 (9): Bad file descriptor 00:28:40.770 [2024-11-28 15:23:34.411137] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:40.770 00:28:40.770 Latency(us) 00:28:40.770 [2024-11-28T14:23:41.004Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:40.770 [2024-11-28T14:23:41.004Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:40.770 Verification LBA range: start 0x0 length 0x4000 00:28:40.770 NVMe0n1 : 15.01 12732.31 49.74 899.50 0.00 9372.71 606.81 16990.81 00:28:40.770 [2024-11-28T14:23:41.004Z] =================================================================================================================== 00:28:40.770 [2024-11-28T14:23:41.004Z] Total : 12732.31 49.74 899.50 0.00 9372.71 606.81 16990.81 00:28:40.770 Received shutdown signal, test time was about 15.000000 seconds 00:28:40.770 00:28:40.770 Latency(us) 00:28:40.770 [2024-11-28T14:23:41.004Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:40.770 [2024-11-28T14:23:41.004Z] =================================================================================================================== 00:28:40.770 [2024-11-28T14:23:41.004Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:40.770 15:23:40 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:40.770 15:23:40 -- host/failover.sh@65 -- # count=3 00:28:40.770 15:23:40 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:40.770 15:23:40 -- host/failover.sh@73 -- # bdevperf_pid=819713 00:28:40.770 15:23:40 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:40.770 15:23:40 -- host/failover.sh@75 -- # waitforlisten 819713 /var/tmp/bdevperf.sock 00:28:40.770 15:23:40 -- common/autotest_common.sh@829 -- # '[' -z 819713 ']' 00:28:40.770 15:23:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:40.770 15:23:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:40.770 15:23:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:40.770 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:40.770 15:23:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:40.770 15:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:41.028 15:23:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:41.029 15:23:41 -- common/autotest_common.sh@862 -- # return 0 00:28:41.029 15:23:41 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:41.287 [2024-11-28 15:23:41.496481] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:41.287 15:23:41 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:41.546 [2024-11-28 15:23:41.753221] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:41.546 15:23:41 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:42.114 NVMe0n1 00:28:42.114 15:23:42 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:42.683 00:28:42.683 15:23:42 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:42.941 00:28:42.942 15:23:43 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:42.942 15:23:43 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:43.200 15:23:43 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:43.459 15:23:43 -- host/failover.sh@87 -- # sleep 3 00:28:46.750 15:23:46 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:46.750 15:23:46 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:46.750 15:23:46 -- host/failover.sh@90 -- # run_test_pid=820538 00:28:46.750 15:23:46 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:46.750 15:23:46 -- host/failover.sh@92 -- # wait 820538 00:28:47.687 0 00:28:47.946 15:23:47 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:47.946 [2024-11-28 15:23:40.211608] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:47.946 [2024-11-28 15:23:40.211699] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid819713 ] 00:28:47.946 EAL: No free 2048 kB hugepages reported on node 1 00:28:47.946 [2024-11-28 15:23:40.276913] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:47.946 [2024-11-28 15:23:40.361486] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:47.946 [2024-11-28 15:23:43.522479] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:47.946 [2024-11-28 15:23:43.522561] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:47.946 [2024-11-28 15:23:43.522584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:47.946 [2024-11-28 15:23:43.522615] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:47.946 [2024-11-28 15:23:43.522629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:47.946 [2024-11-28 15:23:43.522643] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:47.946 [2024-11-28 15:23:43.522656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:47.946 [2024-11-28 15:23:43.522669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:47.946 [2024-11-28 15:23:43.522684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:47.946 [2024-11-28 15:23:43.522697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:47.946 [2024-11-28 15:23:43.522734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:47.946 [2024-11-28 15:23:43.522765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x710600 (9): Bad file descriptor 00:28:47.946 [2024-11-28 15:23:43.534143] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:47.946 Running I/O for 1 seconds... 00:28:47.946 00:28:47.946 Latency(us) 00:28:47.946 [2024-11-28T14:23:48.180Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:47.946 [2024-11-28T14:23:48.180Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:47.946 Verification LBA range: start 0x0 length 0x4000 00:28:47.946 NVMe0n1 : 1.01 12899.47 50.39 0.00 0.00 9878.14 1407.81 12718.84 00:28:47.946 [2024-11-28T14:23:48.180Z] =================================================================================================================== 00:28:47.946 [2024-11-28T14:23:48.180Z] Total : 12899.47 50.39 0.00 0.00 9878.14 1407.81 12718.84 00:28:47.946 15:23:47 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:47.946 15:23:47 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:48.203 15:23:48 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:48.495 15:23:48 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:48.495 15:23:48 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:48.784 15:23:48 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:48.784 15:23:49 -- host/failover.sh@101 -- # sleep 3 00:28:52.073 15:23:52 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:52.073 15:23:52 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:52.073 15:23:52 -- host/failover.sh@108 -- # killprocess 819713 00:28:52.073 15:23:52 -- common/autotest_common.sh@936 -- # '[' -z 819713 ']' 00:28:52.073 15:23:52 -- common/autotest_common.sh@940 -- # kill -0 819713 00:28:52.073 15:23:52 -- common/autotest_common.sh@941 -- # uname 00:28:52.073 15:23:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:52.073 15:23:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 819713 00:28:52.331 15:23:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:52.331 15:23:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:52.331 15:23:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 819713' 00:28:52.331 killing process with pid 819713 00:28:52.331 15:23:52 -- common/autotest_common.sh@955 -- # kill 819713 00:28:52.331 15:23:52 -- common/autotest_common.sh@960 -- # wait 819713 00:28:52.331 15:23:52 -- host/failover.sh@110 -- # sync 00:28:52.331 15:23:52 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:52.590 15:23:52 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:52.590 15:23:52 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:52.590 15:23:52 -- host/failover.sh@116 -- # nvmftestfini 00:28:52.590 15:23:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:52.590 15:23:52 -- nvmf/common.sh@116 -- # sync 00:28:52.590 15:23:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:52.590 15:23:52 -- nvmf/common.sh@119 -- # set +e 00:28:52.590 15:23:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:52.590 15:23:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:52.590 rmmod nvme_tcp 00:28:52.590 rmmod nvme_fabrics 00:28:52.590 rmmod nvme_keyring 00:28:52.850 15:23:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:52.850 15:23:52 -- nvmf/common.sh@123 -- # set -e 00:28:52.850 15:23:52 -- nvmf/common.sh@124 -- # return 0 00:28:52.850 15:23:52 -- nvmf/common.sh@477 -- # '[' -n 817360 ']' 00:28:52.850 15:23:52 -- nvmf/common.sh@478 -- # killprocess 817360 00:28:52.850 15:23:52 -- common/autotest_common.sh@936 -- # '[' -z 817360 ']' 00:28:52.850 15:23:52 -- common/autotest_common.sh@940 -- # kill -0 817360 00:28:52.850 15:23:52 -- common/autotest_common.sh@941 -- # uname 00:28:52.850 15:23:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:52.850 15:23:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 817360 00:28:52.850 15:23:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:52.850 15:23:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:52.850 15:23:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 817360' 00:28:52.850 killing process with pid 817360 00:28:52.850 15:23:52 -- common/autotest_common.sh@955 -- # kill 817360 00:28:52.850 15:23:52 -- common/autotest_common.sh@960 -- # wait 817360 00:28:53.111 15:23:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:53.111 15:23:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:53.111 15:23:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:53.111 15:23:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:53.111 15:23:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:53.111 15:23:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:53.111 15:23:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:53.111 15:23:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:55.017 15:23:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:55.017 00:28:55.017 real 0m37.333s 00:28:55.017 user 2m12.526s 00:28:55.017 sys 0m5.912s 00:28:55.017 15:23:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:55.017 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:28:55.017 ************************************ 00:28:55.017 END TEST nvmf_failover 00:28:55.017 ************************************ 00:28:55.017 15:23:55 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:55.017 15:23:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:55.017 15:23:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:55.017 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:28:55.017 ************************************ 00:28:55.017 START TEST nvmf_discovery 00:28:55.017 ************************************ 00:28:55.017 15:23:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:55.275 * Looking for test storage... 00:28:55.275 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:55.275 15:23:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:55.275 15:23:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:55.275 15:23:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:55.275 15:23:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:55.275 15:23:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:55.275 15:23:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:55.275 15:23:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:55.276 15:23:55 -- scripts/common.sh@335 -- # IFS=.-: 00:28:55.276 15:23:55 -- scripts/common.sh@335 -- # read -ra ver1 00:28:55.276 15:23:55 -- scripts/common.sh@336 -- # IFS=.-: 00:28:55.276 15:23:55 -- scripts/common.sh@336 -- # read -ra ver2 00:28:55.276 15:23:55 -- scripts/common.sh@337 -- # local 'op=<' 00:28:55.276 15:23:55 -- scripts/common.sh@339 -- # ver1_l=2 00:28:55.276 15:23:55 -- scripts/common.sh@340 -- # ver2_l=1 00:28:55.276 15:23:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:55.276 15:23:55 -- scripts/common.sh@343 -- # case "$op" in 00:28:55.276 15:23:55 -- scripts/common.sh@344 -- # : 1 00:28:55.276 15:23:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:55.276 15:23:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:55.276 15:23:55 -- scripts/common.sh@364 -- # decimal 1 00:28:55.276 15:23:55 -- scripts/common.sh@352 -- # local d=1 00:28:55.276 15:23:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:55.276 15:23:55 -- scripts/common.sh@354 -- # echo 1 00:28:55.276 15:23:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:55.276 15:23:55 -- scripts/common.sh@365 -- # decimal 2 00:28:55.276 15:23:55 -- scripts/common.sh@352 -- # local d=2 00:28:55.276 15:23:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:55.276 15:23:55 -- scripts/common.sh@354 -- # echo 2 00:28:55.276 15:23:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:55.276 15:23:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:55.276 15:23:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:55.276 15:23:55 -- scripts/common.sh@367 -- # return 0 00:28:55.276 15:23:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:55.276 15:23:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:55.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.276 --rc genhtml_branch_coverage=1 00:28:55.276 --rc genhtml_function_coverage=1 00:28:55.276 --rc genhtml_legend=1 00:28:55.276 --rc geninfo_all_blocks=1 00:28:55.276 --rc geninfo_unexecuted_blocks=1 00:28:55.276 00:28:55.276 ' 00:28:55.276 15:23:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:55.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.276 --rc genhtml_branch_coverage=1 00:28:55.276 --rc genhtml_function_coverage=1 00:28:55.276 --rc genhtml_legend=1 00:28:55.276 --rc geninfo_all_blocks=1 00:28:55.276 --rc geninfo_unexecuted_blocks=1 00:28:55.276 00:28:55.276 ' 00:28:55.276 15:23:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:55.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.276 --rc genhtml_branch_coverage=1 00:28:55.276 --rc genhtml_function_coverage=1 00:28:55.276 --rc genhtml_legend=1 00:28:55.276 --rc geninfo_all_blocks=1 00:28:55.276 --rc geninfo_unexecuted_blocks=1 00:28:55.276 00:28:55.276 ' 00:28:55.276 15:23:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:55.276 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:55.276 --rc genhtml_branch_coverage=1 00:28:55.276 --rc genhtml_function_coverage=1 00:28:55.276 --rc genhtml_legend=1 00:28:55.276 --rc geninfo_all_blocks=1 00:28:55.276 --rc geninfo_unexecuted_blocks=1 00:28:55.276 00:28:55.276 ' 00:28:55.276 15:23:55 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:55.276 15:23:55 -- nvmf/common.sh@7 -- # uname -s 00:28:55.276 15:23:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:55.276 15:23:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:55.276 15:23:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:55.276 15:23:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:55.276 15:23:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:55.276 15:23:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:55.276 15:23:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:55.276 15:23:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:55.276 15:23:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:55.276 15:23:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:55.276 15:23:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:55.276 15:23:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:55.276 15:23:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:55.276 15:23:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:55.276 15:23:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:55.276 15:23:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:55.276 15:23:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:55.276 15:23:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:55.276 15:23:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:55.276 15:23:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.276 15:23:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.276 15:23:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.276 15:23:55 -- paths/export.sh@5 -- # export PATH 00:28:55.276 15:23:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:55.276 15:23:55 -- nvmf/common.sh@46 -- # : 0 00:28:55.276 15:23:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:55.276 15:23:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:55.276 15:23:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:55.276 15:23:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:55.276 15:23:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:55.276 15:23:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:55.276 15:23:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:55.276 15:23:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:55.276 15:23:55 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:55.276 15:23:55 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:55.276 15:23:55 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:55.276 15:23:55 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:55.276 15:23:55 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:55.276 15:23:55 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:55.276 15:23:55 -- host/discovery.sh@25 -- # nvmftestinit 00:28:55.276 15:23:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:55.276 15:23:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:55.276 15:23:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:55.276 15:23:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:55.276 15:23:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:55.276 15:23:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:55.276 15:23:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:55.276 15:23:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:55.276 15:23:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:55.276 15:23:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:55.276 15:23:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:55.276 15:23:55 -- common/autotest_common.sh@10 -- # set +x 00:28:57.179 15:23:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:57.179 15:23:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:57.179 15:23:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:57.179 15:23:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:57.179 15:23:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:57.179 15:23:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:57.179 15:23:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:57.179 15:23:57 -- nvmf/common.sh@294 -- # net_devs=() 00:28:57.179 15:23:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:57.179 15:23:57 -- nvmf/common.sh@295 -- # e810=() 00:28:57.179 15:23:57 -- nvmf/common.sh@295 -- # local -ga e810 00:28:57.179 15:23:57 -- nvmf/common.sh@296 -- # x722=() 00:28:57.179 15:23:57 -- nvmf/common.sh@296 -- # local -ga x722 00:28:57.179 15:23:57 -- nvmf/common.sh@297 -- # mlx=() 00:28:57.179 15:23:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:57.179 15:23:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:57.179 15:23:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:57.179 15:23:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:57.179 15:23:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:57.179 15:23:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:57.179 15:23:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:57.179 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:57.179 15:23:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:57.179 15:23:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:57.179 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:57.179 15:23:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:57.179 15:23:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:57.179 15:23:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:57.179 15:23:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:57.179 15:23:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:57.179 15:23:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:57.179 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:57.179 15:23:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:57.179 15:23:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:57.179 15:23:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:57.179 15:23:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:57.179 15:23:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:57.179 15:23:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:57.179 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:57.179 15:23:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:57.179 15:23:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:57.179 15:23:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:57.179 15:23:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:57.179 15:23:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:57.179 15:23:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:57.179 15:23:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:57.179 15:23:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:57.179 15:23:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:57.179 15:23:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:57.179 15:23:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:57.179 15:23:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:57.179 15:23:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:57.179 15:23:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:57.179 15:23:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:57.179 15:23:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:57.179 15:23:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:57.180 15:23:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:57.180 15:23:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:57.180 15:23:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:57.180 15:23:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:57.180 15:23:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:57.180 15:23:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:57.180 15:23:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:57.180 15:23:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:57.180 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:57.180 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:28:57.180 00:28:57.180 --- 10.0.0.2 ping statistics --- 00:28:57.180 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:57.180 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:28:57.180 15:23:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:57.438 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:57.438 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:28:57.438 00:28:57.438 --- 10.0.0.1 ping statistics --- 00:28:57.438 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:57.438 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:28:57.438 15:23:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:57.438 15:23:57 -- nvmf/common.sh@410 -- # return 0 00:28:57.438 15:23:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:57.438 15:23:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:57.438 15:23:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:57.438 15:23:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:57.438 15:23:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:57.438 15:23:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:57.438 15:23:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:57.438 15:23:57 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:57.438 15:23:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:57.438 15:23:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:57.438 15:23:57 -- common/autotest_common.sh@10 -- # set +x 00:28:57.438 15:23:57 -- nvmf/common.sh@469 -- # nvmfpid=823293 00:28:57.438 15:23:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:57.438 15:23:57 -- nvmf/common.sh@470 -- # waitforlisten 823293 00:28:57.438 15:23:57 -- common/autotest_common.sh@829 -- # '[' -z 823293 ']' 00:28:57.438 15:23:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:57.438 15:23:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:57.438 15:23:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:57.438 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:57.438 15:23:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:57.438 15:23:57 -- common/autotest_common.sh@10 -- # set +x 00:28:57.438 [2024-11-28 15:23:57.488276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:57.438 [2024-11-28 15:23:57.488351] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:57.438 EAL: No free 2048 kB hugepages reported on node 1 00:28:57.438 [2024-11-28 15:23:57.557195] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:57.438 [2024-11-28 15:23:57.643850] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:57.438 [2024-11-28 15:23:57.644025] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:57.438 [2024-11-28 15:23:57.644042] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:57.438 [2024-11-28 15:23:57.644054] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:57.438 [2024-11-28 15:23:57.644081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:58.377 15:23:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:58.377 15:23:58 -- common/autotest_common.sh@862 -- # return 0 00:28:58.377 15:23:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:58.377 15:23:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 15:23:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:58.377 15:23:58 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:58.377 15:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 [2024-11-28 15:23:58.528938] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:58.377 15:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.377 15:23:58 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:58.377 15:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 [2024-11-28 15:23:58.537112] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:58.377 15:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.377 15:23:58 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:58.377 15:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 null0 00:28:58.377 15:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.377 15:23:58 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:58.377 15:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 null1 00:28:58.377 15:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.377 15:23:58 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:58.377 15:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 15:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.377 15:23:58 -- host/discovery.sh@45 -- # hostpid=823450 00:28:58.377 15:23:58 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:58.377 15:23:58 -- host/discovery.sh@46 -- # waitforlisten 823450 /tmp/host.sock 00:28:58.377 15:23:58 -- common/autotest_common.sh@829 -- # '[' -z 823450 ']' 00:28:58.377 15:23:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:58.377 15:23:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:58.377 15:23:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:58.377 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:58.377 15:23:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:58.377 15:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:58.377 [2024-11-28 15:23:58.606539] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:28:58.377 [2024-11-28 15:23:58.606601] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid823450 ] 00:28:58.635 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.635 [2024-11-28 15:23:58.667942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:58.635 [2024-11-28 15:23:58.756714] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:58.635 [2024-11-28 15:23:58.756869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:59.572 15:23:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:59.572 15:23:59 -- common/autotest_common.sh@862 -- # return 0 00:28:59.572 15:23:59 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:59.572 15:23:59 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.572 15:23:59 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.572 15:23:59 -- host/discovery.sh@72 -- # notify_id=0 00:28:59.572 15:23:59 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # sort 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # xargs 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.572 15:23:59 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:59.572 15:23:59 -- host/discovery.sh@79 -- # get_bdev_list 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # sort 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # xargs 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.572 15:23:59 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:59.572 15:23:59 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.572 15:23:59 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # sort 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- host/discovery.sh@59 -- # xargs 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.572 15:23:59 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:59.572 15:23:59 -- host/discovery.sh@83 -- # get_bdev_list 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.572 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # sort 00:28:59.572 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.572 15:23:59 -- host/discovery.sh@55 -- # xargs 00:28:59.572 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:23:59 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:59.833 15:23:59 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:59.833 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:23:59 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:59.833 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # sort 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # xargs 00:28:59.833 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:23:59 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:59.833 15:23:59 -- host/discovery.sh@87 -- # get_bdev_list 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.833 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # sort 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # xargs 00:28:59.833 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:23:59 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:59.833 15:23:59 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:59.833 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 [2024-11-28 15:23:59.924909] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:59.833 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:23:59 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:59.833 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # sort 00:28:59.833 15:23:59 -- host/discovery.sh@59 -- # xargs 00:28:59.833 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:23:59 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:59.833 15:23:59 -- host/discovery.sh@93 -- # get_bdev_list 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.833 15:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # sort 00:28:59.833 15:23:59 -- host/discovery.sh@55 -- # xargs 00:28:59.833 15:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:24:00 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:59.833 15:24:00 -- host/discovery.sh@94 -- # get_notification_count 00:28:59.833 15:24:00 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:59.833 15:24:00 -- host/discovery.sh@74 -- # jq '. | length' 00:28:59.833 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:24:00 -- host/discovery.sh@74 -- # notification_count=0 00:28:59.833 15:24:00 -- host/discovery.sh@75 -- # notify_id=0 00:28:59.833 15:24:00 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:59.833 15:24:00 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:59.833 15:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.833 15:24:00 -- common/autotest_common.sh@10 -- # set +x 00:28:59.833 15:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.833 15:24:00 -- host/discovery.sh@100 -- # sleep 1 00:29:00.768 [2024-11-28 15:24:00.699762] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:00.768 [2024-11-28 15:24:00.699801] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:00.768 [2024-11-28 15:24:00.699829] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:00.768 [2024-11-28 15:24:00.827270] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:01.026 [2024-11-28 15:24:01.011462] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:01.026 [2024-11-28 15:24:01.011491] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:01.026 15:24:01 -- host/discovery.sh@101 -- # get_subsystem_names 00:29:01.026 15:24:01 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:01.026 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.026 15:24:01 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:01.026 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:29:01.026 15:24:01 -- host/discovery.sh@59 -- # sort 00:29:01.026 15:24:01 -- host/discovery.sh@59 -- # xargs 00:29:01.026 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@102 -- # get_bdev_list 00:29:01.026 15:24:01 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.026 15:24:01 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:01.026 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.026 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:29:01.026 15:24:01 -- host/discovery.sh@55 -- # sort 00:29:01.026 15:24:01 -- host/discovery.sh@55 -- # xargs 00:29:01.026 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:29:01.026 15:24:01 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:01.026 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.026 15:24:01 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:01.026 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:29:01.026 15:24:01 -- host/discovery.sh@63 -- # sort -n 00:29:01.026 15:24:01 -- host/discovery.sh@63 -- # xargs 00:29:01.026 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@104 -- # get_notification_count 00:29:01.026 15:24:01 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:29:01.026 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.026 15:24:01 -- host/discovery.sh@74 -- # jq '. | length' 00:29:01.026 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:29:01.026 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@74 -- # notification_count=1 00:29:01.026 15:24:01 -- host/discovery.sh@75 -- # notify_id=1 00:29:01.026 15:24:01 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:29:01.026 15:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.026 15:24:01 -- common/autotest_common.sh@10 -- # set +x 00:29:01.026 15:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.026 15:24:01 -- host/discovery.sh@109 -- # sleep 1 00:29:02.406 15:24:02 -- host/discovery.sh@110 -- # get_bdev_list 00:29:02.406 15:24:02 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.406 15:24:02 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:02.406 15:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.406 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:29:02.406 15:24:02 -- host/discovery.sh@55 -- # sort 00:29:02.406 15:24:02 -- host/discovery.sh@55 -- # xargs 00:29:02.406 15:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.406 15:24:02 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:02.406 15:24:02 -- host/discovery.sh@111 -- # get_notification_count 00:29:02.406 15:24:02 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:29:02.406 15:24:02 -- host/discovery.sh@74 -- # jq '. | length' 00:29:02.406 15:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.406 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:29:02.406 15:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.406 15:24:02 -- host/discovery.sh@74 -- # notification_count=1 00:29:02.406 15:24:02 -- host/discovery.sh@75 -- # notify_id=2 00:29:02.406 15:24:02 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:29:02.406 15:24:02 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:29:02.406 15:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.406 15:24:02 -- common/autotest_common.sh@10 -- # set +x 00:29:02.406 [2024-11-28 15:24:02.312431] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:29:02.406 [2024-11-28 15:24:02.312915] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:02.406 [2024-11-28 15:24:02.312958] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:02.406 15:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.406 15:24:02 -- host/discovery.sh@117 -- # sleep 1 00:29:02.406 [2024-11-28 15:24:02.442338] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:29:02.406 [2024-11-28 15:24:02.544056] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:02.406 [2024-11-28 15:24:02.544082] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:02.406 [2024-11-28 15:24:02.544102] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:03.349 15:24:03 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:03.349 15:24:03 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:03.349 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.349 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:03.349 15:24:03 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:03.349 15:24:03 -- host/discovery.sh@59 -- # sort 00:29:03.349 15:24:03 -- host/discovery.sh@59 -- # xargs 00:29:03.349 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.349 15:24:03 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:03.349 15:24:03 -- host/discovery.sh@119 -- # get_bdev_list 00:29:03.349 15:24:03 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.349 15:24:03 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:03.350 15:24:03 -- host/discovery.sh@55 -- # sort 00:29:03.350 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.350 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:03.350 15:24:03 -- host/discovery.sh@55 -- # xargs 00:29:03.350 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:03.350 15:24:03 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:03.350 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.350 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:03.350 15:24:03 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:03.350 15:24:03 -- host/discovery.sh@63 -- # sort -n 00:29:03.350 15:24:03 -- host/discovery.sh@63 -- # xargs 00:29:03.350 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@121 -- # get_notification_count 00:29:03.350 15:24:03 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:03.350 15:24:03 -- host/discovery.sh@74 -- # jq '. | length' 00:29:03.350 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.350 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:03.350 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@74 -- # notification_count=0 00:29:03.350 15:24:03 -- host/discovery.sh@75 -- # notify_id=2 00:29:03.350 15:24:03 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:03.350 15:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.350 15:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:03.350 [2024-11-28 15:24:03.480605] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:03.350 [2024-11-28 15:24:03.480648] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:03.350 15:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.350 15:24:03 -- host/discovery.sh@127 -- # sleep 1 00:29:03.350 [2024-11-28 15:24:03.484529] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.350 [2024-11-28 15:24:03.484563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.350 [2024-11-28 15:24:03.484581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.350 [2024-11-28 15:24:03.484597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.350 [2024-11-28 15:24:03.484612] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.350 [2024-11-28 15:24:03.484642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.350 [2024-11-28 15:24:03.484656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:03.350 [2024-11-28 15:24:03.484669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:03.350 [2024-11-28 15:24:03.484682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.494533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.504581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.504768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.504888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.504917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.350 [2024-11-28 15:24:03.504936] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.504962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.504999] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.350 [2024-11-28 15:24:03.505019] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.350 [2024-11-28 15:24:03.505036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.350 [2024-11-28 15:24:03.505059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.350 [2024-11-28 15:24:03.514671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.514888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.515009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.515035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.350 [2024-11-28 15:24:03.515051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.515073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.515130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.350 [2024-11-28 15:24:03.515150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.350 [2024-11-28 15:24:03.515179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.350 [2024-11-28 15:24:03.515201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.350 [2024-11-28 15:24:03.524749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.524917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.525026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.525052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.350 [2024-11-28 15:24:03.525068] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.525105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.525129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.350 [2024-11-28 15:24:03.525143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.350 [2024-11-28 15:24:03.525156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.350 [2024-11-28 15:24:03.525222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.350 [2024-11-28 15:24:03.534830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.535021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.535140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.535168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.350 [2024-11-28 15:24:03.535184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.535206] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.535248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.350 [2024-11-28 15:24:03.535268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.350 [2024-11-28 15:24:03.535281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.350 [2024-11-28 15:24:03.535300] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.350 [2024-11-28 15:24:03.544909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.545062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.545190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.545217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.350 [2024-11-28 15:24:03.545233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.545255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.545287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.350 [2024-11-28 15:24:03.545305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.350 [2024-11-28 15:24:03.545318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.350 [2024-11-28 15:24:03.545337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.350 [2024-11-28 15:24:03.554987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.555174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.555286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.350 [2024-11-28 15:24:03.555313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.350 [2024-11-28 15:24:03.555328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.350 [2024-11-28 15:24:03.555351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.350 [2024-11-28 15:24:03.555394] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.350 [2024-11-28 15:24:03.555414] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.350 [2024-11-28 15:24:03.555443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.350 [2024-11-28 15:24:03.555466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.350 [2024-11-28 15:24:03.565063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.350 [2024-11-28 15:24:03.565280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.351 [2024-11-28 15:24:03.565367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:03.351 [2024-11-28 15:24:03.565402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fa0b80 with addr=10.0.0.2, port=4420 00:29:03.351 [2024-11-28 15:24:03.565419] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0b80 is same with the state(5) to be set 00:29:03.351 [2024-11-28 15:24:03.565441] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fa0b80 (9): Bad file descriptor 00:29:03.351 [2024-11-28 15:24:03.565473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:03.351 [2024-11-28 15:24:03.565491] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:03.351 [2024-11-28 15:24:03.565504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:03.351 [2024-11-28 15:24:03.565523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:03.351 [2024-11-28 15:24:03.567470] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:03.351 [2024-11-28 15:24:03.567510] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:04.285 15:24:04 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:04.285 15:24:04 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:04.285 15:24:04 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:04.285 15:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.285 15:24:04 -- host/discovery.sh@59 -- # sort 00:29:04.285 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:04.285 15:24:04 -- host/discovery.sh@59 -- # xargs 00:29:04.285 15:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@129 -- # get_bdev_list 00:29:04.543 15:24:04 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.543 15:24:04 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:04.543 15:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.543 15:24:04 -- host/discovery.sh@55 -- # sort 00:29:04.543 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:04.543 15:24:04 -- host/discovery.sh@55 -- # xargs 00:29:04.543 15:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:04.543 15:24:04 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:04.543 15:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.543 15:24:04 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:04.543 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:04.543 15:24:04 -- host/discovery.sh@63 -- # sort -n 00:29:04.543 15:24:04 -- host/discovery.sh@63 -- # xargs 00:29:04.543 15:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@131 -- # get_notification_count 00:29:04.543 15:24:04 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:04.543 15:24:04 -- host/discovery.sh@74 -- # jq '. | length' 00:29:04.543 15:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.543 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:04.543 15:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@74 -- # notification_count=0 00:29:04.543 15:24:04 -- host/discovery.sh@75 -- # notify_id=2 00:29:04.543 15:24:04 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:04.543 15:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.543 15:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:04.543 15:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.543 15:24:04 -- host/discovery.sh@135 -- # sleep 1 00:29:05.480 15:24:05 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:05.480 15:24:05 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:05.480 15:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.480 15:24:05 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:05.480 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:29:05.480 15:24:05 -- host/discovery.sh@59 -- # sort 00:29:05.480 15:24:05 -- host/discovery.sh@59 -- # xargs 00:29:05.480 15:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.737 15:24:05 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:05.737 15:24:05 -- host/discovery.sh@137 -- # get_bdev_list 00:29:05.737 15:24:05 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.737 15:24:05 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:05.737 15:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.737 15:24:05 -- host/discovery.sh@55 -- # sort 00:29:05.737 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:29:05.737 15:24:05 -- host/discovery.sh@55 -- # xargs 00:29:05.737 15:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.737 15:24:05 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:05.737 15:24:05 -- host/discovery.sh@138 -- # get_notification_count 00:29:05.737 15:24:05 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:05.737 15:24:05 -- host/discovery.sh@74 -- # jq '. | length' 00:29:05.737 15:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.737 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:29:05.737 15:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.737 15:24:05 -- host/discovery.sh@74 -- # notification_count=2 00:29:05.737 15:24:05 -- host/discovery.sh@75 -- # notify_id=4 00:29:05.737 15:24:05 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:05.737 15:24:05 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:05.737 15:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.737 15:24:05 -- common/autotest_common.sh@10 -- # set +x 00:29:06.675 [2024-11-28 15:24:06.864773] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:06.675 [2024-11-28 15:24:06.864811] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:06.675 [2024-11-28 15:24:06.864839] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:06.934 [2024-11-28 15:24:06.993267] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:07.193 [2024-11-28 15:24:07.259870] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:07.193 [2024-11-28 15:24:07.259915] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:07.193 15:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.193 15:24:07 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.193 15:24:07 -- common/autotest_common.sh@650 -- # local es=0 00:29:07.193 15:24:07 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.193 15:24:07 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:07.193 15:24:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:07.193 15:24:07 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:07.193 15:24:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:07.193 15:24:07 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.193 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.193 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:07.193 request: 00:29:07.193 { 00:29:07.193 "name": "nvme", 00:29:07.193 "trtype": "tcp", 00:29:07.193 "traddr": "10.0.0.2", 00:29:07.193 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:07.193 "adrfam": "ipv4", 00:29:07.193 "trsvcid": "8009", 00:29:07.193 "wait_for_attach": true, 00:29:07.193 "method": "bdev_nvme_start_discovery", 00:29:07.193 "req_id": 1 00:29:07.193 } 00:29:07.193 Got JSON-RPC error response 00:29:07.193 response: 00:29:07.193 { 00:29:07.193 "code": -17, 00:29:07.193 "message": "File exists" 00:29:07.193 } 00:29:07.193 15:24:07 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:07.193 15:24:07 -- common/autotest_common.sh@653 -- # es=1 00:29:07.193 15:24:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:07.193 15:24:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:07.193 15:24:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:07.193 15:24:07 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:07.193 15:24:07 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:07.193 15:24:07 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:07.193 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.194 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:07.194 15:24:07 -- host/discovery.sh@67 -- # sort 00:29:07.194 15:24:07 -- host/discovery.sh@67 -- # xargs 00:29:07.194 15:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.194 15:24:07 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:07.194 15:24:07 -- host/discovery.sh@147 -- # get_bdev_list 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.194 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:07.194 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # sort 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # xargs 00:29:07.194 15:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.194 15:24:07 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:07.194 15:24:07 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.194 15:24:07 -- common/autotest_common.sh@650 -- # local es=0 00:29:07.194 15:24:07 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.194 15:24:07 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:07.194 15:24:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:07.194 15:24:07 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:07.194 15:24:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:07.194 15:24:07 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:07.194 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.194 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:07.194 request: 00:29:07.194 { 00:29:07.194 "name": "nvme_second", 00:29:07.194 "trtype": "tcp", 00:29:07.194 "traddr": "10.0.0.2", 00:29:07.194 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:07.194 "adrfam": "ipv4", 00:29:07.194 "trsvcid": "8009", 00:29:07.194 "wait_for_attach": true, 00:29:07.194 "method": "bdev_nvme_start_discovery", 00:29:07.194 "req_id": 1 00:29:07.194 } 00:29:07.194 Got JSON-RPC error response 00:29:07.194 response: 00:29:07.194 { 00:29:07.194 "code": -17, 00:29:07.194 "message": "File exists" 00:29:07.194 } 00:29:07.194 15:24:07 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:07.194 15:24:07 -- common/autotest_common.sh@653 -- # es=1 00:29:07.194 15:24:07 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:07.194 15:24:07 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:07.194 15:24:07 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:07.194 15:24:07 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:07.194 15:24:07 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:07.194 15:24:07 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:07.194 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.194 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:07.194 15:24:07 -- host/discovery.sh@67 -- # sort 00:29:07.194 15:24:07 -- host/discovery.sh@67 -- # xargs 00:29:07.194 15:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.194 15:24:07 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:07.194 15:24:07 -- host/discovery.sh@153 -- # get_bdev_list 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.194 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:07.194 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # sort 00:29:07.194 15:24:07 -- host/discovery.sh@55 -- # xargs 00:29:07.194 15:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.453 15:24:07 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:07.453 15:24:07 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:07.453 15:24:07 -- common/autotest_common.sh@650 -- # local es=0 00:29:07.453 15:24:07 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:07.453 15:24:07 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:07.453 15:24:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:07.453 15:24:07 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:07.453 15:24:07 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:07.453 15:24:07 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:07.453 15:24:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.453 15:24:07 -- common/autotest_common.sh@10 -- # set +x 00:29:08.389 [2024-11-28 15:24:08.456317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:08.389 [2024-11-28 15:24:08.456512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:08.389 [2024-11-28 15:24:08.456557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fd83c0 with addr=10.0.0.2, port=8010 00:29:08.389 [2024-11-28 15:24:08.456588] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:08.389 [2024-11-28 15:24:08.456603] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:08.389 [2024-11-28 15:24:08.456616] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:09.323 [2024-11-28 15:24:09.458808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.323 [2024-11-28 15:24:09.458970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:09.323 [2024-11-28 15:24:09.458997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fd83c0 with addr=10.0.0.2, port=8010 00:29:09.323 [2024-11-28 15:24:09.459028] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:09.323 [2024-11-28 15:24:09.459044] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:09.323 [2024-11-28 15:24:09.459057] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:10.257 [2024-11-28 15:24:10.460936] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:10.257 request: 00:29:10.257 { 00:29:10.257 "name": "nvme_second", 00:29:10.257 "trtype": "tcp", 00:29:10.257 "traddr": "10.0.0.2", 00:29:10.257 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:10.257 "adrfam": "ipv4", 00:29:10.257 "trsvcid": "8010", 00:29:10.257 "attach_timeout_ms": 3000, 00:29:10.257 "method": "bdev_nvme_start_discovery", 00:29:10.257 "req_id": 1 00:29:10.257 } 00:29:10.257 Got JSON-RPC error response 00:29:10.257 response: 00:29:10.257 { 00:29:10.257 "code": -110, 00:29:10.257 "message": "Connection timed out" 00:29:10.257 } 00:29:10.257 15:24:10 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:10.257 15:24:10 -- common/autotest_common.sh@653 -- # es=1 00:29:10.257 15:24:10 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:10.257 15:24:10 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:10.257 15:24:10 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:10.257 15:24:10 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:10.257 15:24:10 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:10.257 15:24:10 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:10.257 15:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:10.258 15:24:10 -- host/discovery.sh@67 -- # sort 00:29:10.258 15:24:10 -- common/autotest_common.sh@10 -- # set +x 00:29:10.258 15:24:10 -- host/discovery.sh@67 -- # xargs 00:29:10.258 15:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:10.515 15:24:10 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:10.515 15:24:10 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:10.515 15:24:10 -- host/discovery.sh@162 -- # kill 823450 00:29:10.515 15:24:10 -- host/discovery.sh@163 -- # nvmftestfini 00:29:10.515 15:24:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:10.515 15:24:10 -- nvmf/common.sh@116 -- # sync 00:29:10.515 15:24:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:10.515 15:24:10 -- nvmf/common.sh@119 -- # set +e 00:29:10.515 15:24:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:10.515 15:24:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:10.516 rmmod nvme_tcp 00:29:10.516 rmmod nvme_fabrics 00:29:10.516 rmmod nvme_keyring 00:29:10.516 15:24:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:10.516 15:24:10 -- nvmf/common.sh@123 -- # set -e 00:29:10.516 15:24:10 -- nvmf/common.sh@124 -- # return 0 00:29:10.516 15:24:10 -- nvmf/common.sh@477 -- # '[' -n 823293 ']' 00:29:10.516 15:24:10 -- nvmf/common.sh@478 -- # killprocess 823293 00:29:10.516 15:24:10 -- common/autotest_common.sh@936 -- # '[' -z 823293 ']' 00:29:10.516 15:24:10 -- common/autotest_common.sh@940 -- # kill -0 823293 00:29:10.516 15:24:10 -- common/autotest_common.sh@941 -- # uname 00:29:10.516 15:24:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:10.516 15:24:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 823293 00:29:10.516 15:24:10 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:10.516 15:24:10 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:10.516 15:24:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 823293' 00:29:10.516 killing process with pid 823293 00:29:10.516 15:24:10 -- common/autotest_common.sh@955 -- # kill 823293 00:29:10.516 15:24:10 -- common/autotest_common.sh@960 -- # wait 823293 00:29:10.774 15:24:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:10.774 15:24:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:10.774 15:24:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:10.774 15:24:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:10.774 15:24:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:10.774 15:24:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:10.774 15:24:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:10.774 15:24:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:12.676 15:24:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:12.676 00:29:12.676 real 0m17.677s 00:29:12.676 user 0m27.598s 00:29:12.676 sys 0m2.909s 00:29:12.676 15:24:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:12.676 15:24:12 -- common/autotest_common.sh@10 -- # set +x 00:29:12.676 ************************************ 00:29:12.676 END TEST nvmf_discovery 00:29:12.676 ************************************ 00:29:12.934 15:24:12 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:12.934 15:24:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:12.934 15:24:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:12.934 15:24:12 -- common/autotest_common.sh@10 -- # set +x 00:29:12.934 ************************************ 00:29:12.934 START TEST nvmf_discovery_remove_ifc 00:29:12.934 ************************************ 00:29:12.934 15:24:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:12.934 * Looking for test storage... 00:29:12.934 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:12.934 15:24:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:12.934 15:24:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:12.934 15:24:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:12.934 15:24:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:12.934 15:24:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:12.934 15:24:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:12.934 15:24:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:12.934 15:24:13 -- scripts/common.sh@335 -- # IFS=.-: 00:29:12.934 15:24:13 -- scripts/common.sh@335 -- # read -ra ver1 00:29:12.934 15:24:13 -- scripts/common.sh@336 -- # IFS=.-: 00:29:12.934 15:24:13 -- scripts/common.sh@336 -- # read -ra ver2 00:29:12.934 15:24:13 -- scripts/common.sh@337 -- # local 'op=<' 00:29:12.934 15:24:13 -- scripts/common.sh@339 -- # ver1_l=2 00:29:12.934 15:24:13 -- scripts/common.sh@340 -- # ver2_l=1 00:29:12.934 15:24:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:12.934 15:24:13 -- scripts/common.sh@343 -- # case "$op" in 00:29:12.934 15:24:13 -- scripts/common.sh@344 -- # : 1 00:29:12.934 15:24:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:12.934 15:24:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:12.934 15:24:13 -- scripts/common.sh@364 -- # decimal 1 00:29:12.934 15:24:13 -- scripts/common.sh@352 -- # local d=1 00:29:12.934 15:24:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:12.934 15:24:13 -- scripts/common.sh@354 -- # echo 1 00:29:12.934 15:24:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:12.934 15:24:13 -- scripts/common.sh@365 -- # decimal 2 00:29:12.934 15:24:13 -- scripts/common.sh@352 -- # local d=2 00:29:12.934 15:24:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:12.934 15:24:13 -- scripts/common.sh@354 -- # echo 2 00:29:12.934 15:24:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:12.934 15:24:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:12.934 15:24:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:12.934 15:24:13 -- scripts/common.sh@367 -- # return 0 00:29:12.934 15:24:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:12.934 15:24:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:12.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:12.934 --rc genhtml_branch_coverage=1 00:29:12.934 --rc genhtml_function_coverage=1 00:29:12.934 --rc genhtml_legend=1 00:29:12.934 --rc geninfo_all_blocks=1 00:29:12.934 --rc geninfo_unexecuted_blocks=1 00:29:12.934 00:29:12.934 ' 00:29:12.934 15:24:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:12.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:12.934 --rc genhtml_branch_coverage=1 00:29:12.934 --rc genhtml_function_coverage=1 00:29:12.934 --rc genhtml_legend=1 00:29:12.934 --rc geninfo_all_blocks=1 00:29:12.934 --rc geninfo_unexecuted_blocks=1 00:29:12.934 00:29:12.934 ' 00:29:12.934 15:24:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:12.934 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:12.934 --rc genhtml_branch_coverage=1 00:29:12.934 --rc genhtml_function_coverage=1 00:29:12.934 --rc genhtml_legend=1 00:29:12.935 --rc geninfo_all_blocks=1 00:29:12.935 --rc geninfo_unexecuted_blocks=1 00:29:12.935 00:29:12.935 ' 00:29:12.935 15:24:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:12.935 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:12.935 --rc genhtml_branch_coverage=1 00:29:12.935 --rc genhtml_function_coverage=1 00:29:12.935 --rc genhtml_legend=1 00:29:12.935 --rc geninfo_all_blocks=1 00:29:12.935 --rc geninfo_unexecuted_blocks=1 00:29:12.935 00:29:12.935 ' 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:12.935 15:24:13 -- nvmf/common.sh@7 -- # uname -s 00:29:12.935 15:24:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:12.935 15:24:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:12.935 15:24:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:12.935 15:24:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:12.935 15:24:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:12.935 15:24:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:12.935 15:24:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:12.935 15:24:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:12.935 15:24:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:12.935 15:24:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:12.935 15:24:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:12.935 15:24:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:12.935 15:24:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:12.935 15:24:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:12.935 15:24:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:12.935 15:24:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:12.935 15:24:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:12.935 15:24:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:12.935 15:24:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:12.935 15:24:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:12.935 15:24:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:12.935 15:24:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:12.935 15:24:13 -- paths/export.sh@5 -- # export PATH 00:29:12.935 15:24:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:12.935 15:24:13 -- nvmf/common.sh@46 -- # : 0 00:29:12.935 15:24:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:12.935 15:24:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:12.935 15:24:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:12.935 15:24:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:12.935 15:24:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:12.935 15:24:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:12.935 15:24:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:12.935 15:24:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:12.935 15:24:13 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:12.935 15:24:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:12.935 15:24:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:12.935 15:24:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:12.935 15:24:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:12.935 15:24:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:12.935 15:24:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:12.935 15:24:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:12.935 15:24:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:12.935 15:24:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:12.935 15:24:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:12.935 15:24:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:12.935 15:24:13 -- common/autotest_common.sh@10 -- # set +x 00:29:14.838 15:24:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:14.838 15:24:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:14.838 15:24:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:14.838 15:24:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:14.838 15:24:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:14.838 15:24:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:14.838 15:24:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:14.838 15:24:15 -- nvmf/common.sh@294 -- # net_devs=() 00:29:14.838 15:24:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:14.838 15:24:15 -- nvmf/common.sh@295 -- # e810=() 00:29:14.838 15:24:15 -- nvmf/common.sh@295 -- # local -ga e810 00:29:14.838 15:24:15 -- nvmf/common.sh@296 -- # x722=() 00:29:14.838 15:24:15 -- nvmf/common.sh@296 -- # local -ga x722 00:29:14.838 15:24:15 -- nvmf/common.sh@297 -- # mlx=() 00:29:14.838 15:24:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:14.838 15:24:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:14.838 15:24:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:14.838 15:24:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:14.838 15:24:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:14.838 15:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:14.838 15:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:14.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:14.838 15:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:14.838 15:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:14.838 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:14.838 15:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:14.838 15:24:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:14.838 15:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:14.838 15:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:15.096 15:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:15.096 15:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:15.096 15:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:15.096 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:15.096 15:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:15.096 15:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:15.096 15:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:15.096 15:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:15.096 15:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:15.096 15:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:15.096 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:15.096 15:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:15.096 15:24:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:15.096 15:24:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:15.096 15:24:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:15.096 15:24:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:15.096 15:24:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:15.096 15:24:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:15.096 15:24:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:15.096 15:24:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:15.096 15:24:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:15.096 15:24:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:15.096 15:24:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:15.096 15:24:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:15.096 15:24:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:15.096 15:24:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:15.096 15:24:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:15.096 15:24:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:15.096 15:24:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:15.096 15:24:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:15.096 15:24:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:15.096 15:24:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:15.096 15:24:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:15.096 15:24:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:15.096 15:24:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:15.096 15:24:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:15.096 15:24:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:15.096 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:15.096 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:29:15.096 00:29:15.096 --- 10.0.0.2 ping statistics --- 00:29:15.096 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:15.096 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:29:15.096 15:24:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:15.096 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:15.096 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.179 ms 00:29:15.096 00:29:15.096 --- 10.0.0.1 ping statistics --- 00:29:15.096 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:15.096 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:29:15.096 15:24:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:15.096 15:24:15 -- nvmf/common.sh@410 -- # return 0 00:29:15.096 15:24:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:15.096 15:24:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:15.096 15:24:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:15.096 15:24:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:15.096 15:24:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:15.096 15:24:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:15.096 15:24:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:15.096 15:24:15 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:15.096 15:24:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:15.096 15:24:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:15.096 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:29:15.096 15:24:15 -- nvmf/common.sh@469 -- # nvmfpid=827553 00:29:15.096 15:24:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:15.096 15:24:15 -- nvmf/common.sh@470 -- # waitforlisten 827553 00:29:15.096 15:24:15 -- common/autotest_common.sh@829 -- # '[' -z 827553 ']' 00:29:15.096 15:24:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:15.096 15:24:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:15.096 15:24:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:15.096 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:15.096 15:24:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:15.096 15:24:15 -- common/autotest_common.sh@10 -- # set +x 00:29:15.096 [2024-11-28 15:24:15.258544] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:15.096 [2024-11-28 15:24:15.258613] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:15.096 EAL: No free 2048 kB hugepages reported on node 1 00:29:15.096 [2024-11-28 15:24:15.320624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:15.353 [2024-11-28 15:24:15.407392] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:15.353 [2024-11-28 15:24:15.407562] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:15.353 [2024-11-28 15:24:15.407580] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:15.353 [2024-11-28 15:24:15.407591] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:15.353 [2024-11-28 15:24:15.407618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:16.287 15:24:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:16.287 15:24:16 -- common/autotest_common.sh@862 -- # return 0 00:29:16.287 15:24:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:16.287 15:24:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:16.287 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:16.287 15:24:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:16.287 15:24:16 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:16.287 15:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.287 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:16.287 [2024-11-28 15:24:16.315563] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:16.287 [2024-11-28 15:24:16.323737] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:16.287 null0 00:29:16.287 [2024-11-28 15:24:16.355719] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:16.287 15:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.287 15:24:16 -- host/discovery_remove_ifc.sh@59 -- # hostpid=827706 00:29:16.287 15:24:16 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:16.287 15:24:16 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 827706 /tmp/host.sock 00:29:16.287 15:24:16 -- common/autotest_common.sh@829 -- # '[' -z 827706 ']' 00:29:16.287 15:24:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:16.287 15:24:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:16.287 15:24:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:16.287 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:16.287 15:24:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:16.287 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:16.287 [2024-11-28 15:24:16.417065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:16.287 [2024-11-28 15:24:16.417161] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid827706 ] 00:29:16.287 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.287 [2024-11-28 15:24:16.478589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:16.546 [2024-11-28 15:24:16.569974] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:16.546 [2024-11-28 15:24:16.570188] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:16.546 15:24:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:16.546 15:24:16 -- common/autotest_common.sh@862 -- # return 0 00:29:16.546 15:24:16 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:16.546 15:24:16 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:16.546 15:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.546 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:16.546 15:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.546 15:24:16 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:16.546 15:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.546 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:16.546 15:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.546 15:24:16 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:16.546 15:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.546 15:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:17.920 [2024-11-28 15:24:17.803240] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:17.920 [2024-11-28 15:24:17.803271] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:17.920 [2024-11-28 15:24:17.803297] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:17.920 [2024-11-28 15:24:17.891616] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:17.920 [2024-11-28 15:24:18.074828] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:17.920 [2024-11-28 15:24:18.074892] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:17.920 [2024-11-28 15:24:18.074938] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:17.920 [2024-11-28 15:24:18.074969] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:17.920 [2024-11-28 15:24:18.074998] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:17.920 15:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:17.920 15:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.920 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:17.920 [2024-11-28 15:24:18.081702] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x9dc4b0 was disconnected and freed. delete nvme_qpair. 00:29:17.920 15:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:17.920 15:24:18 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:18.178 15:24:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.178 15:24:18 -- common/autotest_common.sh@10 -- # set +x 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:18.178 15:24:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:18.178 15:24:18 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:19.113 15:24:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.113 15:24:19 -- common/autotest_common.sh@10 -- # set +x 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:19.113 15:24:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:19.113 15:24:19 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:20.048 15:24:20 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.048 15:24:20 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.048 15:24:20 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.048 15:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.048 15:24:20 -- common/autotest_common.sh@10 -- # set +x 00:29:20.048 15:24:20 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.048 15:24:20 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.048 15:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.306 15:24:20 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:20.306 15:24:20 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.262 15:24:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:21.262 15:24:21 -- common/autotest_common.sh@10 -- # set +x 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:21.262 15:24:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:21.262 15:24:21 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:22.202 15:24:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:22.202 15:24:22 -- common/autotest_common.sh@10 -- # set +x 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:22.202 15:24:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:22.202 15:24:22 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.594 15:24:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.594 15:24:23 -- common/autotest_common.sh@10 -- # set +x 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.594 15:24:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:23.594 15:24:23 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.594 [2024-11-28 15:24:23.516019] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:23.594 [2024-11-28 15:24:23.516087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.594 [2024-11-28 15:24:23.516120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.594 [2024-11-28 15:24:23.516164] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.594 [2024-11-28 15:24:23.516178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.594 [2024-11-28 15:24:23.516191] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.594 [2024-11-28 15:24:23.516203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.594 [2024-11-28 15:24:23.516216] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.594 [2024-11-28 15:24:23.516229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.594 [2024-11-28 15:24:23.516242] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:23.594 [2024-11-28 15:24:23.516254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:23.595 [2024-11-28 15:24:23.516267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3790 is same with the state(5) to be set 00:29:23.595 [2024-11-28 15:24:23.526043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3790 (9): Bad file descriptor 00:29:23.595 [2024-11-28 15:24:23.536114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:24.201 15:24:24 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:24.201 15:24:24 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.201 15:24:24 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:24.201 15:24:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.201 15:24:24 -- common/autotest_common.sh@10 -- # set +x 00:29:24.201 15:24:24 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:24.201 15:24:24 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:24.459 [2024-11-28 15:24:24.587171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:25.397 [2024-11-28 15:24:25.611164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:25.397 [2024-11-28 15:24:25.611229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x9a3790 with addr=10.0.0.2, port=4420 00:29:25.397 [2024-11-28 15:24:25.611257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x9a3790 is same with the state(5) to be set 00:29:25.397 [2024-11-28 15:24:25.611296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:25.397 [2024-11-28 15:24:25.611315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:25.397 [2024-11-28 15:24:25.611329] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:25.397 [2024-11-28 15:24:25.611345] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:25.397 [2024-11-28 15:24:25.611802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a3790 (9): Bad file descriptor 00:29:25.397 [2024-11-28 15:24:25.611849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:25.397 [2024-11-28 15:24:25.611897] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:25.397 [2024-11-28 15:24:25.611938] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.397 [2024-11-28 15:24:25.611964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.397 [2024-11-28 15:24:25.611985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.397 [2024-11-28 15:24:25.612001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.397 [2024-11-28 15:24:25.612017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.397 [2024-11-28 15:24:25.612032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.397 [2024-11-28 15:24:25.612048] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.397 [2024-11-28 15:24:25.612063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.397 [2024-11-28 15:24:25.612079] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:25.397 [2024-11-28 15:24:25.612108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:25.397 [2024-11-28 15:24:25.612142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:25.397 [2024-11-28 15:24:25.612295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x9a2c40 (9): Bad file descriptor 00:29:25.397 [2024-11-28 15:24:25.613317] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:25.397 [2024-11-28 15:24:25.613341] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:25.397 15:24:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:25.397 15:24:25 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:25.397 15:24:25 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:26.772 15:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.772 15:24:26 -- common/autotest_common.sh@10 -- # set +x 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:26.772 15:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:26.772 15:24:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.772 15:24:26 -- common/autotest_common.sh@10 -- # set +x 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:26.772 15:24:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:26.772 15:24:26 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:27.706 [2024-11-28 15:24:27.670729] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:27.706 [2024-11-28 15:24:27.670759] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:27.706 [2024-11-28 15:24:27.670786] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:27.706 15:24:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:27.706 15:24:27 -- common/autotest_common.sh@10 -- # set +x 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:27.706 15:24:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:27.706 15:24:27 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:27.706 [2024-11-28 15:24:27.798227] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:27.706 [2024-11-28 15:24:27.900164] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:27.706 [2024-11-28 15:24:27.900209] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:27.706 [2024-11-28 15:24:27.900241] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:27.706 [2024-11-28 15:24:27.900263] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:27.706 [2024-11-28 15:24:27.900275] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:27.706 [2024-11-28 15:24:27.908010] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x9c0c20 was disconnected and freed. delete nvme_qpair. 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:28.641 15:24:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:28.641 15:24:28 -- common/autotest_common.sh@10 -- # set +x 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:28.641 15:24:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:28.641 15:24:28 -- host/discovery_remove_ifc.sh@90 -- # killprocess 827706 00:29:28.641 15:24:28 -- common/autotest_common.sh@936 -- # '[' -z 827706 ']' 00:29:28.641 15:24:28 -- common/autotest_common.sh@940 -- # kill -0 827706 00:29:28.641 15:24:28 -- common/autotest_common.sh@941 -- # uname 00:29:28.641 15:24:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:28.641 15:24:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 827706 00:29:28.898 15:24:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:28.898 15:24:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:28.898 15:24:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 827706' 00:29:28.898 killing process with pid 827706 00:29:28.898 15:24:28 -- common/autotest_common.sh@955 -- # kill 827706 00:29:28.898 15:24:28 -- common/autotest_common.sh@960 -- # wait 827706 00:29:28.898 15:24:29 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:28.898 15:24:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:28.898 15:24:29 -- nvmf/common.sh@116 -- # sync 00:29:28.898 15:24:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:28.898 15:24:29 -- nvmf/common.sh@119 -- # set +e 00:29:28.898 15:24:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:28.898 15:24:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:28.898 rmmod nvme_tcp 00:29:28.898 rmmod nvme_fabrics 00:29:28.898 rmmod nvme_keyring 00:29:28.898 15:24:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:28.898 15:24:29 -- nvmf/common.sh@123 -- # set -e 00:29:28.898 15:24:29 -- nvmf/common.sh@124 -- # return 0 00:29:28.898 15:24:29 -- nvmf/common.sh@477 -- # '[' -n 827553 ']' 00:29:28.898 15:24:29 -- nvmf/common.sh@478 -- # killprocess 827553 00:29:28.898 15:24:29 -- common/autotest_common.sh@936 -- # '[' -z 827553 ']' 00:29:28.898 15:24:29 -- common/autotest_common.sh@940 -- # kill -0 827553 00:29:28.898 15:24:29 -- common/autotest_common.sh@941 -- # uname 00:29:29.156 15:24:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:29.156 15:24:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 827553 00:29:29.156 15:24:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:29.156 15:24:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:29.156 15:24:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 827553' 00:29:29.156 killing process with pid 827553 00:29:29.156 15:24:29 -- common/autotest_common.sh@955 -- # kill 827553 00:29:29.156 15:24:29 -- common/autotest_common.sh@960 -- # wait 827553 00:29:29.415 15:24:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:29.415 15:24:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:29.415 15:24:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:29.415 15:24:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:29.415 15:24:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:29.415 15:24:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:29.415 15:24:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:29.415 15:24:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:31.316 15:24:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:31.316 00:29:31.316 real 0m18.534s 00:29:31.316 user 0m25.755s 00:29:31.316 sys 0m2.977s 00:29:31.316 15:24:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:31.316 15:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:31.316 ************************************ 00:29:31.316 END TEST nvmf_discovery_remove_ifc 00:29:31.316 ************************************ 00:29:31.316 15:24:31 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:31.316 15:24:31 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:31.316 15:24:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:31.316 15:24:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:31.316 15:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:31.316 ************************************ 00:29:31.316 START TEST nvmf_digest 00:29:31.316 ************************************ 00:29:31.316 15:24:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:31.316 * Looking for test storage... 00:29:31.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:31.316 15:24:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:31.316 15:24:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:31.316 15:24:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:31.574 15:24:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:31.574 15:24:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:31.574 15:24:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:31.574 15:24:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:31.574 15:24:31 -- scripts/common.sh@335 -- # IFS=.-: 00:29:31.574 15:24:31 -- scripts/common.sh@335 -- # read -ra ver1 00:29:31.574 15:24:31 -- scripts/common.sh@336 -- # IFS=.-: 00:29:31.575 15:24:31 -- scripts/common.sh@336 -- # read -ra ver2 00:29:31.575 15:24:31 -- scripts/common.sh@337 -- # local 'op=<' 00:29:31.575 15:24:31 -- scripts/common.sh@339 -- # ver1_l=2 00:29:31.575 15:24:31 -- scripts/common.sh@340 -- # ver2_l=1 00:29:31.575 15:24:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:31.575 15:24:31 -- scripts/common.sh@343 -- # case "$op" in 00:29:31.575 15:24:31 -- scripts/common.sh@344 -- # : 1 00:29:31.575 15:24:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:31.575 15:24:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:31.575 15:24:31 -- scripts/common.sh@364 -- # decimal 1 00:29:31.575 15:24:31 -- scripts/common.sh@352 -- # local d=1 00:29:31.575 15:24:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:31.575 15:24:31 -- scripts/common.sh@354 -- # echo 1 00:29:31.575 15:24:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:31.575 15:24:31 -- scripts/common.sh@365 -- # decimal 2 00:29:31.575 15:24:31 -- scripts/common.sh@352 -- # local d=2 00:29:31.575 15:24:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:31.575 15:24:31 -- scripts/common.sh@354 -- # echo 2 00:29:31.575 15:24:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:31.575 15:24:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:31.575 15:24:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:31.575 15:24:31 -- scripts/common.sh@367 -- # return 0 00:29:31.575 15:24:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:31.575 15:24:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:31.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:31.575 --rc genhtml_branch_coverage=1 00:29:31.575 --rc genhtml_function_coverage=1 00:29:31.575 --rc genhtml_legend=1 00:29:31.575 --rc geninfo_all_blocks=1 00:29:31.575 --rc geninfo_unexecuted_blocks=1 00:29:31.575 00:29:31.575 ' 00:29:31.575 15:24:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:31.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:31.575 --rc genhtml_branch_coverage=1 00:29:31.575 --rc genhtml_function_coverage=1 00:29:31.575 --rc genhtml_legend=1 00:29:31.575 --rc geninfo_all_blocks=1 00:29:31.575 --rc geninfo_unexecuted_blocks=1 00:29:31.575 00:29:31.575 ' 00:29:31.575 15:24:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:31.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:31.575 --rc genhtml_branch_coverage=1 00:29:31.575 --rc genhtml_function_coverage=1 00:29:31.575 --rc genhtml_legend=1 00:29:31.575 --rc geninfo_all_blocks=1 00:29:31.575 --rc geninfo_unexecuted_blocks=1 00:29:31.575 00:29:31.575 ' 00:29:31.575 15:24:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:31.575 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:31.575 --rc genhtml_branch_coverage=1 00:29:31.575 --rc genhtml_function_coverage=1 00:29:31.575 --rc genhtml_legend=1 00:29:31.575 --rc geninfo_all_blocks=1 00:29:31.575 --rc geninfo_unexecuted_blocks=1 00:29:31.575 00:29:31.575 ' 00:29:31.575 15:24:31 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:31.575 15:24:31 -- nvmf/common.sh@7 -- # uname -s 00:29:31.575 15:24:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:31.575 15:24:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:31.575 15:24:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:31.575 15:24:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:31.575 15:24:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:31.575 15:24:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:31.575 15:24:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:31.575 15:24:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:31.575 15:24:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:31.575 15:24:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:31.575 15:24:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:31.575 15:24:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:31.575 15:24:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:31.575 15:24:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:31.575 15:24:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:31.575 15:24:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:31.575 15:24:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:31.575 15:24:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:31.575 15:24:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:31.575 15:24:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:31.575 15:24:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:31.575 15:24:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:31.575 15:24:31 -- paths/export.sh@5 -- # export PATH 00:29:31.575 15:24:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:31.575 15:24:31 -- nvmf/common.sh@46 -- # : 0 00:29:31.575 15:24:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:31.575 15:24:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:31.575 15:24:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:31.575 15:24:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:31.575 15:24:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:31.575 15:24:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:31.575 15:24:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:31.575 15:24:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:31.575 15:24:31 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:31.575 15:24:31 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:31.575 15:24:31 -- host/digest.sh@16 -- # runtime=2 00:29:31.575 15:24:31 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:31.575 15:24:31 -- host/digest.sh@132 -- # nvmftestinit 00:29:31.575 15:24:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:31.575 15:24:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:31.575 15:24:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:31.575 15:24:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:31.575 15:24:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:31.575 15:24:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:31.575 15:24:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:31.575 15:24:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:31.575 15:24:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:31.575 15:24:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:31.575 15:24:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:31.575 15:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:33.476 15:24:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:33.476 15:24:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:33.476 15:24:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:33.476 15:24:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:33.476 15:24:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:33.476 15:24:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:33.476 15:24:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:33.476 15:24:33 -- nvmf/common.sh@294 -- # net_devs=() 00:29:33.476 15:24:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:33.476 15:24:33 -- nvmf/common.sh@295 -- # e810=() 00:29:33.476 15:24:33 -- nvmf/common.sh@295 -- # local -ga e810 00:29:33.476 15:24:33 -- nvmf/common.sh@296 -- # x722=() 00:29:33.476 15:24:33 -- nvmf/common.sh@296 -- # local -ga x722 00:29:33.476 15:24:33 -- nvmf/common.sh@297 -- # mlx=() 00:29:33.476 15:24:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:33.476 15:24:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:33.476 15:24:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:33.476 15:24:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:33.476 15:24:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:33.476 15:24:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:33.476 15:24:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:33.734 15:24:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:33.734 15:24:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:33.734 15:24:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:33.734 15:24:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:33.734 15:24:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:33.734 15:24:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:33.735 15:24:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:33.735 15:24:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:33.735 15:24:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:33.735 15:24:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:33.735 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:33.735 15:24:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:33.735 15:24:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:33.735 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:33.735 15:24:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:33.735 15:24:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:33.735 15:24:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:33.735 15:24:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:33.735 15:24:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:33.735 15:24:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:33.735 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:33.735 15:24:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:33.735 15:24:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:33.735 15:24:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:33.735 15:24:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:33.735 15:24:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:33.735 15:24:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:33.735 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:33.735 15:24:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:33.735 15:24:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:33.735 15:24:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:33.735 15:24:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:33.735 15:24:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:33.735 15:24:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:33.735 15:24:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:33.735 15:24:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:33.735 15:24:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:33.735 15:24:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:33.735 15:24:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:33.735 15:24:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:33.735 15:24:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:33.735 15:24:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:33.735 15:24:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:33.735 15:24:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:33.735 15:24:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:33.735 15:24:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:33.735 15:24:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:33.735 15:24:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:33.735 15:24:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:33.735 15:24:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:33.735 15:24:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:33.735 15:24:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:33.735 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:33.735 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:29:33.735 00:29:33.735 --- 10.0.0.2 ping statistics --- 00:29:33.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:33.735 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:29:33.735 15:24:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:33.735 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:33.735 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.166 ms 00:29:33.735 00:29:33.735 --- 10.0.0.1 ping statistics --- 00:29:33.735 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:33.735 rtt min/avg/max/mdev = 0.166/0.166/0.166/0.000 ms 00:29:33.735 15:24:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:33.735 15:24:33 -- nvmf/common.sh@410 -- # return 0 00:29:33.735 15:24:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:33.735 15:24:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:33.735 15:24:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:33.735 15:24:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:33.735 15:24:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:33.735 15:24:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:33.735 15:24:33 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:33.735 15:24:33 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:33.735 15:24:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:33.735 15:24:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:33.735 15:24:33 -- common/autotest_common.sh@10 -- # set +x 00:29:33.735 ************************************ 00:29:33.735 START TEST nvmf_digest_clean 00:29:33.735 ************************************ 00:29:33.735 15:24:33 -- common/autotest_common.sh@1114 -- # run_digest 00:29:33.735 15:24:33 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:33.735 15:24:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:33.735 15:24:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:33.735 15:24:33 -- common/autotest_common.sh@10 -- # set +x 00:29:33.735 15:24:33 -- nvmf/common.sh@469 -- # nvmfpid=831353 00:29:33.735 15:24:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:33.735 15:24:33 -- nvmf/common.sh@470 -- # waitforlisten 831353 00:29:33.735 15:24:33 -- common/autotest_common.sh@829 -- # '[' -z 831353 ']' 00:29:33.735 15:24:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:33.735 15:24:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:33.735 15:24:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:33.735 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:33.735 15:24:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:33.735 15:24:33 -- common/autotest_common.sh@10 -- # set +x 00:29:33.735 [2024-11-28 15:24:33.919707] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:33.735 [2024-11-28 15:24:33.919804] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:33.735 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.993 [2024-11-28 15:24:33.983161] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:33.993 [2024-11-28 15:24:34.065581] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:33.993 [2024-11-28 15:24:34.065733] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:33.993 [2024-11-28 15:24:34.065765] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:33.993 [2024-11-28 15:24:34.065777] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:33.993 [2024-11-28 15:24:34.065815] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:33.993 15:24:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:33.993 15:24:34 -- common/autotest_common.sh@862 -- # return 0 00:29:33.993 15:24:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:33.993 15:24:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:33.993 15:24:34 -- common/autotest_common.sh@10 -- # set +x 00:29:33.993 15:24:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:33.993 15:24:34 -- host/digest.sh@120 -- # common_target_config 00:29:33.993 15:24:34 -- host/digest.sh@43 -- # rpc_cmd 00:29:33.993 15:24:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:33.993 15:24:34 -- common/autotest_common.sh@10 -- # set +x 00:29:34.252 null0 00:29:34.252 [2024-11-28 15:24:34.263499] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:34.252 [2024-11-28 15:24:34.287705] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:34.252 15:24:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.252 15:24:34 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:34.252 15:24:34 -- host/digest.sh@77 -- # local rw bs qd 00:29:34.252 15:24:34 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:34.252 15:24:34 -- host/digest.sh@80 -- # rw=randread 00:29:34.252 15:24:34 -- host/digest.sh@80 -- # bs=4096 00:29:34.252 15:24:34 -- host/digest.sh@80 -- # qd=128 00:29:34.252 15:24:34 -- host/digest.sh@82 -- # bperfpid=831379 00:29:34.252 15:24:34 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:34.252 15:24:34 -- host/digest.sh@83 -- # waitforlisten 831379 /var/tmp/bperf.sock 00:29:34.252 15:24:34 -- common/autotest_common.sh@829 -- # '[' -z 831379 ']' 00:29:34.252 15:24:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:34.252 15:24:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:34.252 15:24:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:34.252 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:34.252 15:24:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:34.252 15:24:34 -- common/autotest_common.sh@10 -- # set +x 00:29:34.252 [2024-11-28 15:24:34.334288] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:34.252 [2024-11-28 15:24:34.334361] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid831379 ] 00:29:34.252 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.252 [2024-11-28 15:24:34.398781] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:34.510 [2024-11-28 15:24:34.487912] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:34.510 15:24:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:34.510 15:24:34 -- common/autotest_common.sh@862 -- # return 0 00:29:34.510 15:24:34 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:34.510 15:24:34 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:34.510 15:24:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:34.769 15:24:34 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.769 15:24:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:35.347 nvme0n1 00:29:35.347 15:24:35 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:35.347 15:24:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:35.347 Running I/O for 2 seconds... 00:29:37.875 00:29:37.875 Latency(us) 00:29:37.875 [2024-11-28T14:24:38.109Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.875 [2024-11-28T14:24:38.109Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:37.875 nvme0n1 : 2.04 15266.34 59.63 0.00 0.00 8214.14 3640.89 48545.19 00:29:37.875 [2024-11-28T14:24:38.109Z] =================================================================================================================== 00:29:37.875 [2024-11-28T14:24:38.109Z] Total : 15266.34 59.63 0.00 0.00 8214.14 3640.89 48545.19 00:29:37.875 0 00:29:37.875 15:24:37 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:37.875 15:24:37 -- host/digest.sh@92 -- # get_accel_stats 00:29:37.875 15:24:37 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:37.875 15:24:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:37.875 15:24:37 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:37.875 | select(.opcode=="crc32c") 00:29:37.875 | "\(.module_name) \(.executed)"' 00:29:37.875 15:24:37 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:37.875 15:24:37 -- host/digest.sh@93 -- # exp_module=software 00:29:37.875 15:24:37 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:37.875 15:24:37 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:37.875 15:24:37 -- host/digest.sh@97 -- # killprocess 831379 00:29:37.875 15:24:37 -- common/autotest_common.sh@936 -- # '[' -z 831379 ']' 00:29:37.875 15:24:37 -- common/autotest_common.sh@940 -- # kill -0 831379 00:29:37.875 15:24:37 -- common/autotest_common.sh@941 -- # uname 00:29:37.875 15:24:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.875 15:24:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 831379 00:29:37.875 15:24:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:37.875 15:24:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:37.875 15:24:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 831379' 00:29:37.875 killing process with pid 831379 00:29:37.875 15:24:37 -- common/autotest_common.sh@955 -- # kill 831379 00:29:37.875 Received shutdown signal, test time was about 2.000000 seconds 00:29:37.875 00:29:37.875 Latency(us) 00:29:37.875 [2024-11-28T14:24:38.109Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.875 [2024-11-28T14:24:38.109Z] =================================================================================================================== 00:29:37.875 [2024-11-28T14:24:38.109Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:37.875 15:24:37 -- common/autotest_common.sh@960 -- # wait 831379 00:29:37.875 15:24:37 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:37.875 15:24:37 -- host/digest.sh@77 -- # local rw bs qd 00:29:37.875 15:24:37 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:37.875 15:24:37 -- host/digest.sh@80 -- # rw=randread 00:29:37.875 15:24:37 -- host/digest.sh@80 -- # bs=131072 00:29:37.875 15:24:37 -- host/digest.sh@80 -- # qd=16 00:29:37.875 15:24:37 -- host/digest.sh@82 -- # bperfpid=831812 00:29:37.875 15:24:37 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:37.875 15:24:37 -- host/digest.sh@83 -- # waitforlisten 831812 /var/tmp/bperf.sock 00:29:37.875 15:24:37 -- common/autotest_common.sh@829 -- # '[' -z 831812 ']' 00:29:37.875 15:24:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:37.876 15:24:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:37.876 15:24:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:37.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:37.876 15:24:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:37.876 15:24:38 -- common/autotest_common.sh@10 -- # set +x 00:29:37.876 [2024-11-28 15:24:38.038463] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:37.876 [2024-11-28 15:24:38.038544] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid831812 ] 00:29:37.876 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:37.876 Zero copy mechanism will not be used. 00:29:37.876 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.876 [2024-11-28 15:24:38.103284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:38.134 [2024-11-28 15:24:38.189506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:38.134 15:24:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:38.134 15:24:38 -- common/autotest_common.sh@862 -- # return 0 00:29:38.134 15:24:38 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:38.134 15:24:38 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:38.134 15:24:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:38.392 15:24:38 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.392 15:24:38 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:38.958 nvme0n1 00:29:38.958 15:24:38 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:38.958 15:24:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:38.958 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:38.958 Zero copy mechanism will not be used. 00:29:38.958 Running I/O for 2 seconds... 00:29:40.857 00:29:40.857 Latency(us) 00:29:40.857 [2024-11-28T14:24:41.091Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:40.857 [2024-11-28T14:24:41.091Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:40.857 nvme0n1 : 2.00 5665.77 708.22 0.00 0.00 2819.84 761.55 7378.87 00:29:40.857 [2024-11-28T14:24:41.091Z] =================================================================================================================== 00:29:40.857 [2024-11-28T14:24:41.091Z] Total : 5665.77 708.22 0.00 0.00 2819.84 761.55 7378.87 00:29:40.857 0 00:29:40.857 15:24:41 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:40.857 15:24:41 -- host/digest.sh@92 -- # get_accel_stats 00:29:40.857 15:24:41 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:40.858 15:24:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:40.858 15:24:41 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:40.858 | select(.opcode=="crc32c") 00:29:40.858 | "\(.module_name) \(.executed)"' 00:29:41.115 15:24:41 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:41.115 15:24:41 -- host/digest.sh@93 -- # exp_module=software 00:29:41.115 15:24:41 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:41.115 15:24:41 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:41.115 15:24:41 -- host/digest.sh@97 -- # killprocess 831812 00:29:41.115 15:24:41 -- common/autotest_common.sh@936 -- # '[' -z 831812 ']' 00:29:41.115 15:24:41 -- common/autotest_common.sh@940 -- # kill -0 831812 00:29:41.115 15:24:41 -- common/autotest_common.sh@941 -- # uname 00:29:41.115 15:24:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:41.115 15:24:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 831812 00:29:41.373 15:24:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:41.373 15:24:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:41.373 15:24:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 831812' 00:29:41.373 killing process with pid 831812 00:29:41.373 15:24:41 -- common/autotest_common.sh@955 -- # kill 831812 00:29:41.373 Received shutdown signal, test time was about 2.000000 seconds 00:29:41.373 00:29:41.373 Latency(us) 00:29:41.373 [2024-11-28T14:24:41.607Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.373 [2024-11-28T14:24:41.607Z] =================================================================================================================== 00:29:41.373 [2024-11-28T14:24:41.607Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:41.373 15:24:41 -- common/autotest_common.sh@960 -- # wait 831812 00:29:41.373 15:24:41 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:41.373 15:24:41 -- host/digest.sh@77 -- # local rw bs qd 00:29:41.373 15:24:41 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:41.373 15:24:41 -- host/digest.sh@80 -- # rw=randwrite 00:29:41.373 15:24:41 -- host/digest.sh@80 -- # bs=4096 00:29:41.373 15:24:41 -- host/digest.sh@80 -- # qd=128 00:29:41.373 15:24:41 -- host/digest.sh@82 -- # bperfpid=832340 00:29:41.373 15:24:41 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:41.373 15:24:41 -- host/digest.sh@83 -- # waitforlisten 832340 /var/tmp/bperf.sock 00:29:41.373 15:24:41 -- common/autotest_common.sh@829 -- # '[' -z 832340 ']' 00:29:41.373 15:24:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:41.373 15:24:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:41.373 15:24:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:41.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:41.373 15:24:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:41.373 15:24:41 -- common/autotest_common.sh@10 -- # set +x 00:29:41.632 [2024-11-28 15:24:41.622870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:41.632 [2024-11-28 15:24:41.622951] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid832340 ] 00:29:41.632 EAL: No free 2048 kB hugepages reported on node 1 00:29:41.632 [2024-11-28 15:24:41.681623] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:41.632 [2024-11-28 15:24:41.765949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:41.632 15:24:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:41.632 15:24:41 -- common/autotest_common.sh@862 -- # return 0 00:29:41.632 15:24:41 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:41.632 15:24:41 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:41.632 15:24:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:42.198 15:24:42 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.198 15:24:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.455 nvme0n1 00:29:42.713 15:24:42 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:42.713 15:24:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:42.713 Running I/O for 2 seconds... 00:29:44.612 00:29:44.612 Latency(us) 00:29:44.612 [2024-11-28T14:24:44.846Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:44.612 [2024-11-28T14:24:44.846Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:44.612 nvme0n1 : 2.01 18936.26 73.97 0.00 0.00 6744.57 2839.89 9854.67 00:29:44.612 [2024-11-28T14:24:44.846Z] =================================================================================================================== 00:29:44.612 [2024-11-28T14:24:44.846Z] Total : 18936.26 73.97 0.00 0.00 6744.57 2839.89 9854.67 00:29:44.612 0 00:29:44.612 15:24:44 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:44.612 15:24:44 -- host/digest.sh@92 -- # get_accel_stats 00:29:44.612 15:24:44 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:44.612 15:24:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:44.612 15:24:44 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:44.612 | select(.opcode=="crc32c") 00:29:44.612 | "\(.module_name) \(.executed)"' 00:29:44.870 15:24:45 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:44.870 15:24:45 -- host/digest.sh@93 -- # exp_module=software 00:29:44.870 15:24:45 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:44.870 15:24:45 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:44.870 15:24:45 -- host/digest.sh@97 -- # killprocess 832340 00:29:44.870 15:24:45 -- common/autotest_common.sh@936 -- # '[' -z 832340 ']' 00:29:44.870 15:24:45 -- common/autotest_common.sh@940 -- # kill -0 832340 00:29:44.870 15:24:45 -- common/autotest_common.sh@941 -- # uname 00:29:45.127 15:24:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:45.127 15:24:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 832340 00:29:45.127 15:24:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:45.127 15:24:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:45.127 15:24:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 832340' 00:29:45.127 killing process with pid 832340 00:29:45.127 15:24:45 -- common/autotest_common.sh@955 -- # kill 832340 00:29:45.127 Received shutdown signal, test time was about 2.000000 seconds 00:29:45.127 00:29:45.127 Latency(us) 00:29:45.127 [2024-11-28T14:24:45.361Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.127 [2024-11-28T14:24:45.361Z] =================================================================================================================== 00:29:45.127 [2024-11-28T14:24:45.361Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:45.127 15:24:45 -- common/autotest_common.sh@960 -- # wait 832340 00:29:45.127 15:24:45 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:45.127 15:24:45 -- host/digest.sh@77 -- # local rw bs qd 00:29:45.127 15:24:45 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:45.127 15:24:45 -- host/digest.sh@80 -- # rw=randwrite 00:29:45.127 15:24:45 -- host/digest.sh@80 -- # bs=131072 00:29:45.127 15:24:45 -- host/digest.sh@80 -- # qd=16 00:29:45.127 15:24:45 -- host/digest.sh@82 -- # bperfpid=832759 00:29:45.127 15:24:45 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:45.127 15:24:45 -- host/digest.sh@83 -- # waitforlisten 832759 /var/tmp/bperf.sock 00:29:45.127 15:24:45 -- common/autotest_common.sh@829 -- # '[' -z 832759 ']' 00:29:45.127 15:24:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:45.127 15:24:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:45.127 15:24:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:45.127 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:45.127 15:24:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:45.127 15:24:45 -- common/autotest_common.sh@10 -- # set +x 00:29:45.384 [2024-11-28 15:24:45.378385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:45.384 [2024-11-28 15:24:45.378482] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid832759 ] 00:29:45.384 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:45.384 Zero copy mechanism will not be used. 00:29:45.384 EAL: No free 2048 kB hugepages reported on node 1 00:29:45.384 [2024-11-28 15:24:45.438351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:45.384 [2024-11-28 15:24:45.522785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:45.384 15:24:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:45.384 15:24:45 -- common/autotest_common.sh@862 -- # return 0 00:29:45.384 15:24:45 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:45.384 15:24:45 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:45.384 15:24:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:45.950 15:24:45 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:45.950 15:24:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:46.209 nvme0n1 00:29:46.467 15:24:46 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:46.467 15:24:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:46.467 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:46.467 Zero copy mechanism will not be used. 00:29:46.467 Running I/O for 2 seconds... 00:29:48.366 00:29:48.366 Latency(us) 00:29:48.366 [2024-11-28T14:24:48.600Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.366 [2024-11-28T14:24:48.600Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:48.366 nvme0n1 : 2.00 6708.59 838.57 0.00 0.00 2378.32 1881.13 10777.03 00:29:48.366 [2024-11-28T14:24:48.600Z] =================================================================================================================== 00:29:48.366 [2024-11-28T14:24:48.600Z] Total : 6708.59 838.57 0.00 0.00 2378.32 1881.13 10777.03 00:29:48.366 0 00:29:48.366 15:24:48 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:48.366 15:24:48 -- host/digest.sh@92 -- # get_accel_stats 00:29:48.366 15:24:48 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:48.366 15:24:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:48.366 15:24:48 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:48.366 | select(.opcode=="crc32c") 00:29:48.366 | "\(.module_name) \(.executed)"' 00:29:48.624 15:24:48 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:48.624 15:24:48 -- host/digest.sh@93 -- # exp_module=software 00:29:48.624 15:24:48 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:48.624 15:24:48 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:48.624 15:24:48 -- host/digest.sh@97 -- # killprocess 832759 00:29:48.624 15:24:48 -- common/autotest_common.sh@936 -- # '[' -z 832759 ']' 00:29:48.624 15:24:48 -- common/autotest_common.sh@940 -- # kill -0 832759 00:29:48.624 15:24:48 -- common/autotest_common.sh@941 -- # uname 00:29:48.624 15:24:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:48.624 15:24:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 832759 00:29:48.883 15:24:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:48.883 15:24:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:48.883 15:24:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 832759' 00:29:48.883 killing process with pid 832759 00:29:48.883 15:24:48 -- common/autotest_common.sh@955 -- # kill 832759 00:29:48.883 Received shutdown signal, test time was about 2.000000 seconds 00:29:48.883 00:29:48.883 Latency(us) 00:29:48.883 [2024-11-28T14:24:49.117Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:48.883 [2024-11-28T14:24:49.117Z] =================================================================================================================== 00:29:48.883 [2024-11-28T14:24:49.117Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:48.883 15:24:48 -- common/autotest_common.sh@960 -- # wait 832759 00:29:48.883 15:24:49 -- host/digest.sh@126 -- # killprocess 831353 00:29:48.883 15:24:49 -- common/autotest_common.sh@936 -- # '[' -z 831353 ']' 00:29:48.883 15:24:49 -- common/autotest_common.sh@940 -- # kill -0 831353 00:29:48.883 15:24:49 -- common/autotest_common.sh@941 -- # uname 00:29:48.883 15:24:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:48.883 15:24:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 831353 00:29:48.883 15:24:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:48.883 15:24:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:49.141 15:24:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 831353' 00:29:49.141 killing process with pid 831353 00:29:49.141 15:24:49 -- common/autotest_common.sh@955 -- # kill 831353 00:29:49.141 15:24:49 -- common/autotest_common.sh@960 -- # wait 831353 00:29:49.141 00:29:49.141 real 0m15.459s 00:29:49.141 user 0m29.670s 00:29:49.141 sys 0m4.659s 00:29:49.141 15:24:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.141 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.141 ************************************ 00:29:49.141 END TEST nvmf_digest_clean 00:29:49.141 ************************************ 00:29:49.141 15:24:49 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:49.141 15:24:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:49.141 15:24:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:49.141 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.141 ************************************ 00:29:49.141 START TEST nvmf_digest_error 00:29:49.141 ************************************ 00:29:49.141 15:24:49 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:49.141 15:24:49 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:49.141 15:24:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:49.141 15:24:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:49.141 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.141 15:24:49 -- nvmf/common.sh@469 -- # nvmfpid=833205 00:29:49.141 15:24:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:49.141 15:24:49 -- nvmf/common.sh@470 -- # waitforlisten 833205 00:29:49.141 15:24:49 -- common/autotest_common.sh@829 -- # '[' -z 833205 ']' 00:29:49.141 15:24:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:49.141 15:24:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:49.141 15:24:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:49.141 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:49.141 15:24:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:49.141 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.399 [2024-11-28 15:24:49.407940] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:49.399 [2024-11-28 15:24:49.408028] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:49.399 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.399 [2024-11-28 15:24:49.475203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:49.399 [2024-11-28 15:24:49.561507] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:49.399 [2024-11-28 15:24:49.561650] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:49.399 [2024-11-28 15:24:49.561666] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:49.399 [2024-11-28 15:24:49.561678] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:49.399 [2024-11-28 15:24:49.561716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:49.399 15:24:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:49.399 15:24:49 -- common/autotest_common.sh@862 -- # return 0 00:29:49.399 15:24:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:49.399 15:24:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:49.399 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.658 15:24:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:49.658 15:24:49 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:49.658 15:24:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.658 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.658 [2024-11-28 15:24:49.654353] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:49.658 15:24:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.658 15:24:49 -- host/digest.sh@104 -- # common_target_config 00:29:49.658 15:24:49 -- host/digest.sh@43 -- # rpc_cmd 00:29:49.658 15:24:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.658 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.658 null0 00:29:49.658 [2024-11-28 15:24:49.769960] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:49.658 [2024-11-28 15:24:49.794178] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:49.658 15:24:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.658 15:24:49 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:49.658 15:24:49 -- host/digest.sh@54 -- # local rw bs qd 00:29:49.658 15:24:49 -- host/digest.sh@56 -- # rw=randread 00:29:49.658 15:24:49 -- host/digest.sh@56 -- # bs=4096 00:29:49.658 15:24:49 -- host/digest.sh@56 -- # qd=128 00:29:49.658 15:24:49 -- host/digest.sh@58 -- # bperfpid=833356 00:29:49.658 15:24:49 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:49.658 15:24:49 -- host/digest.sh@60 -- # waitforlisten 833356 /var/tmp/bperf.sock 00:29:49.658 15:24:49 -- common/autotest_common.sh@829 -- # '[' -z 833356 ']' 00:29:49.658 15:24:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:49.658 15:24:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:49.658 15:24:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:49.658 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:49.658 15:24:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:49.658 15:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:49.658 [2024-11-28 15:24:49.838041] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:49.658 [2024-11-28 15:24:49.838121] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid833356 ] 00:29:49.658 EAL: No free 2048 kB hugepages reported on node 1 00:29:49.916 [2024-11-28 15:24:49.899528] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:49.916 [2024-11-28 15:24:49.987736] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:50.849 15:24:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:50.849 15:24:50 -- common/autotest_common.sh@862 -- # return 0 00:29:50.849 15:24:50 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:50.849 15:24:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:50.849 15:24:51 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:50.849 15:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:50.849 15:24:51 -- common/autotest_common.sh@10 -- # set +x 00:29:50.849 15:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:50.849 15:24:51 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:50.849 15:24:51 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:51.414 nvme0n1 00:29:51.414 15:24:51 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:51.414 15:24:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.414 15:24:51 -- common/autotest_common.sh@10 -- # set +x 00:29:51.414 15:24:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.414 15:24:51 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:51.414 15:24:51 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:51.414 Running I/O for 2 seconds... 00:29:51.414 [2024-11-28 15:24:51.616106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.414 [2024-11-28 15:24:51.616167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:2377 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.414 [2024-11-28 15:24:51.616189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.414 [2024-11-28 15:24:51.628262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.414 [2024-11-28 15:24:51.628293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:18369 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.414 [2024-11-28 15:24:51.628309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.414 [2024-11-28 15:24:51.645986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.414 [2024-11-28 15:24:51.646022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:4316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.414 [2024-11-28 15:24:51.646042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.662278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.662311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:17639 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.662329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.674156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.674185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:20200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.674216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.690506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.690541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:21600 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.690559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.706972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.707002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:20667 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.707034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.718976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.719012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18795 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.719031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.734480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.734512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:4720 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.734548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.751558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.751592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:21068 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.751611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.764705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.764736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:7970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.764768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.776068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.776113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:3583 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.776135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.789919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.789949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:21530 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.673 [2024-11-28 15:24:51.789981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.673 [2024-11-28 15:24:51.801257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.673 [2024-11-28 15:24:51.801288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:19689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.801325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.812718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.812765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:5889 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.812784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.824083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.824125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8323 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.824152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.836900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.836928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:9999 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.836964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.847811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.847845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:13838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.847864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.860203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.860230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:17723 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.860260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.871810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.871838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:10307 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.871871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.885236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.885264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:22377 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.885295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.674 [2024-11-28 15:24:51.900904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.674 [2024-11-28 15:24:51.900934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:14336 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.674 [2024-11-28 15:24:51.900970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.932 [2024-11-28 15:24:51.918119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.932 [2024-11-28 15:24:51.918150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:20128 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.932 [2024-11-28 15:24:51.918182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.932 [2024-11-28 15:24:51.934567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.932 [2024-11-28 15:24:51.934599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9213 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.932 [2024-11-28 15:24:51.934632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.932 [2024-11-28 15:24:51.952684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.932 [2024-11-28 15:24:51.952718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:24626 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.932 [2024-11-28 15:24:51.952737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.932 [2024-11-28 15:24:51.963845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.932 [2024-11-28 15:24:51.963879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18293 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.932 [2024-11-28 15:24:51.963911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.932 [2024-11-28 15:24:51.979722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:51.979750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:14835 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:51.979780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:51.996165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:51.996198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:16349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:51.996217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.012320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.012348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:19811 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.012378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.028840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.028874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:22929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.028895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.045717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.045747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:14820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.045780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.062574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.062608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6018 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.062627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.078065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.078121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:11750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.078144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.093400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.093446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6635 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.093462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.111426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.111460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:11031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.111479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.126669] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.126698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:21498 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.126730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.143055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.143106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:16787 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.143125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:51.933 [2024-11-28 15:24:52.159062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:51.933 [2024-11-28 15:24:52.159114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:51.933 [2024-11-28 15:24:52.159132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.177661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.177696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.177715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.193831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.193860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.193891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.210291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.210318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9013 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.210349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.226687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.226721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:17373 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.226739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.243325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.243354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:12657 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.243391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.258527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.258556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:15046 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.258586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.270304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.270332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:25223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.270363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.286746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.286780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:15056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.286800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.302963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.302997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:12173 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.191 [2024-11-28 15:24:52.303015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.191 [2024-11-28 15:24:52.319941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.191 [2024-11-28 15:24:52.319971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16485 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.319987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.192 [2024-11-28 15:24:52.333274] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.192 [2024-11-28 15:24:52.333303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:25135 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.333335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.192 [2024-11-28 15:24:52.348901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.192 [2024-11-28 15:24:52.348936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:15031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.348955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.192 [2024-11-28 15:24:52.364881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.192 [2024-11-28 15:24:52.364916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6352 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.364935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.192 [2024-11-28 15:24:52.381131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.192 [2024-11-28 15:24:52.381160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:24941 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.381192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.192 [2024-11-28 15:24:52.397697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.192 [2024-11-28 15:24:52.397724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:1479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.397754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.192 [2024-11-28 15:24:52.414351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.192 [2024-11-28 15:24:52.414378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:2391 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.192 [2024-11-28 15:24:52.414409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.450 [2024-11-28 15:24:52.430836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.450 [2024-11-28 15:24:52.430863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3466 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.450 [2024-11-28 15:24:52.430893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.450 [2024-11-28 15:24:52.444806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.450 [2024-11-28 15:24:52.444840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.450 [2024-11-28 15:24:52.444860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.450 [2024-11-28 15:24:52.458138] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.450 [2024-11-28 15:24:52.458183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.450 [2024-11-28 15:24:52.458199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.450 [2024-11-28 15:24:52.469277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.469308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:5862 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.469325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.484765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.484799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:11262 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.484817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.501574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.501607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:12315 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.501633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.518017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.518051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:6116 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.518069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.533940] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.533968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:1031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.533998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.550558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.550591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:7772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.550611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.566128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.566175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:3212 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.566191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.577438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.577481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:1097 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.577500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.594402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.594432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:6099 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.594469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.611378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.611407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.611423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.628196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.628225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14844 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.628256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.643125] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.643158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:8294 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.643191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.656036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.656066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:9678 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.656106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.451 [2024-11-28 15:24:52.667878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.451 [2024-11-28 15:24:52.667912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5968 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.451 [2024-11-28 15:24:52.667931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.709 [2024-11-28 15:24:52.684396] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.684426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:20584 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.684459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.701725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.701759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:18051 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.701778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.717840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.717868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:15341 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.717898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.734326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.734353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:5112 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.734384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.750905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.750940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.750959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.767372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.767401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:16858 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.767432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.783249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.783277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:11414 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.783308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.800230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.800260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:4273 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.800293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.817415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.817450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:5463 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.817470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.832171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.832201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:19605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.832234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.844306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.844335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:8351 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.844365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.859700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.859734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:16732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.859752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.875645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.875680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:15111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.875699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.892910] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.892943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:2509 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.892962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.909860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.909894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:20813 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.909919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.925518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.925553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:6604 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.925572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.710 [2024-11-28 15:24:52.940862] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.710 [2024-11-28 15:24:52.940897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:24585 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.710 [2024-11-28 15:24:52.940917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:52.959430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:52.959458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17292 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:52.959489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:52.975582] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:52.975610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:7766 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:52.975641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:52.985750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:52.985784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:52.985803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.001018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.001052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:17289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.001071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.017070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.017119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:23755 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.017135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.033519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.033554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:25565 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.033572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.049917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.049950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:1259 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.049982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.066877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.066911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:14374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.066930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.083221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.083248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:25459 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.083279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.099797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.099831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:8316 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.099849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.116208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.116236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:11503 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.116267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.132513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.132547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:23021 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.132566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.149068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.149120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:2654 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.149140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.165776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.165811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:6964 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.165829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.182205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.182245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:18269 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.182261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.972 [2024-11-28 15:24:53.199034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:52.972 [2024-11-28 15:24:53.199068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:20573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.972 [2024-11-28 15:24:53.199087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.216006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.216034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:24407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.216064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.232572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.232606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:9597 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.232625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.249227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.249261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23990 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.249280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.265657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.265685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:20577 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.265716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.281848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.281892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6421 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.281911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.298156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.298184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:8508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.298199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.314347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.314375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13676 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.314392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.330692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.330728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:14936 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.330753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.346684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.346717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:8514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.346736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.362969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.231 [2024-11-28 15:24:53.362997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:3782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.231 [2024-11-28 15:24:53.363028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.231 [2024-11-28 15:24:53.377819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.232 [2024-11-28 15:24:53.377851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:3552 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.232 [2024-11-28 15:24:53.377884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.232 [2024-11-28 15:24:53.389524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.232 [2024-11-28 15:24:53.389558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.232 [2024-11-28 15:24:53.389576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.232 [2024-11-28 15:24:53.406145] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.232 [2024-11-28 15:24:53.406174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:634 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.232 [2024-11-28 15:24:53.406190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.232 [2024-11-28 15:24:53.422369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.232 [2024-11-28 15:24:53.422413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.232 [2024-11-28 15:24:53.422428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.232 [2024-11-28 15:24:53.438273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.232 [2024-11-28 15:24:53.438305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:18020 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.232 [2024-11-28 15:24:53.438321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.232 [2024-11-28 15:24:53.456112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.232 [2024-11-28 15:24:53.456156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:9924 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.232 [2024-11-28 15:24:53.456171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.472922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.472949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:8771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.472982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.489895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.489925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:3268 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.489956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.506133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.506172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:19514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.506189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.524160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.524194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:6437 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.524235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.539013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.539042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.539073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.555609] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.555639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:9234 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.555671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.572346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.490 [2024-11-28 15:24:53.572374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:13458 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.490 [2024-11-28 15:24:53.572390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.490 [2024-11-28 15:24:53.583207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.491 [2024-11-28 15:24:53.583235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:1358 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.491 [2024-11-28 15:24:53.583267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.491 [2024-11-28 15:24:53.598440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0xdc7400) 00:29:53.491 [2024-11-28 15:24:53.598474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:4708 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.491 [2024-11-28 15:24:53.598500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.491 00:29:53.491 Latency(us) 00:29:53.491 [2024-11-28T14:24:53.725Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.491 [2024-11-28T14:24:53.725Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:53.491 nvme0n1 : 2.04 16106.41 62.92 0.00 0.00 7786.36 3373.89 48545.19 00:29:53.491 [2024-11-28T14:24:53.725Z] =================================================================================================================== 00:29:53.491 [2024-11-28T14:24:53.725Z] Total : 16106.41 62.92 0.00 0.00 7786.36 3373.89 48545.19 00:29:53.491 0 00:29:53.491 15:24:53 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:53.491 15:24:53 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:53.491 15:24:53 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:53.491 15:24:53 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:53.491 | .driver_specific 00:29:53.491 | .nvme_error 00:29:53.491 | .status_code 00:29:53.491 | .command_transient_transport_error' 00:29:53.749 15:24:53 -- host/digest.sh@71 -- # (( 129 > 0 )) 00:29:53.749 15:24:53 -- host/digest.sh@73 -- # killprocess 833356 00:29:53.750 15:24:53 -- common/autotest_common.sh@936 -- # '[' -z 833356 ']' 00:29:53.750 15:24:53 -- common/autotest_common.sh@940 -- # kill -0 833356 00:29:53.750 15:24:53 -- common/autotest_common.sh@941 -- # uname 00:29:53.750 15:24:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:53.750 15:24:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 833356 00:29:53.750 15:24:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:53.750 15:24:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:53.750 15:24:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 833356' 00:29:53.750 killing process with pid 833356 00:29:53.750 15:24:53 -- common/autotest_common.sh@955 -- # kill 833356 00:29:53.750 Received shutdown signal, test time was about 2.000000 seconds 00:29:53.750 00:29:53.750 Latency(us) 00:29:53.750 [2024-11-28T14:24:53.984Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.750 [2024-11-28T14:24:53.984Z] =================================================================================================================== 00:29:53.750 [2024-11-28T14:24:53.984Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:53.750 15:24:53 -- common/autotest_common.sh@960 -- # wait 833356 00:29:54.009 15:24:54 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:54.009 15:24:54 -- host/digest.sh@54 -- # local rw bs qd 00:29:54.009 15:24:54 -- host/digest.sh@56 -- # rw=randread 00:29:54.009 15:24:54 -- host/digest.sh@56 -- # bs=131072 00:29:54.009 15:24:54 -- host/digest.sh@56 -- # qd=16 00:29:54.009 15:24:54 -- host/digest.sh@58 -- # bperfpid=833901 00:29:54.009 15:24:54 -- host/digest.sh@60 -- # waitforlisten 833901 /var/tmp/bperf.sock 00:29:54.009 15:24:54 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:54.009 15:24:54 -- common/autotest_common.sh@829 -- # '[' -z 833901 ']' 00:29:54.009 15:24:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:54.009 15:24:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:54.009 15:24:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:54.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:54.009 15:24:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:54.009 15:24:54 -- common/autotest_common.sh@10 -- # set +x 00:29:54.009 [2024-11-28 15:24:54.212299] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:54.009 [2024-11-28 15:24:54.212402] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid833901 ] 00:29:54.009 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:54.009 Zero copy mechanism will not be used. 00:29:54.009 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.268 [2024-11-28 15:24:54.275944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:54.268 [2024-11-28 15:24:54.365797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:55.203 15:24:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:55.203 15:24:55 -- common/autotest_common.sh@862 -- # return 0 00:29:55.203 15:24:55 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:55.203 15:24:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:55.203 15:24:55 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:55.203 15:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.203 15:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:55.461 15:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.461 15:24:55 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.461 15:24:55 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.719 nvme0n1 00:29:55.719 15:24:55 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:55.719 15:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.719 15:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:55.719 15:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.719 15:24:55 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:55.719 15:24:55 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:55.719 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:55.719 Zero copy mechanism will not be used. 00:29:55.719 Running I/O for 2 seconds... 00:29:55.719 [2024-11-28 15:24:55.911835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.719 [2024-11-28 15:24:55.911891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.719 [2024-11-28 15:24:55.911915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.719 [2024-11-28 15:24:55.916772] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.719 [2024-11-28 15:24:55.916807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.719 [2024-11-28 15:24:55.916826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.719 [2024-11-28 15:24:55.921605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.719 [2024-11-28 15:24:55.921638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.921657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.720 [2024-11-28 15:24:55.926517] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.720 [2024-11-28 15:24:55.926552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.926571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.720 [2024-11-28 15:24:55.931331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.720 [2024-11-28 15:24:55.931388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.931406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.720 [2024-11-28 15:24:55.936118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.720 [2024-11-28 15:24:55.936163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.936179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.720 [2024-11-28 15:24:55.941759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.720 [2024-11-28 15:24:55.941797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.941822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.720 [2024-11-28 15:24:55.946187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.720 [2024-11-28 15:24:55.946218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.946250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.720 [2024-11-28 15:24:55.951230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.720 [2024-11-28 15:24:55.951261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.720 [2024-11-28 15:24:55.951279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.981 [2024-11-28 15:24:55.956127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.981 [2024-11-28 15:24:55.956172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.981 [2024-11-28 15:24:55.956189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.981 [2024-11-28 15:24:55.961046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.981 [2024-11-28 15:24:55.961079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.981 [2024-11-28 15:24:55.961107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.981 [2024-11-28 15:24:55.965961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.981 [2024-11-28 15:24:55.965993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.981 [2024-11-28 15:24:55.966012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.981 [2024-11-28 15:24:55.970926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.981 [2024-11-28 15:24:55.970960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.981 [2024-11-28 15:24:55.970979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.981 [2024-11-28 15:24:55.975809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:55.975842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:55.975860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:55.980627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:55.980661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:55.980679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:55.985464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:55.985498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:55.985516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:55.990472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:55.990505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:55.990523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:55.995502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:55.995536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:55.995555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.000392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.000440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.000467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.005250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.005280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.005311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.010162] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.010192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.010225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.015047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.015101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.015132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.020789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.020823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.020842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.025047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.025080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.025106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.030403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.030432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.030464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.034409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.034438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.034469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.038782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.038815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.038834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.043368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.043395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.043411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.047995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.048028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.048046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.052633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.052666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.052684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.057241] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.057276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.057310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.062663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.062692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.062724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.069254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.069283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.069314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.076315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.076346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.076379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.082122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.082167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.082182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.089100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.089148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.089165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.093231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.093260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.093297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.098148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.098175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.098205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.103118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.103163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.103201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.108621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.982 [2024-11-28 15:24:56.108653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.982 [2024-11-28 15:24:56.108672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.982 [2024-11-28 15:24:56.115912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.115946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.115970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.122540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.122577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.122595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.128019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.128049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.128087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.133495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.133530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.133549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.140574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.140609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.140628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.145982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.146016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.146034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.151430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.151478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.151496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.158276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.158329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.158347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.164209] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.164239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.164271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.171449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.171484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.171504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.176580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.176609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.176640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.182809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.182844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.182863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.188723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.188757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.188776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.194891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.194936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.194954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.201957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.201999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.202018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.207715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.207751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.207781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:55.983 [2024-11-28 15:24:56.212991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:55.983 [2024-11-28 15:24:56.213027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:55.983 [2024-11-28 15:24:56.213047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.218912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.218951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.218971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.223624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.223658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.223677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.228553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.228587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.228606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.233272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.233301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.233318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.238308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.238337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.238354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.243311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.243340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.243357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.248295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.248324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.248341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.253339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.253386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.253412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.258200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.258230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.258247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.263639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.263674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.263693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.269689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.269728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.269747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.274619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.274653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.274672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.279272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.279302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.279319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.284585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.284626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.284645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.290184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.290215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.281 [2024-11-28 15:24:56.290248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.281 [2024-11-28 15:24:56.296214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.281 [2024-11-28 15:24:56.296244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.296276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.301754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.301789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.301808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.307674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.307708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.307727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.314717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.314756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.314775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.319736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.319770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.319788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.325597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.325631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.325650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.331544] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.331578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.331597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.337229] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.337257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.337288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.342743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.342778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.342797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.348503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.348537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.348565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.354312] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.354342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.354375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.360313] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.360343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.360360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.365217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.365247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.365265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.369551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.369584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.369602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.373957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.373989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.374007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.378692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.378726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.378744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.383028] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.383060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.383078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.387724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.387755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.387773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.392347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.392381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.392413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.396684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.396717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.396735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.401349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.401392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.401408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.406070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.406110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.406130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.410999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.411033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.411052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.415685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.415718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.415736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.420026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.420059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.420078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.424426] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.424458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.424476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.428976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.429008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.282 [2024-11-28 15:24:56.429026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.282 [2024-11-28 15:24:56.433298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.282 [2024-11-28 15:24:56.433327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.433344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.437977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.438009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.438027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.442963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.442997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.443015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.448182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.448212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.448229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.452795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.452828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.452846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.458279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.458309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.458326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.463459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.463498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.463517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.468651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.468684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.468703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.473616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.473653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.473681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.479010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.479044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.479062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.484010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.484045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.484064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.489261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.489293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.489310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.283 [2024-11-28 15:24:56.494784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.283 [2024-11-28 15:24:56.494815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.283 [2024-11-28 15:24:56.494832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.500205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.500237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.500254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.504898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.504932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.504952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.510994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.511028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.511046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.516596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.516632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.516651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.522332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.522387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.522405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.528115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.528164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.528181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.533968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.534002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.534021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.539802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.539836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.539855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.545746] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.545782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.545801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.551468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.551502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.551521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.557258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.557286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.557302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.563084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.563140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.563158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.569677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.569712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.569732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.575774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.575809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.575827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.580830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.580864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.580882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.585999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.586032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.586051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.591160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.591190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.591207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.566 [2024-11-28 15:24:56.596310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.566 [2024-11-28 15:24:56.596341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.566 [2024-11-28 15:24:56.596358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.601196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.601240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.601256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.606478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.606512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.606530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.612179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.612223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.612239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.618270] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.618305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.618339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.624171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.624216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.624232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.629820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.629854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.629873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.635496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.635530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.635549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.641009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.641043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.641063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.646225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.646254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.646286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.651898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.651933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.651951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.657495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.657530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.657548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.662860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.662894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.662912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.668406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.668452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.668471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.674386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.674416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.674434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.679706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.679740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.679758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.685427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.685475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.685494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.691282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.691313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.691329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.697201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.697244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.697260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.703113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.703147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.703179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.708112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.708159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.708176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.712266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.567 [2024-11-28 15:24:56.712296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.567 [2024-11-28 15:24:56.712321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.567 [2024-11-28 15:24:56.717174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.717204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.717220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.723795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.723828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.723847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.730559] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.730593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.730612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.738471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.738505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.738524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.745001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.745035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.745054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.750990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.751024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.751051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.757677] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.757711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.757730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.763380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.763426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.763446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.767892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.767934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.767953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.771973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.772006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.772025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.776187] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.776232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.776248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.780452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.780485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.780503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.784397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.784426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.784442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.788371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.788419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.788437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.792672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.792705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.792724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.568 [2024-11-28 15:24:56.797293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.568 [2024-11-28 15:24:56.797323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.568 [2024-11-28 15:24:56.797340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.802015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.802049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.802068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.805900] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.805933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.805952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.809610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.809644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.809662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.813716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.813749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.813775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.817815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.817848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.817867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.821548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.821580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.821598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.829 [2024-11-28 15:24:56.825720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.829 [2024-11-28 15:24:56.825754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.829 [2024-11-28 15:24:56.825772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.831921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.831955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.831973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.838739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.838772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.838791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.843895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.843929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.843956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.849683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.849717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.849736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.854932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.854966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.854985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.861143] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.861172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.861204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.866671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.866705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.866724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.872296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.872328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.872345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.879073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.879116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.879148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.885935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.885969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.885987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.892373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.892403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.892419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.898290] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.898330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.898353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.903597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.903632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.903650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.908564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.908598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.908616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.914157] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.914202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.914219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.920414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.920448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.920467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.925860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.925894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.925913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.930466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.930500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.930518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.934624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.934658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.934676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.938595] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.938629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.938655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.942829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.830 [2024-11-28 15:24:56.942862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.830 [2024-11-28 15:24:56.942880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.830 [2024-11-28 15:24:56.947340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.947370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.947386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.952182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.952212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.952228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.956960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.956993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.957011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.961640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.961672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.961690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.966285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.966315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.966332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.971268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.971312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.971327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.976186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.976229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.976245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.980804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.980844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.980863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.985626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.985659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.985677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.990228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.990257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.990273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.994914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.994947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.994965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:56.999610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:56.999643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:56.999661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.004172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.004201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.004218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.008877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.008910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.008928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.014272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.014303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.014319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.019215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.019244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.019276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.024641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.024675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.024693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.029914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.029948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.029966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.034471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.034504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.034522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.038920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.038952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.038970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.044363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.044408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.044427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.049480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.049513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.831 [2024-11-28 15:24:57.049532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:56.831 [2024-11-28 15:24:57.054904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.831 [2024-11-28 15:24:57.054938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.832 [2024-11-28 15:24:57.054956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:56.832 [2024-11-28 15:24:57.061115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:56.832 [2024-11-28 15:24:57.061162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:56.832 [2024-11-28 15:24:57.061179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.066662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.066695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.066722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.071707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.071741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.071760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.077080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.077123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.077156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.083144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.083175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.083191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.089257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.089288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.089304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.095482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.095518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.095537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.101526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.101561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.101580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.107258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.107289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.107306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.113280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.113310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.113327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.118926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.118967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.118987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.124178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.124209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.124225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.129364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.129394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.129411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.134657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.134691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.134709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.140227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.140273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.140289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.145454] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.145488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.092 [2024-11-28 15:24:57.145506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.092 [2024-11-28 15:24:57.151029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.092 [2024-11-28 15:24:57.151063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.151082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.156766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.156800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.156818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.162567] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.162601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.162620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.167920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.167954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.167973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.173110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.173158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.173175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.178202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.178232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.178248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.183027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.183060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.183079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.188296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.188327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.188343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.193370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.193400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.193417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.198968] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.199001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.199019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.203882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.203916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.203934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.209181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.209211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.209240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.214358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.214406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.214425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.222014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.222048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.222067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.229359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.229390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.229406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.235806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.235839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.235858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.241497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.241531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.241549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.246919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.246953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.246971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.252330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.252361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.252378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.257950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.257984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.258002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.263153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.263184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.263201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.093 [2024-11-28 15:24:57.267728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.093 [2024-11-28 15:24:57.267762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.093 [2024-11-28 15:24:57.267780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.270944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.270978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.270996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.276472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.276506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.276525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.281988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.282022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.282040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.287554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.287588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.287611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.292564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.292598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.292616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.297455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.297489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.297507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.302305] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.302335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.302360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.307704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.307739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.307757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.312817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.312852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.312871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.317409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.317443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.317462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.094 [2024-11-28 15:24:57.321515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.094 [2024-11-28 15:24:57.321548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.094 [2024-11-28 15:24:57.321567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.325706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.325741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.325760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.329836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.329882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.329901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.334107] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.334155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.334172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.338238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.338268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.338285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.342288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.342328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.342346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.346362] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.346401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.346418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.350646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.350680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.350698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.355334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.355364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.355380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.360108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.360153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.360168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.364979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.365012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.365030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.369581] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.355 [2024-11-28 15:24:57.369613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.355 [2024-11-28 15:24:57.369631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.355 [2024-11-28 15:24:57.374906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.374940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.374958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.379134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.379165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.379181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.383295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.383325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.383342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.387372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.387401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.387417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.391599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.391633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.391652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.396054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.396103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.396125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.399789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.399823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.399842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.403638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.403671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.403690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.408352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.408398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.408418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.413265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.413295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.413311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.418309] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.418339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.418365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.424066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.424108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.424129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.428696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.428729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.428747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.433231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.433261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.433277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.439169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.439199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.439217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.443912] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.443946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.443965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.448352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.448382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.448398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.453837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.453871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.453890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.459001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.459043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.459061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.464986] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.465029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.465049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.472449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.472482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.472501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.478406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.478451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.478467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.483074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.483116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.483150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.487067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.487115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.487151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.490552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.490585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.490602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.496610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.496643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.496660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.503074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.356 [2024-11-28 15:24:57.503118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.356 [2024-11-28 15:24:57.503152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.356 [2024-11-28 15:24:57.509871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.509905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.509924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.517768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.517803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.517823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.522867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.522900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.522919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.527234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.527273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.527291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.530722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.530755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.530773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.534658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.534692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.534711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.538621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.538654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.538674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.542686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.542719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.542737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.546717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.546750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.546768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.550764] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.550796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.550826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.555053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.555087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.555114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.559701] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.559733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.559752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.564488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.564535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.564553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.569272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.569302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.569318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.574030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.574062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.574080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.578663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.578697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.578715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.357 [2024-11-28 15:24:57.583839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.357 [2024-11-28 15:24:57.583873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.357 [2024-11-28 15:24:57.583891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.588864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.588898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.588916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.593525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.593559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.593577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.597797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.597830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.597848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.602434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.602480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.602498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.607804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.607838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.607856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.612561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.612596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.612614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.617719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.617753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.617771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.623505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.623539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.623558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.628625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.628658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.628676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.633917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.633951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.633980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.639384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.639429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.639449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.644959] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.644993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.645011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.650729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.650764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.650783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.656890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.656925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.656944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.664404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.664452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.664471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.672876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.672910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.672929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.681015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.681051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.681070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.687888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.687922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.687941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.694411] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.694452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.694472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.701893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.701928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.701947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.708781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.708815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.708834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.715792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.715827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.715847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.722302] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.722333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.722350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.728808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.728842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.728860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.736267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.736313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.736330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.618 [2024-11-28 15:24:57.744023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.618 [2024-11-28 15:24:57.744058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.618 [2024-11-28 15:24:57.744076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.751644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.751678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.751697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.759657] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.759691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.759711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.767695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.767730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.767748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.775013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.775048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.775066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.780769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.780803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.780822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.786317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.786349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.786365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.791854] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.791888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.791907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.797816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.797850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.797869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.803814] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.803848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.803867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.809776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.809810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.809839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.815388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.815437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.815457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.821248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.821279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.821296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.827353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.827383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.827416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.833557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.833592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.833610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.839174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.839205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.839221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.844579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.844613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.844632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.619 [2024-11-28 15:24:57.849648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.619 [2024-11-28 15:24:57.849682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.619 [2024-11-28 15:24:57.849701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.854271] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.854308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.854326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.859430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.859473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.859493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.864711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.864745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.864764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.869558] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.869592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.869611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.874724] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.874758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.874777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.880053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.880087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.880115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.885055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.885089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.885118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.890378] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.878 [2024-11-28 15:24:57.890424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.878 [2024-11-28 15:24:57.890443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:57.878 [2024-11-28 15:24:57.895621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.879 [2024-11-28 15:24:57.895654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.879 [2024-11-28 15:24:57.895672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:57.879 [2024-11-28 15:24:57.900474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.879 [2024-11-28 15:24:57.900509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.879 [2024-11-28 15:24:57.900527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:57.879 [2024-11-28 15:24:57.905471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x12d82f0) 00:29:57.879 [2024-11-28 15:24:57.905505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.879 [2024-11-28 15:24:57.905523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:57.879 00:29:57.879 Latency(us) 00:29:57.879 [2024-11-28T14:24:58.113Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:57.879 [2024-11-28T14:24:58.113Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:57.879 nvme0n1 : 2.00 5832.92 729.12 0.00 0.00 2738.67 722.11 9223.59 00:29:57.879 [2024-11-28T14:24:58.113Z] =================================================================================================================== 00:29:57.879 [2024-11-28T14:24:58.113Z] Total : 5832.92 729.12 0.00 0.00 2738.67 722.11 9223.59 00:29:57.879 0 00:29:57.879 15:24:57 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:57.879 15:24:57 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:57.879 15:24:57 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:57.879 15:24:57 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:57.879 | .driver_specific 00:29:57.879 | .nvme_error 00:29:57.879 | .status_code 00:29:57.879 | .command_transient_transport_error' 00:29:58.138 15:24:58 -- host/digest.sh@71 -- # (( 376 > 0 )) 00:29:58.138 15:24:58 -- host/digest.sh@73 -- # killprocess 833901 00:29:58.138 15:24:58 -- common/autotest_common.sh@936 -- # '[' -z 833901 ']' 00:29:58.138 15:24:58 -- common/autotest_common.sh@940 -- # kill -0 833901 00:29:58.138 15:24:58 -- common/autotest_common.sh@941 -- # uname 00:29:58.138 15:24:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.138 15:24:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 833901 00:29:58.138 15:24:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:58.138 15:24:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:58.138 15:24:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 833901' 00:29:58.138 killing process with pid 833901 00:29:58.138 15:24:58 -- common/autotest_common.sh@955 -- # kill 833901 00:29:58.138 Received shutdown signal, test time was about 2.000000 seconds 00:29:58.138 00:29:58.138 Latency(us) 00:29:58.138 [2024-11-28T14:24:58.372Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:58.138 [2024-11-28T14:24:58.372Z] =================================================================================================================== 00:29:58.138 [2024-11-28T14:24:58.372Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:58.138 15:24:58 -- common/autotest_common.sh@960 -- # wait 833901 00:29:58.396 15:24:58 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:58.396 15:24:58 -- host/digest.sh@54 -- # local rw bs qd 00:29:58.396 15:24:58 -- host/digest.sh@56 -- # rw=randwrite 00:29:58.396 15:24:58 -- host/digest.sh@56 -- # bs=4096 00:29:58.396 15:24:58 -- host/digest.sh@56 -- # qd=128 00:29:58.396 15:24:58 -- host/digest.sh@58 -- # bperfpid=834338 00:29:58.396 15:24:58 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:58.396 15:24:58 -- host/digest.sh@60 -- # waitforlisten 834338 /var/tmp/bperf.sock 00:29:58.396 15:24:58 -- common/autotest_common.sh@829 -- # '[' -z 834338 ']' 00:29:58.396 15:24:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:58.396 15:24:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:58.396 15:24:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:58.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:58.397 15:24:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:58.397 15:24:58 -- common/autotest_common.sh@10 -- # set +x 00:29:58.397 [2024-11-28 15:24:58.445939] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:29:58.397 [2024-11-28 15:24:58.446022] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid834338 ] 00:29:58.397 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.397 [2024-11-28 15:24:58.510246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:58.397 [2024-11-28 15:24:58.603555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:58.655 15:24:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:58.655 15:24:58 -- common/autotest_common.sh@862 -- # return 0 00:29:58.655 15:24:58 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:58.655 15:24:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:58.913 15:24:58 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:58.913 15:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:58.913 15:24:58 -- common/autotest_common.sh@10 -- # set +x 00:29:58.913 15:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:58.913 15:24:58 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:58.913 15:24:58 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:59.171 nvme0n1 00:29:59.171 15:24:59 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:59.171 15:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:59.171 15:24:59 -- common/autotest_common.sh@10 -- # set +x 00:29:59.171 15:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:59.171 15:24:59 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:59.171 15:24:59 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:59.431 Running I/O for 2 seconds... 00:29:59.431 [2024-11-28 15:24:59.438936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190ee5c8 00:29:59.431 [2024-11-28 15:24:59.440221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:7442 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.440262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0049 p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.453456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190ed920 00:29:59.431 [2024-11-28 15:24:59.454734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.454765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.464085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e6fa8 00:29:59.431 [2024-11-28 15:24:59.464512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.464545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0038 p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.479958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f9b30 00:29:59.431 [2024-11-28 15:24:59.481209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.481238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.489091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e1b48 00:29:59.431 [2024-11-28 15:24:59.489319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7707 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.489347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:000c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.501509] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fdeb0 00:29:59.431 [2024-11-28 15:24:59.502212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:7901 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.502253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:001c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.514245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f4b08 00:29:59.431 [2024-11-28 15:24:59.514437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:3959 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.514484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:003d p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.526415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190eff18 00:29:59.431 [2024-11-28 15:24:59.526652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:9720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.526681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:003c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.538856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e6738 00:29:59.431 [2024-11-28 15:24:59.539282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:4686 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.539326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.551350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190df550 00:29:59.431 [2024-11-28 15:24:59.551730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8807 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.551763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.563677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e8d30 00:29:59.431 [2024-11-28 15:24:59.564725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:8610 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.564770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.577232] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f7da8 00:29:59.431 [2024-11-28 15:24:59.578193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.578237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.589410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e9168 00:29:59.431 [2024-11-28 15:24:59.590344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:3877 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.590404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.601185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f8a50 00:29:59.431 [2024-11-28 15:24:59.602181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:9653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.602209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.613503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e5ec8 00:29:59.431 [2024-11-28 15:24:59.614415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:24937 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.614443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.625507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fc998 00:29:59.431 [2024-11-28 15:24:59.626432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:15938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.626480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.637340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190ddc00 00:29:59.431 [2024-11-28 15:24:59.638269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:24842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.638296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.649503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fd640 00:29:59.431 [2024-11-28 15:24:59.650472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:3548 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.650505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:59.431 [2024-11-28 15:24:59.660764] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e6b70 00:29:59.431 [2024-11-28 15:24:59.661073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:19691 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.431 [2024-11-28 15:24:59.661115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0015 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.676501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f3e60 00:29:59.691 [2024-11-28 15:24:59.677526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:8805 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.677558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.687878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e99d8 00:29:59.691 [2024-11-28 15:24:59.688969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:16726 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.689002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.699992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f3e60 00:29:59.691 [2024-11-28 15:24:59.701032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:19554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.701065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.712235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190ed0b0 00:29:59.691 [2024-11-28 15:24:59.713368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6715 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.713427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.724920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fc560 00:29:59.691 [2024-11-28 15:24:59.726556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:7860 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.726599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.736555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190de038 00:29:59.691 [2024-11-28 15:24:59.737821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4180 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.737853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.749204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fc998 00:29:59.691 [2024-11-28 15:24:59.749992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:318 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.750023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.761489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f20d8 00:29:59.691 [2024-11-28 15:24:59.761995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:1370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.762028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.773495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f5378 00:29:59.691 [2024-11-28 15:24:59.773975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:5788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.774006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.785748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f31b8 00:29:59.691 [2024-11-28 15:24:59.786210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:21306 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.786254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.798065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e8d30 00:29:59.691 [2024-11-28 15:24:59.798526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:20690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.798558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.810356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f2d80 00:29:59.691 [2024-11-28 15:24:59.810723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:2619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.810754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.822402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f6458 00:29:59.691 [2024-11-28 15:24:59.822753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.822785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.834303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fda78 00:29:59.691 [2024-11-28 15:24:59.834579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:14900 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.834611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.846616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190eb760 00:29:59.691 [2024-11-28 15:24:59.846855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:3575 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.846887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:004c p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.861910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f31b8 00:29:59.691 [2024-11-28 15:24:59.863204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:11966 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.863231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.874307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fa7d8 00:29:59.691 [2024-11-28 15:24:59.875920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:10782 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.875951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.883829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190eaab8 00:29:59.691 [2024-11-28 15:24:59.884561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:22108 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.691 [2024-11-28 15:24:59.884594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:59.691 [2024-11-28 15:24:59.896052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e4578 00:29:59.691 [2024-11-28 15:24:59.896743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:2032 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.692 [2024-11-28 15:24:59.896775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0069 p:0 m:0 dnr:0 00:29:59.692 [2024-11-28 15:24:59.907728] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e9e10 00:29:59.692 [2024-11-28 15:24:59.908425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:21684 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.692 [2024-11-28 15:24:59.908457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0068 p:0 m:0 dnr:0 00:29:59.692 [2024-11-28 15:24:59.920005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e38d0 00:29:59.692 [2024-11-28 15:24:59.920528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:13762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.692 [2024-11-28 15:24:59.920556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:24:59.932431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e23b8 00:29:59.952 [2024-11-28 15:24:59.933089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:3003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:24:59.933129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:24:59.944706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e2c28 00:29:59.952 [2024-11-28 15:24:59.945306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:20595 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:24:59.945356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:24:59.959264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190eea00 00:29:59.952 [2024-11-28 15:24:59.960846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:17377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:24:59.960877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:24:59.970071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fb8b8 00:29:59.952 [2024-11-28 15:24:59.971066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:16662 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:24:59.971107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:24:59.982408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f3e60 00:29:59.952 [2024-11-28 15:24:59.983373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:12105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:24:59.983400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:24:59.994631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e3498 00:29:59.952 [2024-11-28 15:24:59.995555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:20903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:24:59.995586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.006507] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190eea00 00:29:59.952 [2024-11-28 15:25:00.007826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:10228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.007862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.018970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e4140 00:29:59.952 [2024-11-28 15:25:00.019914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:2231 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.019959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.031401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e23b8 00:29:59.952 [2024-11-28 15:25:00.032253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:24816 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.032296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.043833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e4de8 00:29:59.952 [2024-11-28 15:25:00.044830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:1056 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.044866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.056299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e9e10 00:29:59.952 [2024-11-28 15:25:00.057398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:21135 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.057431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0079 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.068591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f8618 00:29:59.952 [2024-11-28 15:25:00.070249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:7858 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.070282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.080796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f46d0 00:29:59.952 [2024-11-28 15:25:00.081456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.081488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0055 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.093725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e49b0 00:29:59.952 [2024-11-28 15:25:00.094264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:8420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.094301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.107500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190fc560 00:29:59.952 [2024-11-28 15:25:00.108182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:22851 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.108212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.120004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e3060 00:29:59.952 [2024-11-28 15:25:00.120860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:8325 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.120893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.132178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e4140 00:29:59.952 [2024-11-28 15:25:00.133019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:18660 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.133054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0073 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.144430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f6020 00:29:59.952 [2024-11-28 15:25:00.145246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:2920 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.145278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0072 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.156757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190e38d0 00:29:59.952 [2024-11-28 15:25:00.157535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:1940 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.157570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0071 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.169029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190ff3c8 00:29:59.952 [2024-11-28 15:25:00.169733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:1308 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.169769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0070 p:0 m:0 dnr:0 00:29:59.952 [2024-11-28 15:25:00.181402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190eaab8 00:29:59.952 [2024-11-28 15:25:00.182081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:4017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:59.952 [2024-11-28 15:25:00.182128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:006f p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.193908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190ff3c8 00:30:00.212 [2024-11-28 15:25:00.194665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:25491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.194699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:006e p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.206488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.206770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.206805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.220070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.220352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.220400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.233705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.233981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14750 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.234015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.247467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.247733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:23482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.247766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.261201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.261485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.261520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.274884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.275169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:21890 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.275200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.288569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.288842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:17221 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.288875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.302265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.302542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2720 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.302575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.316005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.316271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.316302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.329709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.329968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:18523 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.330002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.343367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.343656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4141 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.343689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.357069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.357396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:19838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.357452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.370723] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.370985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:11990 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.371020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.384348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.384594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:15 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.384628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.397950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.398235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10451 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.398267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.411617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.411877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:24056 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.411911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.425201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.425514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:1941 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.425549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.212 [2024-11-28 15:25:00.438839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.212 [2024-11-28 15:25:00.439111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:16571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.212 [2024-11-28 15:25:00.439157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.453010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.453356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:11422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.453405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.466652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.466922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:23587 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.466957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.480138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.480449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13737 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.480484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.493824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.494088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:11246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.494144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.507465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.507734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:11240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.507767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.521079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.521357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:8325 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.521402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.534771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.535044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18980 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.535078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.548438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.548708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:6820 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.548742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.562079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.562428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:5626 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.562462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.575792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.576043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:18963 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.576078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.589458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.472 [2024-11-28 15:25:00.589732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:15365 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.472 [2024-11-28 15:25:00.589767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.472 [2024-11-28 15:25:00.603105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.603452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:22348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.603487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.616745] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.617008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:22287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.617042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.630421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.630694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:23604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.630729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.644077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.644364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:12863 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.644411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.657730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.657997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.658031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.671387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.671666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:2639 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.671700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.685181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.685478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:20668 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.685512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.473 [2024-11-28 15:25:00.698844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.473 [2024-11-28 15:25:00.699117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:23988 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.473 [2024-11-28 15:25:00.699163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.712805] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.713070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:19286 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.713119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.726436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.726683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:15316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.726718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.739842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.740115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:19952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.740163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.753366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.753649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13109 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.753684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.767020] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.767295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:23746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.767327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.780676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.780943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:11944 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.780978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.794230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.794492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:8328 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.794526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.807851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.808151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:8578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.808183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.821618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.821885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:54 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.821920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.835208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.835506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:19140 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.835547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.848777] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.849042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:14760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.849076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.862498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.862763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23375 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.862798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.876167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.876525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:2382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.876560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.889878] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.890162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:2834 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.890193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.903660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.903926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:5348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.732 [2024-11-28 15:25:00.903961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.732 [2024-11-28 15:25:00.917371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.732 [2024-11-28 15:25:00.917650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23868 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.733 [2024-11-28 15:25:00.917684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.733 [2024-11-28 15:25:00.931017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.733 [2024-11-28 15:25:00.931288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9497 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.733 [2024-11-28 15:25:00.931319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.733 [2024-11-28 15:25:00.944727] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.733 [2024-11-28 15:25:00.944992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:19307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.733 [2024-11-28 15:25:00.945026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.733 [2024-11-28 15:25:00.958337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.733 [2024-11-28 15:25:00.958723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:9796 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.733 [2024-11-28 15:25:00.958757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:00.972358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:00.972637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:2010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:00.972672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:00.986033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:00.986314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:19476 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:00.986345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:00.999635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:00.999903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17048 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:00.999937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.013230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.013554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:20541 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.013588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.026915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.027197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.027229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.040545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.040815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:22571 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.040849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.054218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.054517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:6228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.054551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.067784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.068048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:12723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.068082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.081508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.081770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:292 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.081805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.095117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.095467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:702 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.095501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.108899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.109180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:23366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.109211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.122581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.122842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1021 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.122876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.136238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.136577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:19105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.136611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.149903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.150164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:11929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.150196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.163499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.163774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4875 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.163808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.177200] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.177524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:7392 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.177558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.190924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.191208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:7799 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.191244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.204703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.204971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:2552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.205005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:00.992 [2024-11-28 15:25:01.218348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:00.992 [2024-11-28 15:25:01.218633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:18985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:00.992 [2024-11-28 15:25:01.218668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.232320] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.232631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:24721 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.232665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.246000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.246277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:3814 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.246309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.259576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.259843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:22669 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.259877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.273255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.273566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:17437 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.273600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.287011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.287362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:16310 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.287393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.300695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.301040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:18975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.301075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.314382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.314676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:22897 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.314710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.327989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.328260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:8013 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.328290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.341644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.341907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:357 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.341942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.355239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.355558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14405 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.355592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.368914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.251 [2024-11-28 15:25:01.369198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:24883 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.251 [2024-11-28 15:25:01.369229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.251 [2024-11-28 15:25:01.382569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.252 [2024-11-28 15:25:01.382831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:13076 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-28 15:25:01.382865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.252 [2024-11-28 15:25:01.396239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.252 [2024-11-28 15:25:01.396522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:7459 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-28 15:25:01.396556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.252 [2024-11-28 15:25:01.409906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.252 [2024-11-28 15:25:01.410191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:20840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-28 15:25:01.410222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.252 [2024-11-28 15:25:01.423642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0920) with pdu=0x2000190f0bc0 00:30:01.252 [2024-11-28 15:25:01.423914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:15314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:01.252 [2024-11-28 15:25:01.423947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:30:01.252 00:30:01.252 Latency(us) 00:30:01.252 [2024-11-28T14:25:01.486Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:01.252 [2024-11-28T14:25:01.486Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:30:01.252 nvme0n1 : 2.01 19441.87 75.94 0.00 0.00 6569.39 2657.85 16408.27 00:30:01.252 [2024-11-28T14:25:01.486Z] =================================================================================================================== 00:30:01.252 [2024-11-28T14:25:01.486Z] Total : 19441.87 75.94 0.00 0.00 6569.39 2657.85 16408.27 00:30:01.252 0 00:30:01.252 15:25:01 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:01.252 15:25:01 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:01.252 15:25:01 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:01.252 15:25:01 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:01.252 | .driver_specific 00:30:01.252 | .nvme_error 00:30:01.252 | .status_code 00:30:01.252 | .command_transient_transport_error' 00:30:01.511 15:25:01 -- host/digest.sh@71 -- # (( 152 > 0 )) 00:30:01.511 15:25:01 -- host/digest.sh@73 -- # killprocess 834338 00:30:01.511 15:25:01 -- common/autotest_common.sh@936 -- # '[' -z 834338 ']' 00:30:01.511 15:25:01 -- common/autotest_common.sh@940 -- # kill -0 834338 00:30:01.511 15:25:01 -- common/autotest_common.sh@941 -- # uname 00:30:01.511 15:25:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:01.511 15:25:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 834338 00:30:01.769 15:25:01 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:01.769 15:25:01 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:01.769 15:25:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 834338' 00:30:01.769 killing process with pid 834338 00:30:01.769 15:25:01 -- common/autotest_common.sh@955 -- # kill 834338 00:30:01.770 Received shutdown signal, test time was about 2.000000 seconds 00:30:01.770 00:30:01.770 Latency(us) 00:30:01.770 [2024-11-28T14:25:02.004Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:01.770 [2024-11-28T14:25:02.004Z] =================================================================================================================== 00:30:01.770 [2024-11-28T14:25:02.004Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:01.770 15:25:01 -- common/autotest_common.sh@960 -- # wait 834338 00:30:01.770 15:25:01 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:30:01.770 15:25:01 -- host/digest.sh@54 -- # local rw bs qd 00:30:01.770 15:25:01 -- host/digest.sh@56 -- # rw=randwrite 00:30:01.770 15:25:01 -- host/digest.sh@56 -- # bs=131072 00:30:01.770 15:25:01 -- host/digest.sh@56 -- # qd=16 00:30:01.770 15:25:01 -- host/digest.sh@58 -- # bperfpid=834844 00:30:01.770 15:25:01 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:30:01.770 15:25:01 -- host/digest.sh@60 -- # waitforlisten 834844 /var/tmp/bperf.sock 00:30:01.770 15:25:01 -- common/autotest_common.sh@829 -- # '[' -z 834844 ']' 00:30:01.770 15:25:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:30:01.770 15:25:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:01.770 15:25:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:30:01.770 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:30:01.770 15:25:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:01.770 15:25:01 -- common/autotest_common.sh@10 -- # set +x 00:30:02.027 [2024-11-28 15:25:02.018028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:02.028 [2024-11-28 15:25:02.018139] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid834844 ] 00:30:02.028 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:02.028 Zero copy mechanism will not be used. 00:30:02.028 EAL: No free 2048 kB hugepages reported on node 1 00:30:02.028 [2024-11-28 15:25:02.083020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:02.028 [2024-11-28 15:25:02.176669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:02.961 15:25:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:02.961 15:25:03 -- common/autotest_common.sh@862 -- # return 0 00:30:02.961 15:25:03 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:02.961 15:25:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:30:03.219 15:25:03 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:30:03.219 15:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:03.219 15:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:03.219 15:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.219 15:25:03 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:03.219 15:25:03 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:03.786 nvme0n1 00:30:03.786 15:25:03 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:03.786 15:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:03.786 15:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:03.786 15:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:03.786 15:25:03 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:03.786 15:25:03 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:03.786 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:03.786 Zero copy mechanism will not be used. 00:30:03.786 Running I/O for 2 seconds... 00:30:03.786 [2024-11-28 15:25:03.919657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.920122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.786 [2024-11-28 15:25:03.920183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:03.786 [2024-11-28 15:25:03.925573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.925827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.786 [2024-11-28 15:25:03.925861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:03.786 [2024-11-28 15:25:03.929957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.930083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.786 [2024-11-28 15:25:03.930128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:03.786 [2024-11-28 15:25:03.934458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.934585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.786 [2024-11-28 15:25:03.934616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.786 [2024-11-28 15:25:03.939990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.940088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.786 [2024-11-28 15:25:03.940143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:03.786 [2024-11-28 15:25:03.944687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.944835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.786 [2024-11-28 15:25:03.944865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:03.786 [2024-11-28 15:25:03.949050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.786 [2024-11-28 15:25:03.949228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.949260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.953518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.953663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.953693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.958145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.958378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.958409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.962475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.962689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.962721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.967540] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.967724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.967756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.973119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.973302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.973333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.978707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.978863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.978892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.984050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.984245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.984276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.989429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.989586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.989617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:03.994920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:03.995085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:03.995123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:04.000265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:04.000431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:04.000461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:04.005991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:04.006150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:04.006180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:04.011270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:04.011566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:04.011596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:03.787 [2024-11-28 15:25:04.016348] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:03.787 [2024-11-28 15:25:04.016463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:03.787 [2024-11-28 15:25:04.016495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.021577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.021863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.021895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.026780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.027070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.027116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.031961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.032118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.032149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.037143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.037304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.037334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.042170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.042294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.042328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.047336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.047517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.047547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.052413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.052573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.052604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.057584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.057794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.057825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.062668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.062947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.062978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.067853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.068119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.068150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.072891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.073133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.073171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.078059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.078362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.078394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.083182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.083357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.083387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.088220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.088366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.088396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.093241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.093384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.093414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.098337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.098491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.098522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.103570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.103758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.103788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.108641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.108823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.108853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.114003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.114279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.114311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.119172] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.119325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.119357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.124343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.124540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.124572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.129026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.129186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.129217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.133245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.133438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.133469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.137366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.137529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.137560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.141429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.141606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.048 [2024-11-28 15:25:04.141637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.048 [2024-11-28 15:25:04.145513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.048 [2024-11-28 15:25:04.145663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.145694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.149693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.149889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.149922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.153922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.154174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.154206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.158077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.158313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.158345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.162168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.162326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.162357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.166171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.166349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.166380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.170213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.170337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.170379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.174310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.174479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.174510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.178606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.178773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.178803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.183790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.184007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.184038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.188788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.189005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.189037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.194924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.195102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.195139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.199465] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.199651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.199683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.203506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.203628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.203661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.207605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.207790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.207821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.211945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.212132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.212163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.217066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.217244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.217275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.222987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.223216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.223247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.228011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.228176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.228208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.232299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.232432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.232463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.236577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.236728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.236759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.241618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.241748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.241780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.246256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.246335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.246376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.250860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.251033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.251064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.255427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.255608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.255640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.260190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.260412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.260444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.265053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.049 [2024-11-28 15:25:04.265171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.049 [2024-11-28 15:25:04.265206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.049 [2024-11-28 15:25:04.269621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.050 [2024-11-28 15:25:04.269748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.050 [2024-11-28 15:25:04.269777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.050 [2024-11-28 15:25:04.274293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.050 [2024-11-28 15:25:04.274470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.050 [2024-11-28 15:25:04.274501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.050 [2024-11-28 15:25:04.278929] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.050 [2024-11-28 15:25:04.279021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.050 [2024-11-28 15:25:04.279057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.283587] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.283725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.310 [2024-11-28 15:25:04.283756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.288286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.288478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.310 [2024-11-28 15:25:04.288507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.292920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.293117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.310 [2024-11-28 15:25:04.293147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.297438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.297571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.310 [2024-11-28 15:25:04.297602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.301991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.302118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.310 [2024-11-28 15:25:04.302152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.306694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.306838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.310 [2024-11-28 15:25:04.306869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.310 [2024-11-28 15:25:04.311326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.310 [2024-11-28 15:25:04.311436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.311469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.316335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.316479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.316515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.321469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.321630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.321661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.325899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.326071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.326109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.330496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.330718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.330749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.335031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.335172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.335203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.339516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.339611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.339648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.344902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.345001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.345037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.349511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.349613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.349647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.354187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.354291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.354328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.358771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.358929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.358966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.363379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.363485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.363519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.368105] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.368277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.368308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.372561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.372684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.372714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.377224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.377320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.377356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.381674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.381787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.381819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.386056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.386209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.386241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.390510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.390582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.390615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.395069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.395227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.395258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.399535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.399705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.399736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.403938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.404140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.404171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.408025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.311 [2024-11-28 15:25:04.408191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.311 [2024-11-28 15:25:04.408223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.311 [2024-11-28 15:25:04.412483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.412626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.412659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.416992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.417152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.417197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.421396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.421544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.421580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.425731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.425858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.425889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.430011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.430164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.430196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.434440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.434623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.434654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.438893] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.439066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.439108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.443410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.443524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.443556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.447981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.448109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.448141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.452325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.452456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.452487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.456860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.457002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.457034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.461334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.461410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.461445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.465887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.466056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.466087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.470247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.470434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.470466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.474545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.474728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.474766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.479010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.479163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.479194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.483470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.483607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.483638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.487832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.487937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.487971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.492411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.492488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.492532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.496685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.496785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.312 [2024-11-28 15:25:04.496819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.312 [2024-11-28 15:25:04.501226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.312 [2024-11-28 15:25:04.501399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.501430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.505859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.506048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.506079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.510316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.510488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.510519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.514843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.514968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.514999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.519302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.519427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.519458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.523917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.524014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.524051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.528252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.528394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.528424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.532516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.532624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.532657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.536897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.537056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.537086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.313 [2024-11-28 15:25:04.541677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.313 [2024-11-28 15:25:04.541860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.313 [2024-11-28 15:25:04.541891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.546256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.546441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.546472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.551117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.551243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.551276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.555766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.555903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.555935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.560421] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.560610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.560642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.565707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.565822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.565857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.569952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.570078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.570144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.574310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.574512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.574543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.578541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.578727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.578758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.582976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.583205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.583236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.587660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.587834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.587865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.592822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.593007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.593047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.574 [2024-11-28 15:25:04.598588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.574 [2024-11-28 15:25:04.598765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.574 [2024-11-28 15:25:04.598814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.604064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.604252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.604296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.608291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.608438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.608469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.612683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.612803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.612834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.617177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.617315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.617347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.621514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.621639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.621674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.625999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.626242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.626274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.630211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.630351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.630382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.634629] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.634809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.634840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.639208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.639332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.639364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.643528] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.643665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.643696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.648056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.648248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.648280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.652593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.652762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.652793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.657074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.657306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.657337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.661318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.661501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.661532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.665714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.665850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.665881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.670263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.670410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.670441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.674479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.674659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.674690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.678809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.678937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.678967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.683171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.683359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.683391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.687548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.687714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.687744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.691985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.692187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.575 [2024-11-28 15:25:04.692218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.575 [2024-11-28 15:25:04.696515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.575 [2024-11-28 15:25:04.696678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.696709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.700966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.701151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.701183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.705525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.705758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.705790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.709936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.710151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.710204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.714487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.714661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.714696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.718914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.719140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.719172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.723334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.723479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.723510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.727882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.728044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.728076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.732131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.732303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.732335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.736491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.736700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.736732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.741592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.741812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.741842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.746718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.746876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.746912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.752389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.752555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.752586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.757976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.758167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.758198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.762331] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.762566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.762614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.767005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.767241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.767274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.771263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.771492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.771523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.775688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.775848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.775878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.780704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.780932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.780982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.786449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.786648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.786682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.791788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.791929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.791977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.576 [2024-11-28 15:25:04.796479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.576 [2024-11-28 15:25:04.796662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.576 [2024-11-28 15:25:04.796693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.577 [2024-11-28 15:25:04.801821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.577 [2024-11-28 15:25:04.802002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.577 [2024-11-28 15:25:04.802034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.806848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.807038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.807069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.812045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.812233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.812264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.817397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.817648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.817680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.822577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.822748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.822779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.827856] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.827993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.828025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.833177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.833398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.833430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.838294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.838457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.838493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.843624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.843788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.843819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.848970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.849262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.849293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.853870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.854079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.854121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.859344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.859465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.859497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.865146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.865313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.865344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.837 [2024-11-28 15:25:04.869444] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.837 [2024-11-28 15:25:04.869560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.837 [2024-11-28 15:25:04.869593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.873700] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.873871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.873901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.878010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.878127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.878162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.882370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.882518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.882553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.886862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.887061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.887100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.891159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.891314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.891345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.895555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.895763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.895794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.900162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.900449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.900480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.904567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.904735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.904765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.908974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.909090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.909132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.913286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.913390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.913424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.918380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.918515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.918546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.923579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.923740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.923775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.928852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.929043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.929075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.933889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.934063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.934102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.939786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.939970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.940001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.945036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.945224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.945257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.950134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.950286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.950318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.955395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.955609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.955640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.960620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.960814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.960844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.965541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.965658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.965694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.970673] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.970942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.970973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.975972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.976193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.976224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.981464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.981755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.981806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.986911] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.987076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.987116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.991948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.992318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.992350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:04.997067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:04.997276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:04.997307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.838 [2024-11-28 15:25:05.002245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.838 [2024-11-28 15:25:05.002407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.838 [2024-11-28 15:25:05.002438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.007716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.007948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.007979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.012848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.013017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.013049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.018265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.018470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.018502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.023440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.023568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.023616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.028955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.029148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.029180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.033771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.033996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.034028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.038182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.038389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.038420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.043411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.043548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.043581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.049674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.050011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.050046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.054948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.055205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.055237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.059311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.059518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.059550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.063756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.063896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.063928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:04.839 [2024-11-28 15:25:05.068159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:04.839 [2024-11-28 15:25:05.068267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:04.839 [2024-11-28 15:25:05.068302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.072539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.072660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.072691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.077533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.077759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.077791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.082577] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.082695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.082727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.087739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.088064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.088109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.093515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.093755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.093787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.097990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.098231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.098263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.102119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.102281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.102312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.106586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.106736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.106783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.111746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.111888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.111919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.115944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.116071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.116112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.119988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.120126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.120158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.124222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.124424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.124455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.128326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.128529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.098 [2024-11-28 15:25:05.128560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.098 [2024-11-28 15:25:05.132429] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.098 [2024-11-28 15:25:05.132655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.132686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.136500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.136681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.136718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.140600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.140713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.140745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.144810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.145009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.145041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.148850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.149006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.149037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.152839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.152951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.152983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.156987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.157196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.157228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.161110] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.161307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.161339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.165175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.165384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.165416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.169150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.169334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.169366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.173189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.173319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.173350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.177397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.177608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.177640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.181419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.181537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.181576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.185328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.185437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.185471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.189431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.189632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.189663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.193458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.193652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.193683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.197558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.197778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.197811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.201837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.202004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.202036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.205834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.205950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.205982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.209907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.210103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.210135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.213994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.214153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.214185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.217956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.218066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.218110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.222154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.222354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.222404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.226290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.226492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.226524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.230373] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.230597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.230629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.234488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.234668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.234699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.238552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.238654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.238688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.242676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.242869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.242906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.246811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.246964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.247000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.251136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.251256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.251287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.255371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.255571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.255603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.259343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.259557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.259589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.263462] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.263689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.263739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.267552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.267737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.267769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.271733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.271842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.271876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.276076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.276272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.276305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.280278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.280412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.280443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.284426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.284541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.284573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.288530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.288733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.288765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.292645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.292843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.292881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.099 [2024-11-28 15:25:05.296807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.099 [2024-11-28 15:25:05.296999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.099 [2024-11-28 15:25:05.297034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.300855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.301033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.301068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.304903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.305027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.305058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.309002] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.309199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.309232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.313042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.313220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.313252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.317250] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.317411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.317442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.321398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.321600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.321632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.325455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.325581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.325612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.100 [2024-11-28 15:25:05.329760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.100 [2024-11-28 15:25:05.329950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.100 [2024-11-28 15:25:05.329982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.359 [2024-11-28 15:25:05.334013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.359 [2024-11-28 15:25:05.334202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.359 [2024-11-28 15:25:05.334234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.359 [2024-11-28 15:25:05.338326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.359 [2024-11-28 15:25:05.338467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.359 [2024-11-28 15:25:05.338499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.359 [2024-11-28 15:25:05.342513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.359 [2024-11-28 15:25:05.342699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.359 [2024-11-28 15:25:05.342730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.359 [2024-11-28 15:25:05.346680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.359 [2024-11-28 15:25:05.346812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.359 [2024-11-28 15:25:05.346843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.359 [2024-11-28 15:25:05.350858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.351055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.351100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.355075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.355286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.355318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.359220] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.359419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.359451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.363885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.364111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.364142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.368862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.369075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.369118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.374386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.374689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.374720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.380240] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.380450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.380482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.384574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.384741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.384773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.388902] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.389032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.389064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.393694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.393858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.393889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.399032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.399140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.399177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.404073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.404221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.404251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.410212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.410501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.410533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.415505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.415734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.415766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.420455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.420673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.420704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.425646] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.425866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.425896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.430812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.430994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.431025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.435990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.436174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.436205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.441298] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.441463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.441494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.446549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.446729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.446761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.452252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.452402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.452432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.360 [2024-11-28 15:25:05.458450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.360 [2024-11-28 15:25:05.458737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.360 [2024-11-28 15:25:05.458769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.463467] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.463618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.463650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.467796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.467970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.468003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.471869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.471991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.472023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.476040] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.476176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.476207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.480178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.480310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.480348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.484622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.484831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.484863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.488873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.489143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.489175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.493396] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.493671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.493718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.498492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.498651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.498681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.504176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.504328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.504358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.509768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.509953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.509985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.513971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.514163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.514195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.518254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.518486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.518518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.522272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.522498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.522530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.526508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.526705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.526737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.530715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.530868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.530899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.534955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.535106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.535137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.539166] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.539271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.539308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.543409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.543597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.543647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.547827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.547994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.548025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.361 [2024-11-28 15:25:05.552216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.361 [2024-11-28 15:25:05.552467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.361 [2024-11-28 15:25:05.552503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.556418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.556589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.556621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.560432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.560587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.560619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.564505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.564651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.564683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.568520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.568663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.568695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.572536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.572654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.572687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.576644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.576813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.576845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.580815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.581007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.581055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.585010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.585236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.585268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.362 [2024-11-28 15:25:05.589087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.362 [2024-11-28 15:25:05.589277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.362 [2024-11-28 15:25:05.589308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.593374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.593553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.593606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.597512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.597679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.597710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.601645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.601772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.601802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.605622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.605732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.605765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.609729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.609919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.609969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.613753] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.613896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.613927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.617908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.618136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.618168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.622026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.622226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.622257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.626162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.626309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.626341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.630384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.630551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.630584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.634416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.634527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.634563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.638453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.638558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.638596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.642709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.642881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.642912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.646851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.647007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.647042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.651048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.651265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.651298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.655434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.655689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.655721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.660497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.622 [2024-11-28 15:25:05.660689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.622 [2024-11-28 15:25:05.660720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.622 [2024-11-28 15:25:05.665711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.665938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.665969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.671493] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.671701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.671735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.677323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.677492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.677522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.682422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.682632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.682662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.687687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.687901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.687933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.693749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.693949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.693981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.698749] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.698889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.698921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.703149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.703304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.703335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.707637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.707781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.707813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.711968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.712105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.712141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.716521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.716689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.716720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.720969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.721138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.721169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.725496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.725668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.725700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.730193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.730381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.730413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.734784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.734923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.734955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.739406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.623 [2024-11-28 15:25:05.739583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.623 [2024-11-28 15:25:05.739613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.623 [2024-11-28 15:25:05.744034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.744193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.744224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.748525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.748681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.748712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.752967] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.753091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.753137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.758162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.758312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.758342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.763457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.763792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.763824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.769706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.769920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.769951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.774417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.774579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.774611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.778474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.778602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.778634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.782819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.782964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.782995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.788306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.788409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.788447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.792687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.792790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.792824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.796715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.796817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.796852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.800806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.801042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.801074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.805153] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.805340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.805372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.809628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.809888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.809919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.814628] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.814822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.814852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.819779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.819926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.819957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.825891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.826073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.826111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.830299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.830562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.830593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.835567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.624 [2024-11-28 15:25:05.835841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.624 [2024-11-28 15:25:05.835872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.624 [2024-11-28 15:25:05.840944] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.625 [2024-11-28 15:25:05.841194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.625 [2024-11-28 15:25:05.841225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.625 [2024-11-28 15:25:05.847140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.625 [2024-11-28 15:25:05.847220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.625 [2024-11-28 15:25:05.847258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.625 [2024-11-28 15:25:05.851659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.625 [2024-11-28 15:25:05.851763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.625 [2024-11-28 15:25:05.851799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.883 [2024-11-28 15:25:05.856149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.883 [2024-11-28 15:25:05.856299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.883 [2024-11-28 15:25:05.856330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.883 [2024-11-28 15:25:05.860669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.883 [2024-11-28 15:25:05.860842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.883 [2024-11-28 15:25:05.860872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.883 [2024-11-28 15:25:05.864992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.883 [2024-11-28 15:25:05.865143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.883 [2024-11-28 15:25:05.865174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.869570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.869728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.869758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.873982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.874214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.874246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.878366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.878523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.878560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.883216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.883362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.883392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.888364] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.888585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.888619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.893822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.894027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.894060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.900008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.900153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.900183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.904957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.905144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.905175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.909336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.909479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.909511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:05.884 [2024-11-28 15:25:05.914112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x5e0c60) with pdu=0x2000190fef90 00:30:05.884 [2024-11-28 15:25:05.914337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:05.884 [2024-11-28 15:25:05.914368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:05.884 00:30:05.884 Latency(us) 00:30:05.884 [2024-11-28T14:25:06.118Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:05.884 [2024-11-28T14:25:06.118Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:05.884 nvme0n1 : 2.00 6650.87 831.36 0.00 0.00 2398.72 1796.17 6893.42 00:30:05.884 [2024-11-28T14:25:06.118Z] =================================================================================================================== 00:30:05.884 [2024-11-28T14:25:06.118Z] Total : 6650.87 831.36 0.00 0.00 2398.72 1796.17 6893.42 00:30:05.884 0 00:30:05.884 15:25:05 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:05.884 15:25:05 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:05.884 15:25:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:05.884 15:25:05 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:05.884 | .driver_specific 00:30:05.884 | .nvme_error 00:30:05.884 | .status_code 00:30:05.884 | .command_transient_transport_error' 00:30:06.142 15:25:06 -- host/digest.sh@71 -- # (( 429 > 0 )) 00:30:06.142 15:25:06 -- host/digest.sh@73 -- # killprocess 834844 00:30:06.142 15:25:06 -- common/autotest_common.sh@936 -- # '[' -z 834844 ']' 00:30:06.142 15:25:06 -- common/autotest_common.sh@940 -- # kill -0 834844 00:30:06.142 15:25:06 -- common/autotest_common.sh@941 -- # uname 00:30:06.142 15:25:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:06.142 15:25:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 834844 00:30:06.142 15:25:06 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:06.142 15:25:06 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:06.142 15:25:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 834844' 00:30:06.142 killing process with pid 834844 00:30:06.142 15:25:06 -- common/autotest_common.sh@955 -- # kill 834844 00:30:06.142 Received shutdown signal, test time was about 2.000000 seconds 00:30:06.142 00:30:06.142 Latency(us) 00:30:06.142 [2024-11-28T14:25:06.376Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:06.142 [2024-11-28T14:25:06.376Z] =================================================================================================================== 00:30:06.142 [2024-11-28T14:25:06.376Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:06.143 15:25:06 -- common/autotest_common.sh@960 -- # wait 834844 00:30:06.401 15:25:06 -- host/digest.sh@115 -- # killprocess 833205 00:30:06.401 15:25:06 -- common/autotest_common.sh@936 -- # '[' -z 833205 ']' 00:30:06.401 15:25:06 -- common/autotest_common.sh@940 -- # kill -0 833205 00:30:06.401 15:25:06 -- common/autotest_common.sh@941 -- # uname 00:30:06.401 15:25:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:06.401 15:25:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 833205 00:30:06.401 15:25:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:06.401 15:25:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:06.401 15:25:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 833205' 00:30:06.401 killing process with pid 833205 00:30:06.401 15:25:06 -- common/autotest_common.sh@955 -- # kill 833205 00:30:06.401 15:25:06 -- common/autotest_common.sh@960 -- # wait 833205 00:30:06.660 00:30:06.660 real 0m17.331s 00:30:06.660 user 0m34.898s 00:30:06.660 sys 0m4.555s 00:30:06.660 15:25:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:06.660 15:25:06 -- common/autotest_common.sh@10 -- # set +x 00:30:06.660 ************************************ 00:30:06.660 END TEST nvmf_digest_error 00:30:06.660 ************************************ 00:30:06.660 15:25:06 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:06.660 15:25:06 -- host/digest.sh@139 -- # nvmftestfini 00:30:06.660 15:25:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:06.660 15:25:06 -- nvmf/common.sh@116 -- # sync 00:30:06.660 15:25:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:06.660 15:25:06 -- nvmf/common.sh@119 -- # set +e 00:30:06.660 15:25:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:06.660 15:25:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:06.660 rmmod nvme_tcp 00:30:06.660 rmmod nvme_fabrics 00:30:06.660 rmmod nvme_keyring 00:30:06.660 15:25:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:06.660 15:25:06 -- nvmf/common.sh@123 -- # set -e 00:30:06.660 15:25:06 -- nvmf/common.sh@124 -- # return 0 00:30:06.660 15:25:06 -- nvmf/common.sh@477 -- # '[' -n 833205 ']' 00:30:06.660 15:25:06 -- nvmf/common.sh@478 -- # killprocess 833205 00:30:06.660 15:25:06 -- common/autotest_common.sh@936 -- # '[' -z 833205 ']' 00:30:06.660 15:25:06 -- common/autotest_common.sh@940 -- # kill -0 833205 00:30:06.660 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (833205) - No such process 00:30:06.660 15:25:06 -- common/autotest_common.sh@963 -- # echo 'Process with pid 833205 is not found' 00:30:06.660 Process with pid 833205 is not found 00:30:06.660 15:25:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:06.660 15:25:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:06.660 15:25:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:06.660 15:25:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:06.660 15:25:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:06.660 15:25:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:06.660 15:25:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:06.660 15:25:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:09.195 15:25:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:09.195 00:30:09.195 real 0m37.320s 00:30:09.195 user 1m5.519s 00:30:09.195 sys 0m10.795s 00:30:09.195 15:25:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:09.195 15:25:08 -- common/autotest_common.sh@10 -- # set +x 00:30:09.195 ************************************ 00:30:09.195 END TEST nvmf_digest 00:30:09.195 ************************************ 00:30:09.195 15:25:08 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:09.195 15:25:08 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:09.195 15:25:08 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:09.195 15:25:08 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:09.195 15:25:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:09.195 15:25:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:09.195 15:25:08 -- common/autotest_common.sh@10 -- # set +x 00:30:09.195 ************************************ 00:30:09.195 START TEST nvmf_bdevperf 00:30:09.195 ************************************ 00:30:09.195 15:25:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:09.195 * Looking for test storage... 00:30:09.195 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:09.195 15:25:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:09.195 15:25:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:09.195 15:25:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:09.195 15:25:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:09.195 15:25:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:09.195 15:25:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:09.195 15:25:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:09.195 15:25:08 -- scripts/common.sh@335 -- # IFS=.-: 00:30:09.195 15:25:08 -- scripts/common.sh@335 -- # read -ra ver1 00:30:09.195 15:25:08 -- scripts/common.sh@336 -- # IFS=.-: 00:30:09.195 15:25:08 -- scripts/common.sh@336 -- # read -ra ver2 00:30:09.195 15:25:08 -- scripts/common.sh@337 -- # local 'op=<' 00:30:09.195 15:25:08 -- scripts/common.sh@339 -- # ver1_l=2 00:30:09.195 15:25:08 -- scripts/common.sh@340 -- # ver2_l=1 00:30:09.195 15:25:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:09.195 15:25:08 -- scripts/common.sh@343 -- # case "$op" in 00:30:09.195 15:25:08 -- scripts/common.sh@344 -- # : 1 00:30:09.195 15:25:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:09.195 15:25:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:09.195 15:25:08 -- scripts/common.sh@364 -- # decimal 1 00:30:09.195 15:25:08 -- scripts/common.sh@352 -- # local d=1 00:30:09.195 15:25:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:09.195 15:25:08 -- scripts/common.sh@354 -- # echo 1 00:30:09.195 15:25:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:09.195 15:25:08 -- scripts/common.sh@365 -- # decimal 2 00:30:09.195 15:25:08 -- scripts/common.sh@352 -- # local d=2 00:30:09.195 15:25:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:09.195 15:25:08 -- scripts/common.sh@354 -- # echo 2 00:30:09.195 15:25:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:09.195 15:25:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:09.195 15:25:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:09.195 15:25:08 -- scripts/common.sh@367 -- # return 0 00:30:09.195 15:25:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:09.195 15:25:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:09.195 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:09.195 --rc genhtml_branch_coverage=1 00:30:09.195 --rc genhtml_function_coverage=1 00:30:09.195 --rc genhtml_legend=1 00:30:09.195 --rc geninfo_all_blocks=1 00:30:09.195 --rc geninfo_unexecuted_blocks=1 00:30:09.195 00:30:09.195 ' 00:30:09.195 15:25:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:09.195 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:09.195 --rc genhtml_branch_coverage=1 00:30:09.195 --rc genhtml_function_coverage=1 00:30:09.195 --rc genhtml_legend=1 00:30:09.195 --rc geninfo_all_blocks=1 00:30:09.195 --rc geninfo_unexecuted_blocks=1 00:30:09.195 00:30:09.195 ' 00:30:09.195 15:25:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:09.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:09.196 --rc genhtml_branch_coverage=1 00:30:09.196 --rc genhtml_function_coverage=1 00:30:09.196 --rc genhtml_legend=1 00:30:09.196 --rc geninfo_all_blocks=1 00:30:09.196 --rc geninfo_unexecuted_blocks=1 00:30:09.196 00:30:09.196 ' 00:30:09.196 15:25:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:09.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:09.196 --rc genhtml_branch_coverage=1 00:30:09.196 --rc genhtml_function_coverage=1 00:30:09.196 --rc genhtml_legend=1 00:30:09.196 --rc geninfo_all_blocks=1 00:30:09.196 --rc geninfo_unexecuted_blocks=1 00:30:09.196 00:30:09.196 ' 00:30:09.196 15:25:08 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:09.196 15:25:08 -- nvmf/common.sh@7 -- # uname -s 00:30:09.196 15:25:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:09.196 15:25:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:09.196 15:25:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:09.196 15:25:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:09.196 15:25:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:09.196 15:25:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:09.196 15:25:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:09.196 15:25:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:09.196 15:25:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:09.196 15:25:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:09.196 15:25:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:09.196 15:25:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:09.196 15:25:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:09.196 15:25:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:09.196 15:25:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:09.196 15:25:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:09.196 15:25:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:09.196 15:25:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:09.196 15:25:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:09.196 15:25:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:09.196 15:25:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:09.196 15:25:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:09.196 15:25:08 -- paths/export.sh@5 -- # export PATH 00:30:09.196 15:25:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:09.196 15:25:08 -- nvmf/common.sh@46 -- # : 0 00:30:09.196 15:25:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:09.196 15:25:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:09.196 15:25:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:09.196 15:25:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:09.196 15:25:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:09.196 15:25:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:09.196 15:25:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:09.196 15:25:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:09.196 15:25:08 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:09.196 15:25:08 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:09.196 15:25:08 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:09.196 15:25:08 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:09.196 15:25:08 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:09.196 15:25:08 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:09.196 15:25:08 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:09.196 15:25:08 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:09.196 15:25:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:09.196 15:25:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:09.196 15:25:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:09.196 15:25:08 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:09.196 15:25:08 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:09.196 15:25:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:09.196 15:25:08 -- common/autotest_common.sh@10 -- # set +x 00:30:11.098 15:25:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:11.098 15:25:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:11.098 15:25:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:11.098 15:25:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:11.098 15:25:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:11.098 15:25:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:11.098 15:25:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:11.098 15:25:10 -- nvmf/common.sh@294 -- # net_devs=() 00:30:11.098 15:25:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:11.098 15:25:10 -- nvmf/common.sh@295 -- # e810=() 00:30:11.098 15:25:10 -- nvmf/common.sh@295 -- # local -ga e810 00:30:11.098 15:25:10 -- nvmf/common.sh@296 -- # x722=() 00:30:11.098 15:25:10 -- nvmf/common.sh@296 -- # local -ga x722 00:30:11.098 15:25:10 -- nvmf/common.sh@297 -- # mlx=() 00:30:11.098 15:25:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:11.098 15:25:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:11.098 15:25:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:11.098 15:25:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:11.098 15:25:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:11.098 15:25:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:11.098 15:25:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:11.098 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:11.098 15:25:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:11.098 15:25:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:11.098 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:11.098 15:25:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:11.098 15:25:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:11.098 15:25:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:11.098 15:25:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:11.098 15:25:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:11.098 15:25:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:11.098 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:11.098 15:25:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:11.098 15:25:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:11.098 15:25:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:11.098 15:25:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:11.098 15:25:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:11.098 15:25:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:11.098 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:11.098 15:25:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:11.098 15:25:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:11.098 15:25:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:11.098 15:25:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:11.098 15:25:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:11.098 15:25:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:11.098 15:25:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:11.098 15:25:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:11.098 15:25:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:11.098 15:25:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:11.098 15:25:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:11.098 15:25:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:11.098 15:25:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:11.098 15:25:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:11.098 15:25:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:11.098 15:25:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:11.098 15:25:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:11.098 15:25:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:11.098 15:25:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:11.098 15:25:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:11.098 15:25:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:11.098 15:25:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:11.098 15:25:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:11.098 15:25:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:11.098 15:25:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:11.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:11.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.223 ms 00:30:11.098 00:30:11.098 --- 10.0.0.2 ping statistics --- 00:30:11.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:11.098 rtt min/avg/max/mdev = 0.223/0.223/0.223/0.000 ms 00:30:11.098 15:25:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:11.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:11.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:30:11.098 00:30:11.098 --- 10.0.0.1 ping statistics --- 00:30:11.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:11.098 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:30:11.098 15:25:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:11.098 15:25:11 -- nvmf/common.sh@410 -- # return 0 00:30:11.098 15:25:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:11.098 15:25:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:11.098 15:25:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:11.098 15:25:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:11.098 15:25:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:11.098 15:25:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:11.098 15:25:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:11.098 15:25:11 -- host/bdevperf.sh@25 -- # tgt_init 00:30:11.098 15:25:11 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:11.098 15:25:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:11.099 15:25:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:11.099 15:25:11 -- common/autotest_common.sh@10 -- # set +x 00:30:11.099 15:25:11 -- nvmf/common.sh@469 -- # nvmfpid=837371 00:30:11.099 15:25:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:11.099 15:25:11 -- nvmf/common.sh@470 -- # waitforlisten 837371 00:30:11.099 15:25:11 -- common/autotest_common.sh@829 -- # '[' -z 837371 ']' 00:30:11.099 15:25:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:11.099 15:25:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:11.099 15:25:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:11.099 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:11.099 15:25:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:11.099 15:25:11 -- common/autotest_common.sh@10 -- # set +x 00:30:11.099 [2024-11-28 15:25:11.186357] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:11.099 [2024-11-28 15:25:11.186458] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:11.099 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.099 [2024-11-28 15:25:11.255574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:11.357 [2024-11-28 15:25:11.347423] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:11.357 [2024-11-28 15:25:11.347586] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:11.357 [2024-11-28 15:25:11.347607] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:11.357 [2024-11-28 15:25:11.347621] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:11.357 [2024-11-28 15:25:11.347704] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:11.357 [2024-11-28 15:25:11.347831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:11.357 [2024-11-28 15:25:11.347834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:11.922 15:25:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:11.922 15:25:12 -- common/autotest_common.sh@862 -- # return 0 00:30:11.922 15:25:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:11.922 15:25:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:11.922 15:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:12.181 15:25:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:12.181 15:25:12 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:12.181 15:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.181 15:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:12.181 [2024-11-28 15:25:12.168124] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:12.181 15:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.181 15:25:12 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:12.181 15:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.181 15:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:12.181 Malloc0 00:30:12.181 15:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.181 15:25:12 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:12.181 15:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.181 15:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:12.181 15:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.181 15:25:12 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:12.181 15:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.181 15:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:12.181 15:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.181 15:25:12 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:12.181 15:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:12.181 15:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:12.181 [2024-11-28 15:25:12.223676] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:12.181 15:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:12.181 15:25:12 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:12.181 15:25:12 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:12.181 15:25:12 -- nvmf/common.sh@520 -- # config=() 00:30:12.181 15:25:12 -- nvmf/common.sh@520 -- # local subsystem config 00:30:12.181 15:25:12 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:12.181 15:25:12 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:12.181 { 00:30:12.181 "params": { 00:30:12.181 "name": "Nvme$subsystem", 00:30:12.181 "trtype": "$TEST_TRANSPORT", 00:30:12.181 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:12.181 "adrfam": "ipv4", 00:30:12.181 "trsvcid": "$NVMF_PORT", 00:30:12.181 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:12.181 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:12.181 "hdgst": ${hdgst:-false}, 00:30:12.181 "ddgst": ${ddgst:-false} 00:30:12.181 }, 00:30:12.181 "method": "bdev_nvme_attach_controller" 00:30:12.181 } 00:30:12.181 EOF 00:30:12.181 )") 00:30:12.181 15:25:12 -- nvmf/common.sh@542 -- # cat 00:30:12.181 15:25:12 -- nvmf/common.sh@544 -- # jq . 00:30:12.181 15:25:12 -- nvmf/common.sh@545 -- # IFS=, 00:30:12.181 15:25:12 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:12.181 "params": { 00:30:12.181 "name": "Nvme1", 00:30:12.181 "trtype": "tcp", 00:30:12.181 "traddr": "10.0.0.2", 00:30:12.181 "adrfam": "ipv4", 00:30:12.181 "trsvcid": "4420", 00:30:12.181 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:12.181 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:12.181 "hdgst": false, 00:30:12.181 "ddgst": false 00:30:12.181 }, 00:30:12.181 "method": "bdev_nvme_attach_controller" 00:30:12.181 }' 00:30:12.181 [2024-11-28 15:25:12.272921] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:12.181 [2024-11-28 15:25:12.273007] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid837482 ] 00:30:12.181 EAL: No free 2048 kB hugepages reported on node 1 00:30:12.181 [2024-11-28 15:25:12.334983] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:12.439 [2024-11-28 15:25:12.425181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:12.697 Running I/O for 1 seconds... 00:30:13.632 00:30:13.632 Latency(us) 00:30:13.632 [2024-11-28T14:25:13.866Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:13.632 [2024-11-28T14:25:13.866Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:13.632 Verification LBA range: start 0x0 length 0x4000 00:30:13.632 Nvme1n1 : 1.01 12812.36 50.05 0.00 0.00 9946.68 1304.65 15534.46 00:30:13.632 [2024-11-28T14:25:13.866Z] =================================================================================================================== 00:30:13.632 [2024-11-28T14:25:13.866Z] Total : 12812.36 50.05 0.00 0.00 9946.68 1304.65 15534.46 00:30:13.890 15:25:13 -- host/bdevperf.sh@30 -- # bdevperfpid=837704 00:30:13.890 15:25:13 -- host/bdevperf.sh@32 -- # sleep 3 00:30:13.890 15:25:13 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:13.890 15:25:13 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:13.890 15:25:13 -- nvmf/common.sh@520 -- # config=() 00:30:13.891 15:25:13 -- nvmf/common.sh@520 -- # local subsystem config 00:30:13.891 15:25:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:13.891 15:25:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:13.891 { 00:30:13.891 "params": { 00:30:13.891 "name": "Nvme$subsystem", 00:30:13.891 "trtype": "$TEST_TRANSPORT", 00:30:13.891 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:13.891 "adrfam": "ipv4", 00:30:13.891 "trsvcid": "$NVMF_PORT", 00:30:13.891 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:13.891 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:13.891 "hdgst": ${hdgst:-false}, 00:30:13.891 "ddgst": ${ddgst:-false} 00:30:13.891 }, 00:30:13.891 "method": "bdev_nvme_attach_controller" 00:30:13.891 } 00:30:13.891 EOF 00:30:13.891 )") 00:30:13.891 15:25:13 -- nvmf/common.sh@542 -- # cat 00:30:13.891 15:25:13 -- nvmf/common.sh@544 -- # jq . 00:30:13.891 15:25:13 -- nvmf/common.sh@545 -- # IFS=, 00:30:13.891 15:25:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:13.891 "params": { 00:30:13.891 "name": "Nvme1", 00:30:13.891 "trtype": "tcp", 00:30:13.891 "traddr": "10.0.0.2", 00:30:13.891 "adrfam": "ipv4", 00:30:13.891 "trsvcid": "4420", 00:30:13.891 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:13.891 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:13.891 "hdgst": false, 00:30:13.891 "ddgst": false 00:30:13.891 }, 00:30:13.891 "method": "bdev_nvme_attach_controller" 00:30:13.891 }' 00:30:13.891 [2024-11-28 15:25:14.022472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:13.891 [2024-11-28 15:25:14.022572] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid837704 ] 00:30:13.891 EAL: No free 2048 kB hugepages reported on node 1 00:30:13.891 [2024-11-28 15:25:14.081691] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:14.149 [2024-11-28 15:25:14.168042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:14.407 Running I/O for 15 seconds... 00:30:16.940 15:25:16 -- host/bdevperf.sh@33 -- # kill -9 837371 00:30:16.940 15:25:16 -- host/bdevperf.sh@35 -- # sleep 3 00:30:16.940 [2024-11-28 15:25:16.998225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:4928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:4968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:4976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:4992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:5008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:5072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.998984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.998999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:5736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.940 [2024-11-28 15:25:16.999160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:5744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:5752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:5760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.940 [2024-11-28 15:25:16.999244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:5768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:5776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.940 [2024-11-28 15:25:16.999315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:5080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.940 [2024-11-28 15:25:16.999328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:5200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:5216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:5344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:5456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:5784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:16.999853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:5792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:16.999886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:5800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:16.999917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:5808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:16.999948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:5816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:16.999980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:16.999997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:5832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:5848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:17.000116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:5856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:5864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:17.000195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:5880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:17.000251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:5896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.941 [2024-11-28 15:25:17.000316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:5904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.941 [2024-11-28 15:25:17.000344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.941 [2024-11-28 15:25:17.000363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:5912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:5920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:5928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:5936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:5944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:5968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:5984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:5992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:6000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:6008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:6016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:6024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:6032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.000876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:6040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:6048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:6056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.000969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.000986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:6064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.001001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:6072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:6080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.001070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:6088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.001162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:6112 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:6120 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:6136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:6144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.942 [2024-11-28 15:25:17.001334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.942 [2024-11-28 15:25:17.001349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:6152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.942 [2024-11-28 15:25:17.001362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:6160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:6168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:6176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:6184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:6192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:6200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:6208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:6216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:6232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:6240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:6248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:6256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:6264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:6272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:6280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:6288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:16.943 [2024-11-28 15:25:17.001936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:6296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.001969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.001985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:6304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:6312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:5560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:5584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.943 [2024-11-28 15:25:17.002444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.943 [2024-11-28 15:25:17.002460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.944 [2024-11-28 15:25:17.002475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.944 [2024-11-28 15:25:17.002492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:5696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.944 [2024-11-28 15:25:17.002506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.944 [2024-11-28 15:25:17.002523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:5720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:16.944 [2024-11-28 15:25:17.002537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.944 [2024-11-28 15:25:17.002553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c419a0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.002573] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:16.944 [2024-11-28 15:25:17.002585] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:16.944 [2024-11-28 15:25:17.002597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5728 len:8 PRP1 0x0 PRP2 0x0 00:30:16.944 [2024-11-28 15:25:17.002611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:16.944 [2024-11-28 15:25:17.002687] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c419a0 was disconnected and freed. reset controller. 00:30:16.944 [2024-11-28 15:25:17.005118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.944 [2024-11-28 15:25:17.005204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.005663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.005849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.005874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.944 [2024-11-28 15:25:17.005906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.006075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.006228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.944 [2024-11-28 15:25:17.006251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.944 [2024-11-28 15:25:17.006276] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.944 [2024-11-28 15:25:17.008957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.944 [2024-11-28 15:25:17.017692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.944 [2024-11-28 15:25:17.017957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.018100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.018126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.944 [2024-11-28 15:25:17.018157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.018338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.018507] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.944 [2024-11-28 15:25:17.018529] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.944 [2024-11-28 15:25:17.018544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.944 [2024-11-28 15:25:17.020817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.944 [2024-11-28 15:25:17.030225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.944 [2024-11-28 15:25:17.030539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.030663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.030689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.944 [2024-11-28 15:25:17.030705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.030910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.031110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.944 [2024-11-28 15:25:17.031136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.944 [2024-11-28 15:25:17.031151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.944 [2024-11-28 15:25:17.033315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.944 [2024-11-28 15:25:17.042814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.944 [2024-11-28 15:25:17.043149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.043349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.043377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.944 [2024-11-28 15:25:17.043394] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.043574] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.043760] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.944 [2024-11-28 15:25:17.043785] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.944 [2024-11-28 15:25:17.043800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.944 [2024-11-28 15:25:17.046197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.944 [2024-11-28 15:25:17.055435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.944 [2024-11-28 15:25:17.055829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.055957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.055984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.944 [2024-11-28 15:25:17.056002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.056143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.056276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.944 [2024-11-28 15:25:17.056298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.944 [2024-11-28 15:25:17.056313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.944 [2024-11-28 15:25:17.058605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.944 [2024-11-28 15:25:17.067993] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.944 [2024-11-28 15:25:17.068283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.068493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.944 [2024-11-28 15:25:17.068522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.944 [2024-11-28 15:25:17.068539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.944 [2024-11-28 15:25:17.068722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.944 [2024-11-28 15:25:17.068871] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.944 [2024-11-28 15:25:17.068894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.944 [2024-11-28 15:25:17.068910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.944 [2024-11-28 15:25:17.071343] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.945 [2024-11-28 15:25:17.080487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.945 [2024-11-28 15:25:17.080855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.080951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.080979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.945 [2024-11-28 15:25:17.080997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.945 [2024-11-28 15:25:17.081138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.945 [2024-11-28 15:25:17.081362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.945 [2024-11-28 15:25:17.081386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.945 [2024-11-28 15:25:17.081402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.945 [2024-11-28 15:25:17.083677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.945 [2024-11-28 15:25:17.092770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.945 [2024-11-28 15:25:17.093100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.093317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.093346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.945 [2024-11-28 15:25:17.093364] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.945 [2024-11-28 15:25:17.093511] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.945 [2024-11-28 15:25:17.093697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.945 [2024-11-28 15:25:17.093721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.945 [2024-11-28 15:25:17.093737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.945 [2024-11-28 15:25:17.095972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.945 [2024-11-28 15:25:17.105492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.945 [2024-11-28 15:25:17.105836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.106038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.106067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.945 [2024-11-28 15:25:17.106084] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.945 [2024-11-28 15:25:17.106259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.945 [2024-11-28 15:25:17.106355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.945 [2024-11-28 15:25:17.106378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.945 [2024-11-28 15:25:17.106394] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.945 [2024-11-28 15:25:17.108719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.945 [2024-11-28 15:25:17.118010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.945 [2024-11-28 15:25:17.118359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.118579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.118621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.945 [2024-11-28 15:25:17.118637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.945 [2024-11-28 15:25:17.118850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.945 [2024-11-28 15:25:17.119020] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.945 [2024-11-28 15:25:17.119044] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.945 [2024-11-28 15:25:17.119059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.945 [2024-11-28 15:25:17.121252] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.945 [2024-11-28 15:25:17.130674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.945 [2024-11-28 15:25:17.130981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.131115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.131151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.945 [2024-11-28 15:25:17.131170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.945 [2024-11-28 15:25:17.131354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.945 [2024-11-28 15:25:17.131523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.945 [2024-11-28 15:25:17.131548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.945 [2024-11-28 15:25:17.131564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.945 [2024-11-28 15:25:17.133890] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.945 [2024-11-28 15:25:17.143126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.945 [2024-11-28 15:25:17.143423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.143596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.945 [2024-11-28 15:25:17.143654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.945 [2024-11-28 15:25:17.143672] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.945 [2024-11-28 15:25:17.143872] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.945 [2024-11-28 15:25:17.144059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.945 [2024-11-28 15:25:17.144082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.945 [2024-11-28 15:25:17.144111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.945 [2024-11-28 15:25:17.146439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.946 [2024-11-28 15:25:17.155761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.946 [2024-11-28 15:25:17.156065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.946 [2024-11-28 15:25:17.156162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.946 [2024-11-28 15:25:17.156193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.946 [2024-11-28 15:25:17.156211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.946 [2024-11-28 15:25:17.156339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.946 [2024-11-28 15:25:17.156526] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.946 [2024-11-28 15:25:17.156551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.946 [2024-11-28 15:25:17.156566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.946 [2024-11-28 15:25:17.158764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.946 [2024-11-28 15:25:17.168704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.946 [2024-11-28 15:25:17.169021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.946 [2024-11-28 15:25:17.169122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.946 [2024-11-28 15:25:17.169156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:16.946 [2024-11-28 15:25:17.169181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:16.946 [2024-11-28 15:25:17.169348] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:16.946 [2024-11-28 15:25:17.169577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.946 [2024-11-28 15:25:17.169615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.946 [2024-11-28 15:25:17.169637] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.204 [2024-11-28 15:25:17.172184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.204 [2024-11-28 15:25:17.181414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.204 [2024-11-28 15:25:17.181679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.181806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.181836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.204 [2024-11-28 15:25:17.181854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.204 [2024-11-28 15:25:17.182159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.204 [2024-11-28 15:25:17.182315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.204 [2024-11-28 15:25:17.182340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.204 [2024-11-28 15:25:17.182355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.204 [2024-11-28 15:25:17.184753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.204 [2024-11-28 15:25:17.194036] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.204 [2024-11-28 15:25:17.194380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.194504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.194533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.204 [2024-11-28 15:25:17.194551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.204 [2024-11-28 15:25:17.194698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.204 [2024-11-28 15:25:17.194886] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.204 [2024-11-28 15:25:17.194909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.204 [2024-11-28 15:25:17.194925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.204 [2024-11-28 15:25:17.197442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.204 [2024-11-28 15:25:17.206668] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.204 [2024-11-28 15:25:17.206974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.207107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.207138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.204 [2024-11-28 15:25:17.207156] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.204 [2024-11-28 15:25:17.207327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.204 [2024-11-28 15:25:17.207515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.204 [2024-11-28 15:25:17.207539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.204 [2024-11-28 15:25:17.207554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.204 [2024-11-28 15:25:17.209899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.204 [2024-11-28 15:25:17.219225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.204 [2024-11-28 15:25:17.219530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.219761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.204 [2024-11-28 15:25:17.219813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.219831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.219996] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.220228] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.220253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.220269] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.222703] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.231817] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.232164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.232292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.232321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.232339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.232504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.232674] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.232697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.232713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.235292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.244326] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.244667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.244826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.244852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.244868] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.245067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.245256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.245280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.245296] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.247637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.257012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.257293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.257420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.257454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.257470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.257603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.257744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.257767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.257783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.260214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.269530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.269898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.269993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.270021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.270039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.270212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.270381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.270404] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.270420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.272562] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.281871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.282189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.282343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.282384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.282401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.282549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.282702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.282746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.282762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.285119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.294556] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.294874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.294999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.295029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.205 [2024-11-28 15:25:17.295046] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.205 [2024-11-28 15:25:17.295241] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.205 [2024-11-28 15:25:17.295410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.205 [2024-11-28 15:25:17.295434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.205 [2024-11-28 15:25:17.295450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.205 [2024-11-28 15:25:17.297811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.205 [2024-11-28 15:25:17.306941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.205 [2024-11-28 15:25:17.307244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.307368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.205 [2024-11-28 15:25:17.307397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.307413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.307610] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.307746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.307767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.307782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.309842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.319023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.319292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.319413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.319439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.319455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.319648] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.319804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.319824] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.319841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.322139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.331604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.331932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.332054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.332079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.332102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.332301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.332452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.332476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.332491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.334729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.344397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.344699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.344846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.344874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.344891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.345067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.345245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.345269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.345285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.347680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.356929] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.357238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.357329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.357357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.357375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.357517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.357665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.357688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.357704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.359855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.369437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.369744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.369908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.369933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.369949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.370103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.370226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.370249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.370264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.372641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.382080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.382371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.382497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.382522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.382538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.382730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.382872] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.382896] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.382912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.206 [2024-11-28 15:25:17.385281] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.206 [2024-11-28 15:25:17.394662] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.206 [2024-11-28 15:25:17.394991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.395141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.206 [2024-11-28 15:25:17.395170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.206 [2024-11-28 15:25:17.395187] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.206 [2024-11-28 15:25:17.395326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.206 [2024-11-28 15:25:17.395513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.206 [2024-11-28 15:25:17.395536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.206 [2024-11-28 15:25:17.395552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.207 [2024-11-28 15:25:17.397911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.207 [2024-11-28 15:25:17.407105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.207 [2024-11-28 15:25:17.407462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-11-28 15:25:17.407603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-11-28 15:25:17.407644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.207 [2024-11-28 15:25:17.407660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.207 [2024-11-28 15:25:17.407802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.207 [2024-11-28 15:25:17.408004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.207 [2024-11-28 15:25:17.408028] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.207 [2024-11-28 15:25:17.408044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.207 [2024-11-28 15:25:17.410251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.207 [2024-11-28 15:25:17.419674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.207 [2024-11-28 15:25:17.420030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-11-28 15:25:17.420227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-11-28 15:25:17.420254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.207 [2024-11-28 15:25:17.420269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.207 [2024-11-28 15:25:17.420448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.207 [2024-11-28 15:25:17.420663] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.207 [2024-11-28 15:25:17.420687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.207 [2024-11-28 15:25:17.420703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.207 [2024-11-28 15:25:17.423048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.207 [2024-11-28 15:25:17.432229] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.207 [2024-11-28 15:25:17.432567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-11-28 15:25:17.432725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.207 [2024-11-28 15:25:17.432750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.207 [2024-11-28 15:25:17.432765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.207 [2024-11-28 15:25:17.432957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.207 [2024-11-28 15:25:17.433121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.207 [2024-11-28 15:25:17.433147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.207 [2024-11-28 15:25:17.433163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.207 [2024-11-28 15:25:17.435399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.474 [2024-11-28 15:25:17.445109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.474 [2024-11-28 15:25:17.445448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.445611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.445638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.474 [2024-11-28 15:25:17.445655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.474 [2024-11-28 15:25:17.445829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.474 [2024-11-28 15:25:17.446010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.474 [2024-11-28 15:25:17.446034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.474 [2024-11-28 15:25:17.446049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.474 [2024-11-28 15:25:17.448231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.474 [2024-11-28 15:25:17.457540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.474 [2024-11-28 15:25:17.457927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.458063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.458106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.474 [2024-11-28 15:25:17.458125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.474 [2024-11-28 15:25:17.458267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.474 [2024-11-28 15:25:17.458452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.474 [2024-11-28 15:25:17.458476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.474 [2024-11-28 15:25:17.458491] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.474 [2024-11-28 15:25:17.460933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.474 [2024-11-28 15:25:17.470181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.474 [2024-11-28 15:25:17.470490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.470625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.470652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.474 [2024-11-28 15:25:17.470668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.474 [2024-11-28 15:25:17.470827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.474 [2024-11-28 15:25:17.471005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.474 [2024-11-28 15:25:17.471029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.474 [2024-11-28 15:25:17.471044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.474 [2024-11-28 15:25:17.473527] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.474 [2024-11-28 15:25:17.482699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.474 [2024-11-28 15:25:17.483033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.483125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.483159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.474 [2024-11-28 15:25:17.483178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.474 [2024-11-28 15:25:17.483337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.474 [2024-11-28 15:25:17.483522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.474 [2024-11-28 15:25:17.483546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.474 [2024-11-28 15:25:17.483561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.474 [2024-11-28 15:25:17.485760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.474 [2024-11-28 15:25:17.495231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.474 [2024-11-28 15:25:17.495571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.495692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.474 [2024-11-28 15:25:17.495720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.474 [2024-11-28 15:25:17.495737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.474 [2024-11-28 15:25:17.495861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.474 [2024-11-28 15:25:17.496045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.474 [2024-11-28 15:25:17.496068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.474 [2024-11-28 15:25:17.496084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.474 [2024-11-28 15:25:17.498437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.507903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.508198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.508308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.508334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.508350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.508482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.508652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.508676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.508691] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.511013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.520487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.520773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.520915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.520943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.520966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.521190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.521353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.521378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.521393] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.523735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.533124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.533452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.533567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.533595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.533613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.533771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.533938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.533961] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.533977] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.536420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.545737] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.546039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.546159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.546187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.546205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.546422] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.546553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.546577] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.546592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.548863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.558309] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.558610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.558796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.558822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.558838] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.559017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.559143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.559167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.559182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.561431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.570979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.571256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.571405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.571433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.571450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.571607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.571777] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.571800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.571815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.574222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.583540] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.475 [2024-11-28 15:25:17.583864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.583997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.475 [2024-11-28 15:25:17.584024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.475 [2024-11-28 15:25:17.584041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.475 [2024-11-28 15:25:17.584210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.475 [2024-11-28 15:25:17.584362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.475 [2024-11-28 15:25:17.584386] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.475 [2024-11-28 15:25:17.584401] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.475 [2024-11-28 15:25:17.586599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.475 [2024-11-28 15:25:17.596130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.596436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.596557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.596599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.596617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.596807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.597014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.597038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.597053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.599296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.608830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.609168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.609275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.609300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.609316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.609459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.609659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.609682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.609698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.612212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.621401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.621714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.621850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.621876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.621892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.622104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.622248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.622272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.622286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.624464] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.633750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.634106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.634266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.634292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.634309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.634517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.634739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.634768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.634785] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.637040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.646432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.646784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.646935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.646962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.646979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.647169] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.647321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.647345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.647360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.649866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.659028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.659404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.659578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.659604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.659620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.659779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.659967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.659991] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.660007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.662543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.671659] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.671989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.672138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.672181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.476 [2024-11-28 15:25:17.672197] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.476 [2024-11-28 15:25:17.672359] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.476 [2024-11-28 15:25:17.672491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.476 [2024-11-28 15:25:17.672515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.476 [2024-11-28 15:25:17.672536] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.476 [2024-11-28 15:25:17.674896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.476 [2024-11-28 15:25:17.684303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.476 [2024-11-28 15:25:17.684641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.684746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.476 [2024-11-28 15:25:17.684773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.477 [2024-11-28 15:25:17.684790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.477 [2024-11-28 15:25:17.684931] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.477 [2024-11-28 15:25:17.685107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.477 [2024-11-28 15:25:17.685131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.477 [2024-11-28 15:25:17.685147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.477 [2024-11-28 15:25:17.687600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.477 [2024-11-28 15:25:17.696838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.477 [2024-11-28 15:25:17.697109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.477 [2024-11-28 15:25:17.697247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.477 [2024-11-28 15:25:17.697289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.477 [2024-11-28 15:25:17.697305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.477 [2024-11-28 15:25:17.697481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.477 [2024-11-28 15:25:17.697642] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.477 [2024-11-28 15:25:17.697665] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.477 [2024-11-28 15:25:17.697681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.477 [2024-11-28 15:25:17.700192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.735 [2024-11-28 15:25:17.709317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.735 [2024-11-28 15:25:17.709607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.709733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.709762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.735 [2024-11-28 15:25:17.709779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.735 [2024-11-28 15:25:17.709953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.735 [2024-11-28 15:25:17.710136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.735 [2024-11-28 15:25:17.710161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.735 [2024-11-28 15:25:17.710177] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.735 [2024-11-28 15:25:17.712614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.735 [2024-11-28 15:25:17.721853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.735 [2024-11-28 15:25:17.722167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.722262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.722305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.735 [2024-11-28 15:25:17.722322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.735 [2024-11-28 15:25:17.722485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.735 [2024-11-28 15:25:17.722660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.735 [2024-11-28 15:25:17.722684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.735 [2024-11-28 15:25:17.722700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.735 [2024-11-28 15:25:17.725123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.735 [2024-11-28 15:25:17.734408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.735 [2024-11-28 15:25:17.734725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.734820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.734848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.735 [2024-11-28 15:25:17.734865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.735 [2024-11-28 15:25:17.735042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.735 [2024-11-28 15:25:17.735274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.735 [2024-11-28 15:25:17.735298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.735 [2024-11-28 15:25:17.735313] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.735 [2024-11-28 15:25:17.737638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.735 [2024-11-28 15:25:17.747135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.735 [2024-11-28 15:25:17.747459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.747607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.747635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.735 [2024-11-28 15:25:17.747652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.735 [2024-11-28 15:25:17.747828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.735 [2024-11-28 15:25:17.747997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.735 [2024-11-28 15:25:17.748020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.735 [2024-11-28 15:25:17.748035] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.735 [2024-11-28 15:25:17.750451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.735 [2024-11-28 15:25:17.759630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.735 [2024-11-28 15:25:17.759941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.760063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.760091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.735 [2024-11-28 15:25:17.760119] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.735 [2024-11-28 15:25:17.760279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.735 [2024-11-28 15:25:17.760462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.735 [2024-11-28 15:25:17.760486] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.735 [2024-11-28 15:25:17.760502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.735 [2024-11-28 15:25:17.762753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.735 [2024-11-28 15:25:17.772165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.735 [2024-11-28 15:25:17.772473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.772559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.735 [2024-11-28 15:25:17.772587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.772604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.772763] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.772949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.772973] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.772988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.775320] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.784535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.784877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.785041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.785066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.785091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.785267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.785437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.785461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.785478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.787912] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.797108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.797417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.797571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.797600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.797618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.797782] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.797932] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.797956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.797972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.800430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.809542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.809817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.809933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.809961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.809979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.810171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.810340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.810364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.810380] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.812757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.822030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.822337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.822462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.822491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.822508] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.822655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.822805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.822829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.822844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.825148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.834744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.835077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.835212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.835243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.835260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.835439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.835626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.835649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.835664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.837902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.847429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.847720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.847817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.847846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.847864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.848047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.848190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.736 [2024-11-28 15:25:17.848215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.736 [2024-11-28 15:25:17.848230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.736 [2024-11-28 15:25:17.850438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.736 [2024-11-28 15:25:17.859974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.736 [2024-11-28 15:25:17.860238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.860392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.736 [2024-11-28 15:25:17.860422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.736 [2024-11-28 15:25:17.860439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.736 [2024-11-28 15:25:17.860630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.736 [2024-11-28 15:25:17.860798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.860833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.860849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.863083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.872767] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.873087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.873221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.873254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.873284] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.873517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.873650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.873674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.873689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.876053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.885361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.885729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.885928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.885957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.885975] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.886158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.886366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.886390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.886416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.888687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.897753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.898039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.898183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.898210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.898226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.898409] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.898560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.898584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.898600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.900889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.910366] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.910697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.910802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.910830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.910848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.911002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.911225] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.911248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.911261] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.913548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.922875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.923186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.923273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.923299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.923316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.923509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.923679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.923703] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.923719] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.926112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.935599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.935940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.936071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.936120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.936137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.936285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.936423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.936446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.936461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.938847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.948179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.948550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.948689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.948715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.737 [2024-11-28 15:25:17.948731] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.737 [2024-11-28 15:25:17.948909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.737 [2024-11-28 15:25:17.949076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.737 [2024-11-28 15:25:17.949109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.737 [2024-11-28 15:25:17.949126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.737 [2024-11-28 15:25:17.951556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.737 [2024-11-28 15:25:17.960695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.737 [2024-11-28 15:25:17.960989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.737 [2024-11-28 15:25:17.961115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.738 [2024-11-28 15:25:17.961160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.738 [2024-11-28 15:25:17.961177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.738 [2024-11-28 15:25:17.961342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.738 [2024-11-28 15:25:17.961503] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.738 [2024-11-28 15:25:17.961527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.738 [2024-11-28 15:25:17.961543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.738 [2024-11-28 15:25:17.963903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.996 [2024-11-28 15:25:17.973059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.996 [2024-11-28 15:25:17.973347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.996 [2024-11-28 15:25:17.973447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.996 [2024-11-28 15:25:17.973475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.996 [2024-11-28 15:25:17.973500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.996 [2024-11-28 15:25:17.973646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.996 [2024-11-28 15:25:17.973830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.996 [2024-11-28 15:25:17.973864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.996 [2024-11-28 15:25:17.973893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.996 [2024-11-28 15:25:17.976285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.996 [2024-11-28 15:25:17.985738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.996 [2024-11-28 15:25:17.986039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.996 [2024-11-28 15:25:17.986148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.996 [2024-11-28 15:25:17.986173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.996 [2024-11-28 15:25:17.986189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:17.986355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:17.986519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:17.986549] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:17.986566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:17.988889] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:17.998517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:17.998879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:17.999010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:17.999040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:17.999058] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:17.999271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:17.999429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:17.999452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:17.999467] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:18.001867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:18.011031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:18.011321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.011457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.011500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:18.011517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:18.011747] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:18.011918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:18.011943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:18.011959] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:18.014411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:18.023671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:18.024006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.024131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.024160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:18.024178] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:18.024360] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:18.024564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:18.024599] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:18.024621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:18.026841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:18.036170] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:18.036519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.036644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.036674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:18.036692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:18.036857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:18.037061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:18.037086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:18.037114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:18.039422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:18.048742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:18.049086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.049190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.049219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:18.049237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:18.049420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:18.049625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:18.049650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:18.049666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:18.051942] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:18.061216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:18.061495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.061622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.061651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:18.061669] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:18.061798] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:18.061985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.997 [2024-11-28 15:25:18.062010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.997 [2024-11-28 15:25:18.062025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.997 [2024-11-28 15:25:18.064478] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.997 [2024-11-28 15:25:18.073821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.997 [2024-11-28 15:25:18.074186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.074359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.997 [2024-11-28 15:25:18.074386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.997 [2024-11-28 15:25:18.074402] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.997 [2024-11-28 15:25:18.074599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.997 [2024-11-28 15:25:18.074750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.074775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.074790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.077061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.086478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.086791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.086945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.086974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.086992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.087187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.087374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.087398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.087414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.089631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.099106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.099468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.099599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.099629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.099647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.099848] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.100034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.100058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.100074] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.102286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.111625] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.111980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.112109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.112138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.112155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.112302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.112470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.112492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.112508] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.114888] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.124280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.124665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.124780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.124807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.124824] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.124989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.125171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.125194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.125209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.127516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.136750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.137082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.137224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.137251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.137268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.137469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.137654] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.137679] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.137695] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.139949] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.149186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.149550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.149702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.149742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.149758] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.149976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.150186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.150212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.150227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.152503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.161736] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.998 [2024-11-28 15:25:18.162067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.162238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.998 [2024-11-28 15:25:18.162264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.998 [2024-11-28 15:25:18.162280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.998 [2024-11-28 15:25:18.162484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.998 [2024-11-28 15:25:18.162616] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.998 [2024-11-28 15:25:18.162638] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.998 [2024-11-28 15:25:18.162653] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.998 [2024-11-28 15:25:18.164892] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.998 [2024-11-28 15:25:18.174403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.999 [2024-11-28 15:25:18.174782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.174911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.174938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.999 [2024-11-28 15:25:18.174954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.999 [2024-11-28 15:25:18.175124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.999 [2024-11-28 15:25:18.175238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.999 [2024-11-28 15:25:18.175260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.999 [2024-11-28 15:25:18.175275] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.999 [2024-11-28 15:25:18.177711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.999 [2024-11-28 15:25:18.187109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.999 [2024-11-28 15:25:18.187469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.187628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.187661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.999 [2024-11-28 15:25:18.187679] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.999 [2024-11-28 15:25:18.187879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.999 [2024-11-28 15:25:18.188083] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.999 [2024-11-28 15:25:18.188119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.999 [2024-11-28 15:25:18.188137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.999 [2024-11-28 15:25:18.190607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.999 [2024-11-28 15:25:18.199768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.999 [2024-11-28 15:25:18.200154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.200396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.200454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.999 [2024-11-28 15:25:18.200471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.999 [2024-11-28 15:25:18.200619] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.999 [2024-11-28 15:25:18.200768] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.999 [2024-11-28 15:25:18.200793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.999 [2024-11-28 15:25:18.200808] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.999 [2024-11-28 15:25:18.202953] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.999 [2024-11-28 15:25:18.212165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.999 [2024-11-28 15:25:18.212415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.212571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.212600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.999 [2024-11-28 15:25:18.212618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.999 [2024-11-28 15:25:18.212783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.999 [2024-11-28 15:25:18.212933] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.999 [2024-11-28 15:25:18.212958] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.999 [2024-11-28 15:25:18.212974] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.999 [2024-11-28 15:25:18.215275] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.999 [2024-11-28 15:25:18.224862] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.999 [2024-11-28 15:25:18.225157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.225310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.999 [2024-11-28 15:25:18.225336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:17.999 [2024-11-28 15:25:18.225358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:17.999 [2024-11-28 15:25:18.225544] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:17.999 [2024-11-28 15:25:18.225708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.999 [2024-11-28 15:25:18.225733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.999 [2024-11-28 15:25:18.225754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.999 [2024-11-28 15:25:18.228213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.257 [2024-11-28 15:25:18.237565] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.257 [2024-11-28 15:25:18.237926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.257 [2024-11-28 15:25:18.238081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.257 [2024-11-28 15:25:18.238121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.238140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.238305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.238437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.238460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.238476] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.240712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.250198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.250525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.250643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.250670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.250688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.250889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.251003] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.251026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.251042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.253581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.262831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.263122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.263217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.263245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.263262] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.263434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.263602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.263627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.263643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.265807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.275521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.275853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.275979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.276006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.276024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.276180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.276330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.276353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.276368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.278820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.288037] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.288314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.288432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.288457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.288473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.288633] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.288820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.288846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.288862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.291381] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.300650] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.301034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.301163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.301189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.301205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.301385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.301534] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.301557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.301573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.303791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.313184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.313533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.313644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.313669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.313685] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.313846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.314052] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.314075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.314091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.316505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.325748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.326059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.326191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.326219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.326237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.326421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.326607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.326631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.326647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.329221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.338314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.338638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.338754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.338794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.338810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.338969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.339160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.258 [2024-11-28 15:25:18.339190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.258 [2024-11-28 15:25:18.339206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.258 [2024-11-28 15:25:18.341606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.258 [2024-11-28 15:25:18.350823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.258 [2024-11-28 15:25:18.351108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.351287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.258 [2024-11-28 15:25:18.351313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.258 [2024-11-28 15:25:18.351329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.258 [2024-11-28 15:25:18.351476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.258 [2024-11-28 15:25:18.351656] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.351678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.351694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.353936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.363238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.363540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.363645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.363670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.363686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.363849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.364046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.364067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.364107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.366007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.375637] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.375948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.376068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.376103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.376122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.376334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.376490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.376509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.376526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.378532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.388235] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.388574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.388704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.388732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.388750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.388933] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.389151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.389189] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.389202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.391406] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.400922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.401238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.401402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.401432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.401450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.401634] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.401802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.401826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.401841] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.404145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.413503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.413793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.413912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.413941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.413959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.414088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.414285] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.414310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.414325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.416679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.426102] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.426470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.426622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.426648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.426665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.426862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.427050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.427074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.427090] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.429355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.438675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.438987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.439070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.439105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.439125] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.439308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.439495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.439519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.439535] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.441660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.451296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.451608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.451736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.451766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.451784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.451985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.452129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.452153] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.452169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.454384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.463950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.259 [2024-11-28 15:25:18.464310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.464467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.259 [2024-11-28 15:25:18.464495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.259 [2024-11-28 15:25:18.464512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.259 [2024-11-28 15:25:18.464677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.259 [2024-11-28 15:25:18.464863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.259 [2024-11-28 15:25:18.464899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.259 [2024-11-28 15:25:18.464915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.259 [2024-11-28 15:25:18.467269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.259 [2024-11-28 15:25:18.476475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.260 [2024-11-28 15:25:18.476806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.260 [2024-11-28 15:25:18.476902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.260 [2024-11-28 15:25:18.476931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.260 [2024-11-28 15:25:18.476950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.260 [2024-11-28 15:25:18.477127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.260 [2024-11-28 15:25:18.477331] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.260 [2024-11-28 15:25:18.477356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.260 [2024-11-28 15:25:18.477372] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.260 [2024-11-28 15:25:18.479714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.260 [2024-11-28 15:25:18.489204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.260 [2024-11-28 15:25:18.489469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.260 [2024-11-28 15:25:18.489666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.260 [2024-11-28 15:25:18.489695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.260 [2024-11-28 15:25:18.489712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.260 [2024-11-28 15:25:18.489909] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.260 [2024-11-28 15:25:18.490042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.260 [2024-11-28 15:25:18.490066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.260 [2024-11-28 15:25:18.490083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.517 [2024-11-28 15:25:18.492383] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.517 [2024-11-28 15:25:18.501672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.517 [2024-11-28 15:25:18.501996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-11-28 15:25:18.502132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.517 [2024-11-28 15:25:18.502158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.502175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.502372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.502543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.502568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.502584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.504967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.514008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.514304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.514393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.514419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.514434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.514570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.514738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.514760] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.514775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.517074] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.526505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.526765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.526885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.526916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.526934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.527081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.527244] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.527267] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.527282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.529482] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.539031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.539402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.539611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.539668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.539687] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.539853] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.540002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.540027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.540042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.542364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.551552] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.551861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.552059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.552086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.552132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.552300] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.552448] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.552473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.552489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.554868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.564073] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.564430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.564646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.564699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.564717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.564883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.565051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.565076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.565104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.567182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.576583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.576893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.577022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.577069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.577102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.577294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.577487] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.577512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.577528] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.518 [2024-11-28 15:25:18.579836] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.518 [2024-11-28 15:25:18.589400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.518 [2024-11-28 15:25:18.589704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.589800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.518 [2024-11-28 15:25:18.589828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.518 [2024-11-28 15:25:18.589846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.518 [2024-11-28 15:25:18.589993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.518 [2024-11-28 15:25:18.590139] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.518 [2024-11-28 15:25:18.590165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.518 [2024-11-28 15:25:18.590181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.592471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.602165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.602452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.602661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.602691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.602709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.602892] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.603109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.603133] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.519 [2024-11-28 15:25:18.603148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.605546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.614711] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.615023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.615123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.615152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.615170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.615377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.615564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.615588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.519 [2024-11-28 15:25:18.615604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.618090] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.627116] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.627405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.627524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.627551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.627567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.627714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.627884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.627909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.519 [2024-11-28 15:25:18.627924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.630298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.639721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.640080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.640181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.640211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.640230] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.640431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.640619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.640644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.519 [2024-11-28 15:25:18.640660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.643080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.652295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.652578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.652684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.652712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.652729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.652876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.653014] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.653039] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.519 [2024-11-28 15:25:18.653054] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.655374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.664995] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.665402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.665522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.665550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.665568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.665733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.665884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.665907] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.519 [2024-11-28 15:25:18.665922] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.519 [2024-11-28 15:25:18.668155] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.519 [2024-11-28 15:25:18.677407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.519 [2024-11-28 15:25:18.677754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.677874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.519 [2024-11-28 15:25:18.677902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.519 [2024-11-28 15:25:18.677919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.519 [2024-11-28 15:25:18.678030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.519 [2024-11-28 15:25:18.678212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.519 [2024-11-28 15:25:18.678236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.520 [2024-11-28 15:25:18.678251] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.520 [2024-11-28 15:25:18.680505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.520 [2024-11-28 15:25:18.690157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.520 [2024-11-28 15:25:18.690428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.690553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.690604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.520 [2024-11-28 15:25:18.690620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.520 [2024-11-28 15:25:18.690776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.520 [2024-11-28 15:25:18.690983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.520 [2024-11-28 15:25:18.691014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.520 [2024-11-28 15:25:18.691031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.520 [2024-11-28 15:25:18.693403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.520 [2024-11-28 15:25:18.702416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.520 [2024-11-28 15:25:18.702738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.702874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.702902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.520 [2024-11-28 15:25:18.702919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.520 [2024-11-28 15:25:18.703083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.520 [2024-11-28 15:25:18.703229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.520 [2024-11-28 15:25:18.703252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.520 [2024-11-28 15:25:18.703267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.520 [2024-11-28 15:25:18.705575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.520 [2024-11-28 15:25:18.715040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.520 [2024-11-28 15:25:18.715348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.715505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.715535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.520 [2024-11-28 15:25:18.715553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.520 [2024-11-28 15:25:18.715718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.520 [2024-11-28 15:25:18.715868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.520 [2024-11-28 15:25:18.715892] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.520 [2024-11-28 15:25:18.715908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.520 [2024-11-28 15:25:18.718194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.520 [2024-11-28 15:25:18.727715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.520 [2024-11-28 15:25:18.728039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.728172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.728198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.520 [2024-11-28 15:25:18.728214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.520 [2024-11-28 15:25:18.728389] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.520 [2024-11-28 15:25:18.728568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.520 [2024-11-28 15:25:18.728592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.520 [2024-11-28 15:25:18.728614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.520 [2024-11-28 15:25:18.730985] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.520 [2024-11-28 15:25:18.740210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.520 [2024-11-28 15:25:18.740561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.740683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.520 [2024-11-28 15:25:18.740710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.520 [2024-11-28 15:25:18.740728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.520 [2024-11-28 15:25:18.740894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.520 [2024-11-28 15:25:18.741044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.520 [2024-11-28 15:25:18.741067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.520 [2024-11-28 15:25:18.741081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.520 [2024-11-28 15:25:18.743276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.752939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.753292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.753415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.753446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.753465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.779 [2024-11-28 15:25:18.753649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.779 [2024-11-28 15:25:18.753817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.779 [2024-11-28 15:25:18.753842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.779 [2024-11-28 15:25:18.753858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.779 [2024-11-28 15:25:18.756304] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.765504] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.765801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.765887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.765915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.765933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.779 [2024-11-28 15:25:18.766147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.779 [2024-11-28 15:25:18.766333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.779 [2024-11-28 15:25:18.766359] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.779 [2024-11-28 15:25:18.766375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.779 [2024-11-28 15:25:18.768709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.777842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.778182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.778313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.778343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.778361] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.779 [2024-11-28 15:25:18.778491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.779 [2024-11-28 15:25:18.778622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.779 [2024-11-28 15:25:18.778645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.779 [2024-11-28 15:25:18.778660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.779 [2024-11-28 15:25:18.780786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.790530] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.790841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.790995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.791023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.791041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.779 [2024-11-28 15:25:18.791219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.779 [2024-11-28 15:25:18.791406] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.779 [2024-11-28 15:25:18.791430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.779 [2024-11-28 15:25:18.791447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.779 [2024-11-28 15:25:18.793411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.803120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.803421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.803616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.803642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.803658] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.779 [2024-11-28 15:25:18.803885] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.779 [2024-11-28 15:25:18.804038] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.779 [2024-11-28 15:25:18.804062] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.779 [2024-11-28 15:25:18.804078] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.779 [2024-11-28 15:25:18.806285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.815733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.816027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.816167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.816197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.816215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.779 [2024-11-28 15:25:18.816434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.779 [2024-11-28 15:25:18.816622] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.779 [2024-11-28 15:25:18.816646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.779 [2024-11-28 15:25:18.816662] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.779 [2024-11-28 15:25:18.818993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.779 [2024-11-28 15:25:18.828043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.779 [2024-11-28 15:25:18.828364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.828497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.779 [2024-11-28 15:25:18.828526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.779 [2024-11-28 15:25:18.828544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.828708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.828876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.828901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.828917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.831259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.840573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.840923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.841018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.841045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.841063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.841256] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.841388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.841410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.841424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.843820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.853171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.853509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.853677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.853704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.853721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.853851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.854045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.854070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.854086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.856333] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.865839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.866195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.866360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.866385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.866401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.866607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.866793] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.866818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.866833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.869185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.878281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.878643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.878804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.878834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.878852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.879018] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.879162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.879188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.879204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.881583] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.891028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.891331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.891479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.891533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.891552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.891735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.891903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.891928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.891943] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.894301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.903435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.903704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.903822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.903851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.903869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.904017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.904232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.904258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.904274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.906504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.916030] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.916332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.916509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.916538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.916555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.916701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.916943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.916967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.916982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.919284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.928528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.928876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.929024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.929050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.929072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.929278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.929430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.929454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.929469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.780 [2024-11-28 15:25:18.931873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.780 [2024-11-28 15:25:18.941017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.780 [2024-11-28 15:25:18.941348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.941504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.780 [2024-11-28 15:25:18.941529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.780 [2024-11-28 15:25:18.941545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.780 [2024-11-28 15:25:18.941743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.780 [2024-11-28 15:25:18.941930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.780 [2024-11-28 15:25:18.941953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.780 [2024-11-28 15:25:18.941969] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.781 [2024-11-28 15:25:18.944451] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.781 [2024-11-28 15:25:18.953547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.781 [2024-11-28 15:25:18.953904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.954028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.954056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.781 [2024-11-28 15:25:18.954074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.781 [2024-11-28 15:25:18.954248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.781 [2024-11-28 15:25:18.954382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.781 [2024-11-28 15:25:18.954406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.781 [2024-11-28 15:25:18.954421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.781 [2024-11-28 15:25:18.956762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.781 [2024-11-28 15:25:18.965966] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.781 [2024-11-28 15:25:18.966341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.966554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.966583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.781 [2024-11-28 15:25:18.966601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.781 [2024-11-28 15:25:18.966754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.781 [2024-11-28 15:25:18.966905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.781 [2024-11-28 15:25:18.966929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.781 [2024-11-28 15:25:18.966944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.781 [2024-11-28 15:25:18.969213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.781 [2024-11-28 15:25:18.978360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.781 [2024-11-28 15:25:18.978666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.978784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.978812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.781 [2024-11-28 15:25:18.978829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.781 [2024-11-28 15:25:18.978976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.781 [2024-11-28 15:25:18.979186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.781 [2024-11-28 15:25:18.979209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.781 [2024-11-28 15:25:18.979224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.781 [2024-11-28 15:25:18.981552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.781 [2024-11-28 15:25:18.990814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.781 [2024-11-28 15:25:18.991150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.991234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:18.991259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.781 [2024-11-28 15:25:18.991274] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.781 [2024-11-28 15:25:18.991445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.781 [2024-11-28 15:25:18.991631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.781 [2024-11-28 15:25:18.991653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.781 [2024-11-28 15:25:18.991668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.781 [2024-11-28 15:25:18.993828] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:18.781 [2024-11-28 15:25:19.003250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:18.781 [2024-11-28 15:25:19.003552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:19.003683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.781 [2024-11-28 15:25:19.003707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:18.781 [2024-11-28 15:25:19.003723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:18.781 [2024-11-28 15:25:19.003887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:18.781 [2024-11-28 15:25:19.004026] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:18.781 [2024-11-28 15:25:19.004050] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:18.781 [2024-11-28 15:25:19.004066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:18.781 [2024-11-28 15:25:19.006313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.040 [2024-11-28 15:25:19.015721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.040 [2024-11-28 15:25:19.016038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.016176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.016206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.040 [2024-11-28 15:25:19.016223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.040 [2024-11-28 15:25:19.016356] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.040 [2024-11-28 15:25:19.016536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.040 [2024-11-28 15:25:19.016559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.040 [2024-11-28 15:25:19.016574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.040 [2024-11-28 15:25:19.018824] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.040 [2024-11-28 15:25:19.028236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.040 [2024-11-28 15:25:19.028498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.028656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.028685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.040 [2024-11-28 15:25:19.028702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.040 [2024-11-28 15:25:19.028902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.040 [2024-11-28 15:25:19.029034] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.040 [2024-11-28 15:25:19.029058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.040 [2024-11-28 15:25:19.029073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.040 [2024-11-28 15:25:19.031458] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.040 [2024-11-28 15:25:19.040537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.040 [2024-11-28 15:25:19.040837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.040927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.040956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.040 [2024-11-28 15:25:19.040973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.040 [2024-11-28 15:25:19.041146] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.040 [2024-11-28 15:25:19.041314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.040 [2024-11-28 15:25:19.041346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.040 [2024-11-28 15:25:19.041362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.040 [2024-11-28 15:25:19.043739] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.040 [2024-11-28 15:25:19.052958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.040 [2024-11-28 15:25:19.053461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.053577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.053602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.040 [2024-11-28 15:25:19.053618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.040 [2024-11-28 15:25:19.053828] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.040 [2024-11-28 15:25:19.054015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.040 [2024-11-28 15:25:19.054038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.040 [2024-11-28 15:25:19.054052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.040 [2024-11-28 15:25:19.056201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.040 [2024-11-28 15:25:19.065603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.040 [2024-11-28 15:25:19.065936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.066037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.040 [2024-11-28 15:25:19.066080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.040 [2024-11-28 15:25:19.066102] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.040 [2024-11-28 15:25:19.066219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.040 [2024-11-28 15:25:19.066353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.040 [2024-11-28 15:25:19.066392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.040 [2024-11-28 15:25:19.066405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.068764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.078334] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.078700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.078789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.078814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.078829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.078962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.079189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.079210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.079230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.081648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.090924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.091248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.091371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.091397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.091420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.091593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.091744] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.091767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.091782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.094170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.103456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.103700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.103828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.103869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.103885] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.104048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.104272] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.104293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.104306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.106675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.116108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.116470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.116608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.116633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.116648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.116854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.117001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.117023] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.117038] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.119301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.128621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.128949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.129075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.129107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.129124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.129276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.129462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.129484] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.129499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.132026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.141243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.141552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.141647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.141674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.141691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.141837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.142041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.142064] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.142079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.144209] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.153718] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.154012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.154134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.154160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.154175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.154323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.154523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.154545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.154560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.156850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.166341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.166659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.166746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.166770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.166785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.166978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.167194] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.167218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.167233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.169630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.178921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.179214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.179331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.179356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.041 [2024-11-28 15:25:19.179371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.041 [2024-11-28 15:25:19.179506] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.041 [2024-11-28 15:25:19.179638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.041 [2024-11-28 15:25:19.179661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.041 [2024-11-28 15:25:19.179676] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.041 [2024-11-28 15:25:19.181928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.041 [2024-11-28 15:25:19.191409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.041 [2024-11-28 15:25:19.191688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.191820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.041 [2024-11-28 15:25:19.191847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.191865] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.192028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.192213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.192234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.192247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.194440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.042 [2024-11-28 15:25:19.204196] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.042 [2024-11-28 15:25:19.204460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.204610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.204635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.204650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.204859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.205045] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.205068] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.205082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.207298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.042 [2024-11-28 15:25:19.216903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.042 [2024-11-28 15:25:19.217259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.217348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.217376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.217407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.217614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.217847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.217870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.217885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.220198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.042 [2024-11-28 15:25:19.229500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.042 [2024-11-28 15:25:19.229766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.229933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.229958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.229973] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.230129] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.230292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.230314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.230329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.232654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.042 [2024-11-28 15:25:19.242117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.042 [2024-11-28 15:25:19.242369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.242521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.242553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.242572] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.242727] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.242914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.242936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.242951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.245356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.042 [2024-11-28 15:25:19.254646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.042 [2024-11-28 15:25:19.254934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.255058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.255085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.255113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.255283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.255445] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.255482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.255497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.257711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.042 [2024-11-28 15:25:19.267256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.042 [2024-11-28 15:25:19.267562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.267659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.042 [2024-11-28 15:25:19.267687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.042 [2024-11-28 15:25:19.267704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.042 [2024-11-28 15:25:19.267850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.042 [2024-11-28 15:25:19.267982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.042 [2024-11-28 15:25:19.268004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.042 [2024-11-28 15:25:19.268019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.042 [2024-11-28 15:25:19.270341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.301 [2024-11-28 15:25:19.280345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.280682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.280805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.280831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.280852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.281061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.281232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.281253] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.281266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.283614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.292912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.293200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.293323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.293363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.293379] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.293542] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.293665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.293688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.293703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.296045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.305573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.305822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.305980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.306008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.306025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.306194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.306374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.306394] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.306423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.308799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.318126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.318429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.318550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.318577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.318595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.318783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.318967] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.318990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.319004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.321535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.330545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.330812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.330983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.331011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.331028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.331201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.331362] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.331381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.331410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.333645] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.343002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.343381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.343468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.343491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.343507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.343717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.343900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.343922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.343936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.346187] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.355768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.356075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.356234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.356263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.356280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.356462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.356636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.356659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.356673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.359072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.368063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.368364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.368517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.368541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.368556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.368710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.368842] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.368864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.368878] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.371101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.380583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.380880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.380976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.302 [2024-11-28 15:25:19.381003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.302 [2024-11-28 15:25:19.381020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.302 [2024-11-28 15:25:19.381253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.302 [2024-11-28 15:25:19.381366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.302 [2024-11-28 15:25:19.381384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.302 [2024-11-28 15:25:19.381413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.302 [2024-11-28 15:25:19.383647] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.302 [2024-11-28 15:25:19.393353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.302 [2024-11-28 15:25:19.393709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.393783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.393807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.393822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.393937] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.394102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.394130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.394146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.396505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.405841] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.406118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.406248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.406275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.406292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.406474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.406659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.406682] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.406697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.409142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.418210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.418518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.418615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.418642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.418659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.418857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.419025] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.419047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.419062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.421167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.430729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.431011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.431173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.431199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.431214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.431406] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.431592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.431615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.431636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.433987] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.443419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.443711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.443843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.443871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.443887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.444070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.444229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.444252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.444267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.446644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.455830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.456202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.456301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.456332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.456349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.456549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.456699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.456722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.456737] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.459142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.468590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.468881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.469007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.469034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.469051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.469263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.469425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.469448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.469463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.471900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.481278] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.481561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.481675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.481702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.481719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.481846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.482031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.482054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.482069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.484410] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.493790] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.494073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.494218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.494247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.494264] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.494445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.303 [2024-11-28 15:25:19.494595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.303 [2024-11-28 15:25:19.494618] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.303 [2024-11-28 15:25:19.494633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.303 [2024-11-28 15:25:19.496761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.303 [2024-11-28 15:25:19.506317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.303 [2024-11-28 15:25:19.506626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.506777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.303 [2024-11-28 15:25:19.506805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.303 [2024-11-28 15:25:19.506822] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.303 [2024-11-28 15:25:19.506967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.304 [2024-11-28 15:25:19.507162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.304 [2024-11-28 15:25:19.507186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.304 [2024-11-28 15:25:19.507201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.304 [2024-11-28 15:25:19.509541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.304 [2024-11-28 15:25:19.519024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.304 [2024-11-28 15:25:19.519391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.304 [2024-11-28 15:25:19.519510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.304 [2024-11-28 15:25:19.519536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.304 [2024-11-28 15:25:19.519551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.304 [2024-11-28 15:25:19.519699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.304 [2024-11-28 15:25:19.519894] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.304 [2024-11-28 15:25:19.519929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.304 [2024-11-28 15:25:19.519942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.304 [2024-11-28 15:25:19.521957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.304 [2024-11-28 15:25:19.531701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.304 [2024-11-28 15:25:19.532052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.304 [2024-11-28 15:25:19.532223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.304 [2024-11-28 15:25:19.532263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.304 [2024-11-28 15:25:19.532291] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.304 [2024-11-28 15:25:19.532459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.304 [2024-11-28 15:25:19.532630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.304 [2024-11-28 15:25:19.532653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.304 [2024-11-28 15:25:19.532668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.563 [2024-11-28 15:25:19.535085] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.563 [2024-11-28 15:25:19.544584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.563 [2024-11-28 15:25:19.544923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.545031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.545062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.563 [2024-11-28 15:25:19.545080] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.563 [2024-11-28 15:25:19.545320] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.563 [2024-11-28 15:25:19.545565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.563 [2024-11-28 15:25:19.545588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.563 [2024-11-28 15:25:19.545603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.563 [2024-11-28 15:25:19.547874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.563 [2024-11-28 15:25:19.557058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.563 [2024-11-28 15:25:19.557523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.557667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.557708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.563 [2024-11-28 15:25:19.557726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.563 [2024-11-28 15:25:19.557925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.563 [2024-11-28 15:25:19.558076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.563 [2024-11-28 15:25:19.558109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.563 [2024-11-28 15:25:19.558126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.563 [2024-11-28 15:25:19.560384] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.563 [2024-11-28 15:25:19.569830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.563 [2024-11-28 15:25:19.570107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.570219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.570245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.563 [2024-11-28 15:25:19.570260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.563 [2024-11-28 15:25:19.570437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.563 [2024-11-28 15:25:19.570587] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.563 [2024-11-28 15:25:19.570610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.563 [2024-11-28 15:25:19.570625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.563 [2024-11-28 15:25:19.572801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.563 [2024-11-28 15:25:19.582498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.563 [2024-11-28 15:25:19.582802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.582942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.563 [2024-11-28 15:25:19.582970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.563 [2024-11-28 15:25:19.582987] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.563 [2024-11-28 15:25:19.583162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.563 [2024-11-28 15:25:19.583349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.563 [2024-11-28 15:25:19.583372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.563 [2024-11-28 15:25:19.583387] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.585656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.595318] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.595681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.595835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.595863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.595880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.596044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.596211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.596231] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.596243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.598628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.607856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.608188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.608330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.608358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.608375] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.608521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.608689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.608712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.608726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.610922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.620630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.620926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.621062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.621091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.621120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.621253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.621455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.621490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.621505] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.623754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.633173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.633440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.633541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.633570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.633597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.633745] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.633948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.633970] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.633985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.636022] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.645628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.645962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.646103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.646129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.646145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.646301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.646452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.646474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.646488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.648723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.658437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.658742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.658880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.658905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.658920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.659107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.659257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.659279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.659294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.661671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.670834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.671182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.671285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.671313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.671331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.671483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.671633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.671656] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.671670] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.674067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.683284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.683611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.683753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.683781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.683797] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.683961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.684158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.684182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.684196] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.686646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.695769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.696088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.696196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.696225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.564 [2024-11-28 15:25:19.696241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.564 [2024-11-28 15:25:19.696405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.564 [2024-11-28 15:25:19.696609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.564 [2024-11-28 15:25:19.696632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.564 [2024-11-28 15:25:19.696646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.564 [2024-11-28 15:25:19.698842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.564 [2024-11-28 15:25:19.708268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.564 [2024-11-28 15:25:19.708549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.564 [2024-11-28 15:25:19.708700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.708728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.708744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.708926] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.709128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.709152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.709168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.711492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.565 [2024-11-28 15:25:19.720783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.565 [2024-11-28 15:25:19.721152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.721317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.721359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.721376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.721504] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.721689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.721711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.721726] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.724223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.565 [2024-11-28 15:25:19.733360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.565 [2024-11-28 15:25:19.733644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.733776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.733804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.733821] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.733949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.734129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.734152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.734167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.736385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.565 [2024-11-28 15:25:19.746133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.565 [2024-11-28 15:25:19.746379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.746515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.746543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.746560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.746741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.746910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.746938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.746954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.749309] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.565 [2024-11-28 15:25:19.758776] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.565 [2024-11-28 15:25:19.759084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.759195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.759223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.759240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.759386] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.759553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.759576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.759591] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.761770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.565 [2024-11-28 15:25:19.771316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.565 [2024-11-28 15:25:19.771545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.771672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.771712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.771727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.771858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.772035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.772054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.772067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.774400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.565 [2024-11-28 15:25:19.783893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.565 [2024-11-28 15:25:19.784222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.784372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.565 [2024-11-28 15:25:19.784400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.565 [2024-11-28 15:25:19.784417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.565 [2024-11-28 15:25:19.784545] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.565 [2024-11-28 15:25:19.784658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.565 [2024-11-28 15:25:19.784680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.565 [2024-11-28 15:25:19.784701] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.565 [2024-11-28 15:25:19.787176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.825 [2024-11-28 15:25:19.796432] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.825 [2024-11-28 15:25:19.796802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.796936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.796965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.825 [2024-11-28 15:25:19.796982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.825 [2024-11-28 15:25:19.797141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.825 [2024-11-28 15:25:19.797237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.825 [2024-11-28 15:25:19.797259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.825 [2024-11-28 15:25:19.797274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.825 [2024-11-28 15:25:19.799510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.825 [2024-11-28 15:25:19.808994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.825 [2024-11-28 15:25:19.809378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.809548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.809574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.825 [2024-11-28 15:25:19.809590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.825 [2024-11-28 15:25:19.809713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.825 [2024-11-28 15:25:19.809899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.825 [2024-11-28 15:25:19.809922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.825 [2024-11-28 15:25:19.809938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.825 [2024-11-28 15:25:19.812206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.825 [2024-11-28 15:25:19.821546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.825 [2024-11-28 15:25:19.821803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.821931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.821959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.825 [2024-11-28 15:25:19.821976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.825 [2024-11-28 15:25:19.822166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.825 [2024-11-28 15:25:19.822357] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.825 [2024-11-28 15:25:19.822393] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.825 [2024-11-28 15:25:19.822408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.825 [2024-11-28 15:25:19.824665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.825 [2024-11-28 15:25:19.834241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.825 [2024-11-28 15:25:19.834536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.834629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-28 15:25:19.834657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.825 [2024-11-28 15:25:19.834688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.825 [2024-11-28 15:25:19.834884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.825 [2024-11-28 15:25:19.835079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.825 [2024-11-28 15:25:19.835113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.825 [2024-11-28 15:25:19.835143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.825 [2024-11-28 15:25:19.837305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.825 [2024-11-28 15:25:19.846827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.847155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.847285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.847311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.847326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.847538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.847689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.847711] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.847725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.850219] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.859374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.859630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.859729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.859757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.859774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.859938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.860115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.860139] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.860153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.862314] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.871906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.872225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.872381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.872407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.872422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.872599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.872767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.872791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.872805] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.875158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.884452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.884704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.884833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.884861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.884878] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.885060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.885303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.885323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.885335] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.887467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.897261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.897543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.897693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.897733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.897748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.897911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.898128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.898152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.898166] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.900400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.909679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.909963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.910063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.910090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.910120] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.910301] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.910521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.910544] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.910558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.912901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.922280] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.922571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.922722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.922750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.922767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.922966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.923145] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.923169] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.923183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.925687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.934908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.935242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.935400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.935425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.935440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.935635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.935767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.935789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.935804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.938122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.947535] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.947846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.948005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.948032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.948049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.826 [2024-11-28 15:25:19.948216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.826 [2024-11-28 15:25:19.948421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.826 [2024-11-28 15:25:19.948444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.826 [2024-11-28 15:25:19.948459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.826 [2024-11-28 15:25:19.950712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.826 [2024-11-28 15:25:19.959979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.826 [2024-11-28 15:25:19.960325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.960440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-28 15:25:19.960465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.826 [2024-11-28 15:25:19.960480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:19.960618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:19.960750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:19.960772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:19.960786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:19.963058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 [2024-11-28 15:25:19.972648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:19.973003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:19.973106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:19.973135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:19.973152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:19.973316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:19.973447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:19.973470] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:19.973484] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:19.975753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 [2024-11-28 15:25:19.985236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:19.985571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:19.985681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:19.985706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:19.985727] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:19.985919] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:19.986087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:19.986122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:19.986136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:19.988531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 837371 Killed "${NVMF_APP[@]}" "$@" 00:30:19.827 15:25:19 -- host/bdevperf.sh@36 -- # tgt_init 00:30:19.827 15:25:19 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:19.827 15:25:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:19.827 15:25:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:19.827 15:25:19 -- common/autotest_common.sh@10 -- # set +x 00:30:19.827 15:25:19 -- nvmf/common.sh@469 -- # nvmfpid=838391 00:30:19.827 15:25:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:19.827 15:25:19 -- nvmf/common.sh@470 -- # waitforlisten 838391 00:30:19.827 15:25:19 -- common/autotest_common.sh@829 -- # '[' -z 838391 ']' 00:30:19.827 15:25:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:19.827 15:25:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:19.827 15:25:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:19.827 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:19.827 15:25:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:19.827 15:25:19 -- common/autotest_common.sh@10 -- # set +x 00:30:19.827 [2024-11-28 15:25:19.997901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:19.998193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:19.998316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:19.998360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:19.998377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:19.998556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:19.998718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:19.998740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:19.998755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:20.001251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 [2024-11-28 15:25:20.010320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:20.010748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.010864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.010891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:20.010907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:20.011104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:20.011304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:20.011327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:20.011342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:20.013622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 [2024-11-28 15:25:20.022577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:20.022874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.022969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.022996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:20.023012] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:20.023186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:20.023339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:20.023361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:20.023375] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:20.025424] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 [2024-11-28 15:25:20.034885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:20.035233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.035355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.035381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:20.035398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:20.035548] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:20.035755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:20.035774] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:20.035788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:20.037996] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:19.827 [2024-11-28 15:25:20.038776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:19.827 [2024-11-28 15:25:20.038834] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:19.827 [2024-11-28 15:25:20.047206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:19.827 [2024-11-28 15:25:20.047503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.047650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-28 15:25:20.047675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:19.827 [2024-11-28 15:25:20.047698] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:19.827 [2024-11-28 15:25:20.047863] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:19.827 [2024-11-28 15:25:20.048047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:19.827 [2024-11-28 15:25:20.048066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:19.827 [2024-11-28 15:25:20.048079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:19.827 [2024-11-28 15:25:20.050241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.087 [2024-11-28 15:25:20.059850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.087 [2024-11-28 15:25:20.060232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.087 [2024-11-28 15:25:20.060363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.087 [2024-11-28 15:25:20.060389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.087 [2024-11-28 15:25:20.060405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.087 [2024-11-28 15:25:20.060601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.087 [2024-11-28 15:25:20.060800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.087 [2024-11-28 15:25:20.060820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.087 [2024-11-28 15:25:20.060832] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.063276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.072070] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.072404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.072523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.072548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.072564] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.072696] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.072916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.072935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.072948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.075170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.088 [2024-11-28 15:25:20.084617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.085006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.085117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.085144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.085165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.085329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.085533] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.085552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.085564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.087775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.097275] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.097512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.097664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.097689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.097705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.097866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.098008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.098027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.098039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.100110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.109630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.110054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.110180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.110206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.110222] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.110370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.110576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.110610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.110622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.112760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:20.088 [2024-11-28 15:25:20.112894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.122323] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.122763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.122891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.122918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.122939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.123140] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.123303] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.123323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.123339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.125437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.135015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.135305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.135444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.135469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.135486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.135622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.135792] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.135811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.135825] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.138267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.147669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.148022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.148146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.148190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.148207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.148339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.148522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.148545] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.148571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.151037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.160360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.160699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.160856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.160881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.160908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.161054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.161227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.161249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.161262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.163546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.088 [2024-11-28 15:25:20.173074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.088 [2024-11-28 15:25:20.173557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.173749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.088 [2024-11-28 15:25:20.173778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.088 [2024-11-28 15:25:20.173799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.088 [2024-11-28 15:25:20.174002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.088 [2024-11-28 15:25:20.174188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.088 [2024-11-28 15:25:20.174211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.088 [2024-11-28 15:25:20.174227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.088 [2024-11-28 15:25:20.176246] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.185645] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.185923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.186041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.186067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.186091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.186287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.186501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.186524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.186539] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.188692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.198164] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.198498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.198626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.198664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.198680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.198845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.199036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.199069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.199121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.201475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.207050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:20.089 [2024-11-28 15:25:20.207192] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:20.089 [2024-11-28 15:25:20.207213] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:20.089 [2024-11-28 15:25:20.207228] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:20.089 [2024-11-28 15:25:20.207340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:20.089 [2024-11-28 15:25:20.207393] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:20.089 [2024-11-28 15:25:20.207390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:20.089 [2024-11-28 15:25:20.210425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.210719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.210823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.210849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.210866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.211000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.211227] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.211248] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.211263] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.213188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.222873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.223277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.223424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.223452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.223471] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.223596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.223750] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.223771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.223789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.225927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.235297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.235736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.235856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.235882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.235902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.236060] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.236266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.236289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.236307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.238543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.247549] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.247969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.248074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.248116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.248136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.248278] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.248453] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.248474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.248490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.250729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.259987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.260393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.260528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.260563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.260582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.260736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.260905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.260926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.260941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.263128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.272382] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.272792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.272898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.272933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.272954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.273148] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.273332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.273353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.089 [2024-11-28 15:25:20.273370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.089 [2024-11-28 15:25:20.275226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.089 [2024-11-28 15:25:20.284813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.089 [2024-11-28 15:25:20.285218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.285376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.089 [2024-11-28 15:25:20.285402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.089 [2024-11-28 15:25:20.285430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.089 [2024-11-28 15:25:20.285589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.089 [2024-11-28 15:25:20.285775] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.089 [2024-11-28 15:25:20.285796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.090 [2024-11-28 15:25:20.285814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.090 [2024-11-28 15:25:20.288007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.090 [2024-11-28 15:25:20.297290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.090 [2024-11-28 15:25:20.297545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.090 [2024-11-28 15:25:20.297691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.090 [2024-11-28 15:25:20.297717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.090 [2024-11-28 15:25:20.297733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.090 [2024-11-28 15:25:20.297867] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.090 [2024-11-28 15:25:20.298031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.090 [2024-11-28 15:25:20.298051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.090 [2024-11-28 15:25:20.298065] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.090 [2024-11-28 15:25:20.300015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.090 [2024-11-28 15:25:20.309584] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.090 [2024-11-28 15:25:20.309892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.090 [2024-11-28 15:25:20.310001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.090 [2024-11-28 15:25:20.310026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.090 [2024-11-28 15:25:20.310050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.090 [2024-11-28 15:25:20.310158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.090 [2024-11-28 15:25:20.310293] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.090 [2024-11-28 15:25:20.310314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.090 [2024-11-28 15:25:20.310327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.090 [2024-11-28 15:25:20.312426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.349 [2024-11-28 15:25:20.322225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.349 [2024-11-28 15:25:20.322530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.349 [2024-11-28 15:25:20.322666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.349 [2024-11-28 15:25:20.322693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.349 [2024-11-28 15:25:20.322709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.349 [2024-11-28 15:25:20.322858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.349 [2024-11-28 15:25:20.322992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.349 [2024-11-28 15:25:20.323012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.349 [2024-11-28 15:25:20.323025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.349 [2024-11-28 15:25:20.325274] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.349 [2024-11-28 15:25:20.334629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.349 [2024-11-28 15:25:20.334908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.349 [2024-11-28 15:25:20.335033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.349 [2024-11-28 15:25:20.335058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.349 [2024-11-28 15:25:20.335074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.349 [2024-11-28 15:25:20.335247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.349 [2024-11-28 15:25:20.335334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.349 [2024-11-28 15:25:20.335355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.349 [2024-11-28 15:25:20.335368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.349 [2024-11-28 15:25:20.337499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.349 [2024-11-28 15:25:20.347000] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.349 [2024-11-28 15:25:20.347284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.349 [2024-11-28 15:25:20.347408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.349 [2024-11-28 15:25:20.347434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.349 [2024-11-28 15:25:20.347450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.349 [2024-11-28 15:25:20.347587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.349 [2024-11-28 15:25:20.347767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.349 [2024-11-28 15:25:20.347787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.349 [2024-11-28 15:25:20.347800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.349876] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.359435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.359727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.359850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.359875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.359890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.360006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.360184] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.360205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.360219] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.362285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.371726] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.371975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.372101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.372127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.372143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.372274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.372391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.372411] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.372424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.374574] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.384023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.384318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.384467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.384492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.384507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.384606] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.384714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.384749] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.384762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.386846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.396407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.396660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.396744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.396769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.396784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.396948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.397124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.397146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.397159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.399224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.408792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.409036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.409171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.409198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.409214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.409346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.409494] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.409514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.409527] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.411695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.421064] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.421386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.421506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.421532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.421548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.421695] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.421874] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.421900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.421914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.424190] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.433485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.433818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.433918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.433943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.433959] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.434091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.434250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.434270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.434283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.436413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.445707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.445976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.446087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.446120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.446136] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.446284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.446433] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.446452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.446465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.448696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.457984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.458263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.458381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.458407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.350 [2024-11-28 15:25:20.458423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.350 [2024-11-28 15:25:20.458570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.350 [2024-11-28 15:25:20.458738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.350 [2024-11-28 15:25:20.458758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.350 [2024-11-28 15:25:20.458777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.350 [2024-11-28 15:25:20.460886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.350 [2024-11-28 15:25:20.470499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.350 [2024-11-28 15:25:20.470758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.350 [2024-11-28 15:25:20.470866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.470892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.470907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.471055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.471215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.471236] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.471249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.473484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.483009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.483312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.483452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.483477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.483492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.483657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.483836] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.483856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.483869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.485958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.495352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.495580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.495700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.495725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.495741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.495888] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.496037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.496056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.496069] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.498153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.507640] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.507932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.508018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.508043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.508059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.508199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.508351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.508387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.508399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.510637] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.519940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.520254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.520363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.520388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.520404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.520568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.520764] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.520784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.520797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.522816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.532292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.532594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.532711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.532736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.532751] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.532882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.533031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.533066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.533079] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.535192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.544451] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.544778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.544920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.544945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.544961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.545118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.545253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.545274] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.545287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.547250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.556765] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.556993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.557112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.557138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.557153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.557285] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.557449] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.557469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.557482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.559528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.569130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.569428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.569542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.569567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.351 [2024-11-28 15:25:20.569583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.351 [2024-11-28 15:25:20.569714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.351 [2024-11-28 15:25:20.569848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.351 [2024-11-28 15:25:20.569868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.351 [2024-11-28 15:25:20.569881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.351 [2024-11-28 15:25:20.572027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.351 [2024-11-28 15:25:20.581567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.351 [2024-11-28 15:25:20.581871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.351 [2024-11-28 15:25:20.582020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.582049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.611 [2024-11-28 15:25:20.582067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.611 [2024-11-28 15:25:20.582242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.611 [2024-11-28 15:25:20.582395] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.611 [2024-11-28 15:25:20.582416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.611 [2024-11-28 15:25:20.582429] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.611 [2024-11-28 15:25:20.584652] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.611 [2024-11-28 15:25:20.593872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.611 [2024-11-28 15:25:20.594172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.594302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.594328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.611 [2024-11-28 15:25:20.594345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.611 [2024-11-28 15:25:20.594509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.611 [2024-11-28 15:25:20.594641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.611 [2024-11-28 15:25:20.594661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.611 [2024-11-28 15:25:20.594674] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.611 [2024-11-28 15:25:20.596805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.611 [2024-11-28 15:25:20.606232] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.611 [2024-11-28 15:25:20.606508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.606627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.606652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.611 [2024-11-28 15:25:20.606668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.611 [2024-11-28 15:25:20.606832] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.611 [2024-11-28 15:25:20.606996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.611 [2024-11-28 15:25:20.607016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.611 [2024-11-28 15:25:20.607028] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.611 [2024-11-28 15:25:20.609064] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.611 [2024-11-28 15:25:20.618493] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.611 [2024-11-28 15:25:20.618798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.618941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.618971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.611 [2024-11-28 15:25:20.618988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.611 [2024-11-28 15:25:20.619112] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.611 [2024-11-28 15:25:20.619251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.611 [2024-11-28 15:25:20.619271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.611 [2024-11-28 15:25:20.619284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.611 [2024-11-28 15:25:20.621425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.611 [2024-11-28 15:25:20.630819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.611 [2024-11-28 15:25:20.631090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.631216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.611 [2024-11-28 15:25:20.631242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.611 [2024-11-28 15:25:20.631257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.611 [2024-11-28 15:25:20.631421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.611 [2024-11-28 15:25:20.631585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.611 [2024-11-28 15:25:20.631606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.631619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.633702] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.643207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.643444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.643560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.643586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.643601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.643765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.643960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.643980] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.643993] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.645969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.655475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.655750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.655862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.655887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.655908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.656008] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.656169] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.656190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.656203] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.658234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.667710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.667993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.668116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.668143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.668159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.668339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.668472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.668492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.668504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.670680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.679997] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.680331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.680444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.680469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.680484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.680599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.680780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.680801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.680814] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.682994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.692218] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.692535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.692679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.692704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.692720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.692889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.693057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.693079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.693100] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.695169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.704449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.704790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.704902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.704927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.704942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.705090] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.705234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.705254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.705267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.707470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.716762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.717114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.717221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.717247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.717263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.717444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.717592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.717612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.717625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.719609] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.728891] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.729201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.729287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.729312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.729328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.729443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.729583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.729603] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.729616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.731661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.741194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.741423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.741535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.612 [2024-11-28 15:25:20.741560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.612 [2024-11-28 15:25:20.741576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.612 [2024-11-28 15:25:20.741740] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.612 [2024-11-28 15:25:20.741857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.612 [2024-11-28 15:25:20.741876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.612 [2024-11-28 15:25:20.741889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.612 [2024-11-28 15:25:20.743842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.612 [2024-11-28 15:25:20.753412] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.612 [2024-11-28 15:25:20.753701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.753810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.753835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.753850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.754015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.754188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.754209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.754221] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.756144] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.765551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.765836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.765939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.765964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.765979] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.766102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.766286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.766315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.766329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.768285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.777976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.778274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.778360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.778385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.778401] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.778516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.778651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.778671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.778685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.780842] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.790496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.790810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.790952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.790977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.790992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.791197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.791349] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.791370] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.791383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.793585] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.802821] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.803106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.803219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.803245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.803260] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.803392] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.803573] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.803593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.803610] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.805790] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.814971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.815232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.815350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.815375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.815390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.815554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.815702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.815722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.815736] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.817991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.827187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.827470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.827579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.827604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.827619] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.827766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.827930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.827963] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.827975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.830194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.613 [2024-11-28 15:25:20.839537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.613 [2024-11-28 15:25:20.839887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.839985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.613 [2024-11-28 15:25:20.840011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.613 [2024-11-28 15:25:20.840026] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.613 [2024-11-28 15:25:20.840168] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.613 [2024-11-28 15:25:20.840305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.613 [2024-11-28 15:25:20.840325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.613 [2024-11-28 15:25:20.840339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.613 [2024-11-28 15:25:20.842640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.873 [2024-11-28 15:25:20.851952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.873 [2024-11-28 15:25:20.852208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.852285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.852311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.873 [2024-11-28 15:25:20.852328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.873 [2024-11-28 15:25:20.852460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.873 [2024-11-28 15:25:20.852596] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.873 [2024-11-28 15:25:20.852616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.873 [2024-11-28 15:25:20.852630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.873 [2024-11-28 15:25:20.854833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.873 [2024-11-28 15:25:20.864254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.873 [2024-11-28 15:25:20.864525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.864614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.864640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.873 [2024-11-28 15:25:20.864656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.873 [2024-11-28 15:25:20.864771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.873 [2024-11-28 15:25:20.864921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.873 [2024-11-28 15:25:20.864941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.873 [2024-11-28 15:25:20.864954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.873 [2024-11-28 15:25:20.867034] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.873 [2024-11-28 15:25:20.876481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.873 [2024-11-28 15:25:20.876811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.876920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.876945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.873 [2024-11-28 15:25:20.876961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.873 [2024-11-28 15:25:20.877118] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.873 [2024-11-28 15:25:20.877267] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.873 [2024-11-28 15:25:20.877287] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.873 [2024-11-28 15:25:20.877299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.873 [2024-11-28 15:25:20.879316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.873 [2024-11-28 15:25:20.888808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.873 [2024-11-28 15:25:20.889074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.889177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.889203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.873 [2024-11-28 15:25:20.889218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.873 [2024-11-28 15:25:20.889349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.873 [2024-11-28 15:25:20.889530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.873 [2024-11-28 15:25:20.889550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.873 [2024-11-28 15:25:20.889563] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.873 [2024-11-28 15:25:20.891443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.873 [2024-11-28 15:25:20.901167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.873 [2024-11-28 15:25:20.901461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.901555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-28 15:25:20.901580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.873 [2024-11-28 15:25:20.901595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.873 [2024-11-28 15:25:20.901742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.873 [2024-11-28 15:25:20.901858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.873 [2024-11-28 15:25:20.901877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.873 [2024-11-28 15:25:20.901890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.873 [2024-11-28 15:25:20.903885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.913464] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.913763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.913888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.913914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.913929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.914101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.914232] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.914252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.914264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.916213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.925491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.925814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.925902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.925928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.925943] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.926115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.926283] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.926303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.926316] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.928457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.937775] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.938023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.938150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.938177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.938193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.938341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.938519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.938540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.938553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.940584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.950201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.950487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.950566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.950591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.950607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.950770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.950982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.951002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.951015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.953342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.962607] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.962881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.962971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.963003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.963019] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.963176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.963324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.963344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.963357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.965387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.974849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.975174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.975264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.975291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.975307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.975488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.975635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.975654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.975667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.977649] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.986878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.987174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.987288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.987314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.987330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.987510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.987689] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.987710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.987723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:20.989754] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:20.999185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:20.999446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.999539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:20.999565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:20.999586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:20.999718] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:20.999878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:20.999897] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:20.999911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:21.002059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:21.011503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:21.011795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:21.011884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:21.011908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.874 [2024-11-28 15:25:21.011923] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.874 [2024-11-28 15:25:21.012111] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.874 [2024-11-28 15:25:21.012311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.874 [2024-11-28 15:25:21.012332] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.874 [2024-11-28 15:25:21.012347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.874 [2024-11-28 15:25:21.014569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.874 [2024-11-28 15:25:21.023923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.874 [2024-11-28 15:25:21.024206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:21.024286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-28 15:25:21.024311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.024326] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.024474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.024641] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.024661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.024675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 [2024-11-28 15:25:21.026858] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.875 [2024-11-28 15:25:21.036331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.875 [2024-11-28 15:25:21.036607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.036695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.036722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.036738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.036891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.037074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.037103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.037118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 15:25:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:20.875 15:25:21 -- common/autotest_common.sh@862 -- # return 0 00:30:20.875 15:25:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:20.875 15:25:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:20.875 15:25:21 -- common/autotest_common.sh@10 -- # set +x 00:30:20.875 [2024-11-28 15:25:21.039244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.875 [2024-11-28 15:25:21.048571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.875 [2024-11-28 15:25:21.048887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.048996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.049022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.049037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.049162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.049314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.049334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.049349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 [2024-11-28 15:25:21.051438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.875 15:25:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:20.875 15:25:21 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:20.875 15:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:20.875 15:25:21 -- common/autotest_common.sh@10 -- # set +x 00:30:20.875 [2024-11-28 15:25:21.060908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.875 [2024-11-28 15:25:21.061293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.061373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.061399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.061414] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.061529] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.061631] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:20.875 [2024-11-28 15:25:21.061677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.061697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.061709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 [2024-11-28 15:25:21.063709] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.875 15:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:20.875 15:25:21 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:20.875 15:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:20.875 15:25:21 -- common/autotest_common.sh@10 -- # set +x 00:30:20.875 [2024-11-28 15:25:21.073404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.875 [2024-11-28 15:25:21.073693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.073809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.073834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.073850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.073981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.074107] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.074128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.074155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 [2024-11-28 15:25:21.076313] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.875 [2024-11-28 15:25:21.085688] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.875 [2024-11-28 15:25:21.085945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.086056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.086088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.086112] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.086308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.086505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.086524] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.086537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 [2024-11-28 15:25:21.088595] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:20.875 [2024-11-28 15:25:21.098207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:20.875 [2024-11-28 15:25:21.098607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.098767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-28 15:25:21.098794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:20.875 [2024-11-28 15:25:21.098813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:20.875 [2024-11-28 15:25:21.098936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:20.875 [2024-11-28 15:25:21.099075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:20.875 [2024-11-28 15:25:21.099105] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:20.875 [2024-11-28 15:25:21.099124] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:20.875 [2024-11-28 15:25:21.101186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.134 Malloc0 00:30:21.134 15:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.134 15:25:21 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:21.134 15:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.134 15:25:21 -- common/autotest_common.sh@10 -- # set +x 00:30:21.134 [2024-11-28 15:25:21.110756] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.134 [2024-11-28 15:25:21.111060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.134 [2024-11-28 15:25:21.111164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.134 [2024-11-28 15:25:21.111193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:21.134 [2024-11-28 15:25:21.111211] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:21.134 [2024-11-28 15:25:21.111401] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:21.134 [2024-11-28 15:25:21.111566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.134 [2024-11-28 15:25:21.111604] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.134 [2024-11-28 15:25:21.111620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.134 [2024-11-28 15:25:21.113656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.134 15:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.134 15:25:21 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:21.134 15:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.134 15:25:21 -- common/autotest_common.sh@10 -- # set +x 00:30:21.134 [2024-11-28 15:25:21.122932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.134 [2024-11-28 15:25:21.123239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.134 [2024-11-28 15:25:21.123365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.134 [2024-11-28 15:25:21.123391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c1c1d0 with addr=10.0.0.2, port=4420 00:30:21.134 [2024-11-28 15:25:21.123408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c1c1d0 is same with the state(5) to be set 00:30:21.134 15:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.134 [2024-11-28 15:25:21.123540] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c1c1d0 (9): Bad file descriptor 00:30:21.134 15:25:21 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:21.134 [2024-11-28 15:25:21.123659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:21.134 [2024-11-28 15:25:21.123680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:21.134 [2024-11-28 15:25:21.123694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:21.134 15:25:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.134 15:25:21 -- common/autotest_common.sh@10 -- # set +x 00:30:21.134 [2024-11-28 15:25:21.125695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:21.134 [2024-11-28 15:25:21.127320] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:21.134 15:25:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.134 15:25:21 -- host/bdevperf.sh@38 -- # wait 837704 00:30:21.134 [2024-11-28 15:25:21.135317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:21.134 [2024-11-28 15:25:21.202381] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:29.260 00:30:29.260 Latency(us) 00:30:29.260 [2024-11-28T14:25:29.494Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:29.260 [2024-11-28T14:25:29.494Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:29.260 Verification LBA range: start 0x0 length 0x4000 00:30:29.260 Nvme1n1 : 15.01 8879.80 34.69 16179.74 0.00 5092.92 776.72 22427.88 00:30:29.260 [2024-11-28T14:25:29.494Z] =================================================================================================================== 00:30:29.260 [2024-11-28T14:25:29.494Z] Total : 8879.80 34.69 16179.74 0.00 5092.92 776.72 22427.88 00:30:29.518 15:25:29 -- host/bdevperf.sh@39 -- # sync 00:30:29.518 15:25:29 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:29.518 15:25:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:29.518 15:25:29 -- common/autotest_common.sh@10 -- # set +x 00:30:29.518 15:25:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:29.518 15:25:29 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:29.518 15:25:29 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:29.518 15:25:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:29.518 15:25:29 -- nvmf/common.sh@116 -- # sync 00:30:29.519 15:25:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:29.519 15:25:29 -- nvmf/common.sh@119 -- # set +e 00:30:29.519 15:25:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:29.519 15:25:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:29.519 rmmod nvme_tcp 00:30:29.519 rmmod nvme_fabrics 00:30:29.519 rmmod nvme_keyring 00:30:29.519 15:25:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:29.519 15:25:29 -- nvmf/common.sh@123 -- # set -e 00:30:29.519 15:25:29 -- nvmf/common.sh@124 -- # return 0 00:30:29.519 15:25:29 -- nvmf/common.sh@477 -- # '[' -n 838391 ']' 00:30:29.519 15:25:29 -- nvmf/common.sh@478 -- # killprocess 838391 00:30:29.519 15:25:29 -- common/autotest_common.sh@936 -- # '[' -z 838391 ']' 00:30:29.519 15:25:29 -- common/autotest_common.sh@940 -- # kill -0 838391 00:30:29.519 15:25:29 -- common/autotest_common.sh@941 -- # uname 00:30:29.519 15:25:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:29.519 15:25:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 838391 00:30:29.777 15:25:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:29.777 15:25:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:29.777 15:25:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 838391' 00:30:29.777 killing process with pid 838391 00:30:29.777 15:25:29 -- common/autotest_common.sh@955 -- # kill 838391 00:30:29.777 15:25:29 -- common/autotest_common.sh@960 -- # wait 838391 00:30:30.036 15:25:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:30.036 15:25:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:30.036 15:25:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:30.036 15:25:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:30.036 15:25:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:30.036 15:25:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:30.037 15:25:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:30.037 15:25:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:31.939 15:25:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:31.939 00:30:31.939 real 0m23.247s 00:30:31.939 user 1m2.199s 00:30:31.939 sys 0m4.546s 00:30:31.939 15:25:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:31.939 15:25:32 -- common/autotest_common.sh@10 -- # set +x 00:30:31.939 ************************************ 00:30:31.939 END TEST nvmf_bdevperf 00:30:31.939 ************************************ 00:30:31.939 15:25:32 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:31.939 15:25:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:31.939 15:25:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:31.939 15:25:32 -- common/autotest_common.sh@10 -- # set +x 00:30:31.939 ************************************ 00:30:31.939 START TEST nvmf_target_disconnect 00:30:31.939 ************************************ 00:30:31.939 15:25:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:31.939 * Looking for test storage... 00:30:31.939 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:31.939 15:25:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:31.939 15:25:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:31.939 15:25:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:32.198 15:25:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:32.198 15:25:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:32.198 15:25:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:32.198 15:25:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:32.198 15:25:32 -- scripts/common.sh@335 -- # IFS=.-: 00:30:32.198 15:25:32 -- scripts/common.sh@335 -- # read -ra ver1 00:30:32.198 15:25:32 -- scripts/common.sh@336 -- # IFS=.-: 00:30:32.198 15:25:32 -- scripts/common.sh@336 -- # read -ra ver2 00:30:32.198 15:25:32 -- scripts/common.sh@337 -- # local 'op=<' 00:30:32.198 15:25:32 -- scripts/common.sh@339 -- # ver1_l=2 00:30:32.198 15:25:32 -- scripts/common.sh@340 -- # ver2_l=1 00:30:32.198 15:25:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:32.198 15:25:32 -- scripts/common.sh@343 -- # case "$op" in 00:30:32.198 15:25:32 -- scripts/common.sh@344 -- # : 1 00:30:32.198 15:25:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:32.198 15:25:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:32.198 15:25:32 -- scripts/common.sh@364 -- # decimal 1 00:30:32.198 15:25:32 -- scripts/common.sh@352 -- # local d=1 00:30:32.198 15:25:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:32.198 15:25:32 -- scripts/common.sh@354 -- # echo 1 00:30:32.198 15:25:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:32.198 15:25:32 -- scripts/common.sh@365 -- # decimal 2 00:30:32.198 15:25:32 -- scripts/common.sh@352 -- # local d=2 00:30:32.198 15:25:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:32.198 15:25:32 -- scripts/common.sh@354 -- # echo 2 00:30:32.198 15:25:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:32.198 15:25:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:32.198 15:25:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:32.198 15:25:32 -- scripts/common.sh@367 -- # return 0 00:30:32.198 15:25:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:32.198 15:25:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:32.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.198 --rc genhtml_branch_coverage=1 00:30:32.198 --rc genhtml_function_coverage=1 00:30:32.198 --rc genhtml_legend=1 00:30:32.198 --rc geninfo_all_blocks=1 00:30:32.198 --rc geninfo_unexecuted_blocks=1 00:30:32.198 00:30:32.198 ' 00:30:32.198 15:25:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:32.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.198 --rc genhtml_branch_coverage=1 00:30:32.198 --rc genhtml_function_coverage=1 00:30:32.198 --rc genhtml_legend=1 00:30:32.198 --rc geninfo_all_blocks=1 00:30:32.198 --rc geninfo_unexecuted_blocks=1 00:30:32.198 00:30:32.198 ' 00:30:32.198 15:25:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:32.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.198 --rc genhtml_branch_coverage=1 00:30:32.198 --rc genhtml_function_coverage=1 00:30:32.198 --rc genhtml_legend=1 00:30:32.198 --rc geninfo_all_blocks=1 00:30:32.198 --rc geninfo_unexecuted_blocks=1 00:30:32.198 00:30:32.198 ' 00:30:32.198 15:25:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:32.198 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:32.198 --rc genhtml_branch_coverage=1 00:30:32.198 --rc genhtml_function_coverage=1 00:30:32.198 --rc genhtml_legend=1 00:30:32.198 --rc geninfo_all_blocks=1 00:30:32.198 --rc geninfo_unexecuted_blocks=1 00:30:32.198 00:30:32.198 ' 00:30:32.198 15:25:32 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:32.198 15:25:32 -- nvmf/common.sh@7 -- # uname -s 00:30:32.198 15:25:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:32.198 15:25:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:32.198 15:25:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:32.198 15:25:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:32.198 15:25:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:32.198 15:25:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:32.198 15:25:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:32.198 15:25:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:32.198 15:25:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:32.198 15:25:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:32.198 15:25:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:32.198 15:25:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:32.198 15:25:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:32.198 15:25:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:32.198 15:25:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:32.198 15:25:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:32.198 15:25:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:32.198 15:25:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:32.198 15:25:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:32.198 15:25:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.198 15:25:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.198 15:25:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.198 15:25:32 -- paths/export.sh@5 -- # export PATH 00:30:32.198 15:25:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:32.198 15:25:32 -- nvmf/common.sh@46 -- # : 0 00:30:32.198 15:25:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:32.199 15:25:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:32.199 15:25:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:32.199 15:25:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:32.199 15:25:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:32.199 15:25:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:32.199 15:25:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:32.199 15:25:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:32.199 15:25:32 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:32.199 15:25:32 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:32.199 15:25:32 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:32.199 15:25:32 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:32.199 15:25:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:32.199 15:25:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:32.199 15:25:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:32.199 15:25:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:32.199 15:25:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:32.199 15:25:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:32.199 15:25:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:32.199 15:25:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:32.199 15:25:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:32.199 15:25:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:32.199 15:25:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:32.199 15:25:32 -- common/autotest_common.sh@10 -- # set +x 00:30:34.101 15:25:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:34.101 15:25:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:34.101 15:25:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:34.101 15:25:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:34.101 15:25:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:34.101 15:25:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:34.101 15:25:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:34.101 15:25:34 -- nvmf/common.sh@294 -- # net_devs=() 00:30:34.101 15:25:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:34.101 15:25:34 -- nvmf/common.sh@295 -- # e810=() 00:30:34.101 15:25:34 -- nvmf/common.sh@295 -- # local -ga e810 00:30:34.101 15:25:34 -- nvmf/common.sh@296 -- # x722=() 00:30:34.101 15:25:34 -- nvmf/common.sh@296 -- # local -ga x722 00:30:34.101 15:25:34 -- nvmf/common.sh@297 -- # mlx=() 00:30:34.101 15:25:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:34.101 15:25:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:34.101 15:25:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:34.101 15:25:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:34.101 15:25:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:34.101 15:25:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:34.101 15:25:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:34.101 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:34.101 15:25:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:34.101 15:25:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:34.101 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:34.101 15:25:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:34.101 15:25:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:34.101 15:25:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:34.101 15:25:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:34.101 15:25:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:34.101 15:25:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:34.101 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:34.101 15:25:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:34.101 15:25:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:34.101 15:25:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:34.101 15:25:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:34.101 15:25:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:34.101 15:25:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:34.101 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:34.101 15:25:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:34.101 15:25:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:34.101 15:25:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:34.101 15:25:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:34.101 15:25:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:34.101 15:25:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:34.101 15:25:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:34.101 15:25:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:34.101 15:25:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:34.101 15:25:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:34.101 15:25:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:34.101 15:25:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:34.101 15:25:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:34.101 15:25:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:34.101 15:25:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:34.101 15:25:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:34.101 15:25:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:34.101 15:25:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:34.360 15:25:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:34.360 15:25:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:34.360 15:25:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:34.360 15:25:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:34.360 15:25:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:34.360 15:25:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:34.360 15:25:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:34.360 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:34.360 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:30:34.360 00:30:34.360 --- 10.0.0.2 ping statistics --- 00:30:34.360 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:34.360 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:30:34.360 15:25:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:34.360 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:34.360 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.185 ms 00:30:34.360 00:30:34.360 --- 10.0.0.1 ping statistics --- 00:30:34.360 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:34.360 rtt min/avg/max/mdev = 0.185/0.185/0.185/0.000 ms 00:30:34.360 15:25:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:34.360 15:25:34 -- nvmf/common.sh@410 -- # return 0 00:30:34.360 15:25:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:34.360 15:25:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:34.360 15:25:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:34.360 15:25:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:34.360 15:25:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:34.360 15:25:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:34.360 15:25:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:34.360 15:25:34 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:34.360 15:25:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:34.360 15:25:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:34.360 15:25:34 -- common/autotest_common.sh@10 -- # set +x 00:30:34.360 ************************************ 00:30:34.360 START TEST nvmf_target_disconnect_tc1 00:30:34.360 ************************************ 00:30:34.360 15:25:34 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:34.360 15:25:34 -- host/target_disconnect.sh@32 -- # set +e 00:30:34.360 15:25:34 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:34.360 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.360 [2024-11-28 15:25:34.532849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.360 [2024-11-28 15:25:34.533014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.360 [2024-11-28 15:25:34.533048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xee5270 with addr=10.0.0.2, port=4420 00:30:34.360 [2024-11-28 15:25:34.533088] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:34.360 [2024-11-28 15:25:34.533146] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:34.360 [2024-11-28 15:25:34.533161] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:34.360 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:34.360 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:34.360 Initializing NVMe Controllers 00:30:34.360 15:25:34 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:34.360 15:25:34 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:34.360 15:25:34 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:34.360 15:25:34 -- common/autotest_common.sh@1142 -- # return 0 00:30:34.360 15:25:34 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:34.360 15:25:34 -- host/target_disconnect.sh@41 -- # set -e 00:30:34.360 00:30:34.360 real 0m0.083s 00:30:34.360 user 0m0.039s 00:30:34.360 sys 0m0.044s 00:30:34.361 15:25:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:34.361 15:25:34 -- common/autotest_common.sh@10 -- # set +x 00:30:34.361 ************************************ 00:30:34.361 END TEST nvmf_target_disconnect_tc1 00:30:34.361 ************************************ 00:30:34.361 15:25:34 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:34.361 15:25:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:34.361 15:25:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:34.361 15:25:34 -- common/autotest_common.sh@10 -- # set +x 00:30:34.361 ************************************ 00:30:34.361 START TEST nvmf_target_disconnect_tc2 00:30:34.361 ************************************ 00:30:34.361 15:25:34 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:34.361 15:25:34 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:34.361 15:25:34 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:34.361 15:25:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:34.361 15:25:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:34.361 15:25:34 -- common/autotest_common.sh@10 -- # set +x 00:30:34.361 15:25:34 -- nvmf/common.sh@469 -- # nvmfpid=841590 00:30:34.361 15:25:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:34.361 15:25:34 -- nvmf/common.sh@470 -- # waitforlisten 841590 00:30:34.361 15:25:34 -- common/autotest_common.sh@829 -- # '[' -z 841590 ']' 00:30:34.361 15:25:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:34.361 15:25:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:34.361 15:25:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:34.361 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:34.361 15:25:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:34.361 15:25:34 -- common/autotest_common.sh@10 -- # set +x 00:30:34.619 [2024-11-28 15:25:34.623933] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:34.619 [2024-11-28 15:25:34.624016] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:34.619 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.619 [2024-11-28 15:25:34.696181] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:34.619 [2024-11-28 15:25:34.789016] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:34.619 [2024-11-28 15:25:34.789182] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:34.619 [2024-11-28 15:25:34.789201] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:34.619 [2024-11-28 15:25:34.789213] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:34.619 [2024-11-28 15:25:34.789304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:34.619 [2024-11-28 15:25:34.789360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:34.619 [2024-11-28 15:25:34.789412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:34.619 [2024-11-28 15:25:34.789415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:35.553 15:25:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:35.553 15:25:35 -- common/autotest_common.sh@862 -- # return 0 00:30:35.553 15:25:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:35.553 15:25:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.553 15:25:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:35.553 15:25:35 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:35.553 15:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.553 Malloc0 00:30:35.553 15:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.553 15:25:35 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:35.553 15:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.553 [2024-11-28 15:25:35.671682] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:35.553 15:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.553 15:25:35 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:35.553 15:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.553 15:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.553 15:25:35 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:35.553 15:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.553 15:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.553 15:25:35 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:35.553 15:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.553 [2024-11-28 15:25:35.699941] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:35.553 15:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.553 15:25:35 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:35.553 15:25:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:35.553 15:25:35 -- common/autotest_common.sh@10 -- # set +x 00:30:35.554 15:25:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:35.554 15:25:35 -- host/target_disconnect.sh@50 -- # reconnectpid=841747 00:30:35.554 15:25:35 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:35.554 15:25:35 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:35.554 EAL: No free 2048 kB hugepages reported on node 1 00:30:38.114 15:25:37 -- host/target_disconnect.sh@53 -- # kill -9 841590 00:30:38.114 15:25:37 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 [2024-11-28 15:25:37.726810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Write completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 [2024-11-28 15:25:37.727122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.114 starting I/O failed 00:30:38.114 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 [2024-11-28 15:25:37.727436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Write completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 Read completed with error (sct=0, sc=8) 00:30:38.115 starting I/O failed 00:30:38.115 [2024-11-28 15:25:37.727722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:38.115 [2024-11-28 15:25:37.727899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.728156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.728421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.728629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.728849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.728958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.729035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.729301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.729571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.729848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.729963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.730106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.730376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.730609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.730828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.730947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.115 qpair failed and we were unable to recover it. 00:30:38.115 [2024-11-28 15:25:37.731027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.731114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.115 [2024-11-28 15:25:37.731139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.731223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.731345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.731370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.731443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.731558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.731583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.731697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.731778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.731804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.731917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.732004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.732029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.732121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.732213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.732239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.732330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.733390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.733614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.733840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.733964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.734131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.734373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.734638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.734878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.734981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.735140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.735350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.735609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.735850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.735963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.736050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.736291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.736517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.736744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.736865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.736955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.737216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.737457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.737651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.737873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.738055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.738159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.738185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.738377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.738571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.738635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.738737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.738911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.738936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.116 qpair failed and we were unable to recover it. 00:30:38.116 [2024-11-28 15:25:37.739053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.116 [2024-11-28 15:25:37.739168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.739197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.739327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.739537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.739579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.739678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.739866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.739891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.740121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.740343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.740371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.740492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.740656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.740699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.740787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.740977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.741280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.741565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.741818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.741924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.742029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.742287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.742502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.742785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.742894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.743031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.743286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.743556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.743763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.743904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.744025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.744253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.744460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.744722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.744865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.744949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.745178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.745408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.745660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.745852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.745989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.746078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.746193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.746219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.746307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.746423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.746448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.746552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.746690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.117 [2024-11-28 15:25:37.746715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.117 qpair failed and we were unable to recover it. 00:30:38.117 [2024-11-28 15:25:37.746831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.746915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.746940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.747027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.747228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.747422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.747632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.747790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.747905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.748118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.748381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.748629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.748772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.748920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.749118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.749306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.749540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.749784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.749889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.749971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.750223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.750474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.750728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.750863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.750947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.751176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.751461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.751644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.751756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.751863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.752134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.752346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.752559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.118 [2024-11-28 15:25:37.752698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.118 qpair failed and we were unable to recover it. 00:30:38.118 [2024-11-28 15:25:37.752789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.752895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.752920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.753008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.753302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.753513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.753768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.753882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.753996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.754225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.754469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.754685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.754823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.754911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.755209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.755434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.755743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.755873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.755990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.756192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.756447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.756726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.756862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.756981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.757227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.757419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.757660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.757867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.757989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.758157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.758403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.758647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.758886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.758998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.759043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.119 qpair failed and we were unable to recover it. 00:30:38.119 [2024-11-28 15:25:37.759214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.119 [2024-11-28 15:25:37.759327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.759353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.759447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.759573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.759600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.759686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.759773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.759802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.759930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.760219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.760509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.760738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.760889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.761028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.761223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.761443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.761669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.761798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.761903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.762235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.762477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.762716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.762847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.762959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.763156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.763405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.763654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.763807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.763900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.764193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.764437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.764698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.764838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.764951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.765146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.765434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.765667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.765851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.765986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.766100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.766181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.766206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.120 qpair failed and we were unable to recover it. 00:30:38.120 [2024-11-28 15:25:37.766313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.120 [2024-11-28 15:25:37.766419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.766444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.766565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.766708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.766736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.766819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.766919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.766944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.767053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.767314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.767514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.767802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.767959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.768071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.768336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.768592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.768831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.768984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.769136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.769276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.769301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.769454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.769604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.769644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.769756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.769919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.769960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.770057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.770220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.770247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.770361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.770496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.770524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.770652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.770778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.770806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.770912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.771239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.771518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.771786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.771913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.772037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.772275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.772520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.772781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.772934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.773035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.773278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.773551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.773738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.773868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.121 qpair failed and we were unable to recover it. 00:30:38.121 [2024-11-28 15:25:37.773993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.121 [2024-11-28 15:25:37.774083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.774251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.774488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.774706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.774867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.774961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.775185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.775432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.775663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.775795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.775907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.776190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.776440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.776706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.776858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.777004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.777215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.777506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.777734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.777864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.777977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.778192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.778360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.778665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.778817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.778939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.779247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.779469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.779694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.779881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.779994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.780135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.780354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.780560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.780780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.122 [2024-11-28 15:25:37.780905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.122 qpair failed and we were unable to recover it. 00:30:38.122 [2024-11-28 15:25:37.781009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.781212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.781409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.781646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.781877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.781989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.782103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.782401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.782623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.782803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.782934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.783007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.783252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.783481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.783669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.783808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.783941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.784214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.784551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.784813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.784987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.785099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.785336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.785559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.785810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.785941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.786077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.786334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.786519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.786746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.123 [2024-11-28 15:25:37.786883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.123 qpair failed and we were unable to recover it. 00:30:38.123 [2024-11-28 15:25:37.787003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.787273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.787541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.787759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.787860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.787968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.788205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.788488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.788674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.788863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.788962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.789048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.789224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.789433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.789702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.789865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.789974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.790231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.790423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.790684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.790814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.790933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.791194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.791481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.791731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.791859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.791947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.792169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.792417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.792707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.792914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.792998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.793134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.793356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.124 [2024-11-28 15:25:37.793571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.124 [2024-11-28 15:25:37.793731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.124 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.793875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.793988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.794125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.794331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.794561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.794768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.794898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.794991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.795226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.795414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.795639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.795777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.795873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.796180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.796398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.796622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.796868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.796984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.797103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.797411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.797660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.797873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.797980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.798098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.798346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.798599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.798774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.798904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.798984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.799210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.799399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.799649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.799788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.800015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.800041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.800154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.800292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.800318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.125 qpair failed and we were unable to recover it. 00:30:38.125 [2024-11-28 15:25:37.800396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.800508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.125 [2024-11-28 15:25:37.800533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.800679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.800788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.800813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.800915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.801194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.801456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.801731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.801866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.801949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.802285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.802552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.802782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.802909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.803007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.803212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.803403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.803582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.803781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.803916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.804042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.804320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.804628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.804860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.804989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.805116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.805371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.805592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.805738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.805899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.806150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.806332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.806554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.806860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.806963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.807036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.807156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.807198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.807309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.807418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.807442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.126 qpair failed and we were unable to recover it. 00:30:38.126 [2024-11-28 15:25:37.807549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.807659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.126 [2024-11-28 15:25:37.807683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.807766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.807908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.807933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.808043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.808329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.808529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.808830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.808978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.809056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.809282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.809500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.809720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.809929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.809999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.810134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.810327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.810533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.810813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.810963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.811124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.811316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.811533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.811745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.811850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.811948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.812303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.812549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.812767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.812897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.813037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.813337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.813583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.813813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.813948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.814028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.814109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.814134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.814220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.814299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.814324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.127 [2024-11-28 15:25:37.814435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.814550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.127 [2024-11-28 15:25:37.814574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.127 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.814671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.814745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.814769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.814896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.815154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.815401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.815651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.815799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.815961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.816241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.816446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.816762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.816895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.816978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.817211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.817405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.817695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.817862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.817969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.818204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.818456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.818811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.818975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.819109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.819360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.819596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.819839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.819995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.820154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.820436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.820666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.820909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.820996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.821021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.128 qpair failed and we were unable to recover it. 00:30:38.128 [2024-11-28 15:25:37.821159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.128 [2024-11-28 15:25:37.821292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.821319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.821406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.821530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.821557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.821717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.821801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.821825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.821936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.822244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.822523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.822717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.822906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.823016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.823325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.823545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.823824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.823962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.824100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.824339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.824597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.824836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.824999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.825080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.825165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.825189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.825295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.825406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.825448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.825734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.825898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.825939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.826020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.826278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.826568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.826787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.826887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.826990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.827245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.827434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.827674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.827855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.827964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.828242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.828522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.129 qpair failed and we were unable to recover it. 00:30:38.129 [2024-11-28 15:25:37.828749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.129 [2024-11-28 15:25:37.828826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.828850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.828966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.829227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.829467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.829674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.829857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.830013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.830330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.830597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.830910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.830997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.831129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.831344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.831556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.831813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.831947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.832032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.832297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.832516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.832771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.832881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.833022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.833264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.833488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.833723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.833833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.834023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.834256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.834473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.834750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.834887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.835012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.835269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.835506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.835699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.835829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.130 qpair failed and we were unable to recover it. 00:30:38.130 [2024-11-28 15:25:37.835936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.836049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.130 [2024-11-28 15:25:37.836073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.836200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.836293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.836317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.836433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.836509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.836534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.836644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.836788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.836813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.836917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.837147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.837315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.837564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.837784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.837886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.837968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.838213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.838457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.838708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.838814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.838890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.839183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.839435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.839742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.839873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.839971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.840145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.840171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.840290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.840451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.840479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.840615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.840762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.840787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.840917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.841110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.841428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.841656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.841867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.841989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.842157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.842394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.842656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.842821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.842933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.843046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.843071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.131 [2024-11-28 15:25:37.843278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.843355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.131 [2024-11-28 15:25:37.843380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.131 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.843493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.843619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.843645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.843760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.843890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.843915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.844041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.844308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.844522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.844756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.844888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.845003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.845279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.845504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.845706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.845810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.845912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.846189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.846399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.846684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.846825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.846897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.847192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.847417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.847630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.847791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.847909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.848210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.848414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.848660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.848810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.848956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.849190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.849437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.132 qpair failed and we were unable to recover it. 00:30:38.132 [2024-11-28 15:25:37.849710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.132 [2024-11-28 15:25:37.849836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.849861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.849966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.850220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.850480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.850707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.850818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.850962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.851237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.851446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.851693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.851884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.851987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.852223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.852435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.852667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.852772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.852901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.853250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.853505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.853694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.853821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.853955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.854199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.854421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.854638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.854789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.854927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.855145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.855362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.855670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.855878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.855990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.856134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.856331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.856548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.133 qpair failed and we were unable to recover it. 00:30:38.133 [2024-11-28 15:25:37.856808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.133 [2024-11-28 15:25:37.856923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.856948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.857050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.857245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.857493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.857693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.857831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.857942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.858134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.858376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.858588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.858763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.858872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.858990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.859226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.859489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.859710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.859843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.859967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.860154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.860379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.860554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.860801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.860943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.861062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.861322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.861601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.861845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.861974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.862089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.862220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.862245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.862358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.862492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.862520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.862614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.862728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.862756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.862871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.863132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.863386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.134 qpair failed and we were unable to recover it. 00:30:38.134 [2024-11-28 15:25:37.863583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.134 [2024-11-28 15:25:37.863674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.863699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.863779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.863892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.863918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.864038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.864225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.864456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.864785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.864912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.864994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.865211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.865457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.865672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.865899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.865975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.866101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.866324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.866568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.866850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.866997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.867125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.867352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.867580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.867793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.867942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.868101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.868319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.868536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.868812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.868916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.869073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.869198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.869224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.869340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.869502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.869530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.869664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.869816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.869845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.869976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.870069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.870104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.870218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.870323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.870348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.870456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.870539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.135 [2024-11-28 15:25:37.870564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.135 qpair failed and we were unable to recover it. 00:30:38.135 [2024-11-28 15:25:37.870648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.870753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.870779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.870891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.870966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.870990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.871128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.871270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.871295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.871432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.871567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.871592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.871671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.871773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.871799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.871917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.872185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.872374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.872564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.872879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.872995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.873163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.873433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.873705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.873854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.873980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.874272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.874497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.874751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.874866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.874953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.875215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.875519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.875830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.875969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.876048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.876379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.876646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.876907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.876997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.877114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.877397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.877658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.877896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.877999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.136 qpair failed and we were unable to recover it. 00:30:38.136 [2024-11-28 15:25:37.878090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.136 [2024-11-28 15:25:37.878197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.878224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.878353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.878491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.878516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.878663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.878767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.878793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.878898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.878978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.879100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.879325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.879588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.879756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.879922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.880194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.880451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.880739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.880905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.881067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.881354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.881613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.881847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.881955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.882082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.882348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.882566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.882785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.882945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.883023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.883228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.883523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.883770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.883895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.884001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.884116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.884147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.884261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.884397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.884427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.884562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.884652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.137 [2024-11-28 15:25:37.884678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.137 qpair failed and we were unable to recover it. 00:30:38.137 [2024-11-28 15:25:37.884787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.884896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.884922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.885029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.885269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.885519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.885775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.885908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.886017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.886161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.886188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.886324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.886482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.886511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.886640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.886792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.886817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.886928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.887157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.887449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.887693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.887883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.887978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.888109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.888351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.888556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.888765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.888914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.889013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.889240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.889467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.889749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.889907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.890044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.890324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.890560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.890779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.890948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.891078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.891372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.891650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.891865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.891978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.138 [2024-11-28 15:25:37.892004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.138 qpair failed and we were unable to recover it. 00:30:38.138 [2024-11-28 15:25:37.892139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.892304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.892334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.892427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.892554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.892582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.892718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.892802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.892828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.892940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.893145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.893405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.893624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.893840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.893972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.894129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.894325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.894637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.894842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.894963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.895061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.895320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.895586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.895808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.895913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.896026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.896256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.896486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.896701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.896839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.896944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.897260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.897572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.897815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.897921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.898013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.898270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.898538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.898791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.898956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.899070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.899221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.139 [2024-11-28 15:25:37.899247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.139 qpair failed and we were unable to recover it. 00:30:38.139 [2024-11-28 15:25:37.899337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.899465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.899493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.899597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.899737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.899763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.899877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.900106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.900323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.900579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.900746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.900878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.901176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.901370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.901619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.901759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.901929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.902220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.902528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.902760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.902893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.903003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.903231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.903436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.903720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.903816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.903905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.904205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.904479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.904705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.904818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.904899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.905236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.905465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.905732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.905840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.905981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.906262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.906520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.140 qpair failed and we were unable to recover it. 00:30:38.140 [2024-11-28 15:25:37.906745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.140 [2024-11-28 15:25:37.906872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.906898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.907015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.907241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.907503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.907782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.907895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.908040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.908270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.908480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.908808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.908949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.909046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.909379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.909602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.909884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.909990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.910176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.910435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.910698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.910839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.910977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.911206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.911482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.911743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.911894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.912034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.912235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.912470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.912728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.912851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.912967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.913074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.913106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.913220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.913312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.141 [2024-11-28 15:25:37.913337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.141 qpair failed and we were unable to recover it. 00:30:38.141 [2024-11-28 15:25:37.913491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.913605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.913630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.913752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.913832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.913857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.913989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.914241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.914424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.914715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.914897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.915013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.915226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.915463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.915694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.915881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.915992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.916267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.916529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.916807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.916936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.917057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.917399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.917622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.917919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.917999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.918155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.918370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.918661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.918815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.918951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.919190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.919400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.919607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.919852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.919989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.920070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.920161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.920187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.920271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.920385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.920411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.920526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.920630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.142 [2024-11-28 15:25:37.920663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.142 qpair failed and we were unable to recover it. 00:30:38.142 [2024-11-28 15:25:37.920748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.920831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.920857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.920967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.921211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.921490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.921668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.921868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.921984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.922102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.922336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.922561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.922777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.922910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.923032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.923290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.923520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.923745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.923880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.923997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.924221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.924421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.924681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.924831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.924924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.925139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.925409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.925621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.925809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.925943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.926024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.926295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.926776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.926888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.926992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.927108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.927145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.927242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.927322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.927359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.143 qpair failed and we were unable to recover it. 00:30:38.143 [2024-11-28 15:25:37.927473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.143 [2024-11-28 15:25:37.927550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.927575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.927666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.927806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.927832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.927943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.928153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.928439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.928676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.928806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.928911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.929142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.929350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.929606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.929797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.929902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.929989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.930205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.930471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.930725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.930857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.930963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.931173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.931390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.931603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.931838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.931948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.932055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.932267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.932467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.932724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.932856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.932993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.933210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.933440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.933666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.933879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.933996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.144 qpair failed and we were unable to recover it. 00:30:38.144 [2024-11-28 15:25:37.934113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.144 [2024-11-28 15:25:37.934202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.934331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.934571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.934827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.934996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.935109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.935345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.935559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.935804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.935969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.936058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.936256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.936500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.936735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.936862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.936936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.937254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.937503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.937717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.937818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.937900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.938118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.938331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.938583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.938830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.938926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.939043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.939280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.939538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.939787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.939895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.940004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.940212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.940425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.940677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.145 qpair failed and we were unable to recover it. 00:30:38.145 [2024-11-28 15:25:37.940914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.145 [2024-11-28 15:25:37.940994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.941117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.941330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.941511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.941811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.941954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.942052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.942316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.942542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.942766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.942897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.943008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.943240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.943454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.943642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.943856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.943992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.944078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.944365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.944623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.944862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.944986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.945106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.945319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.945569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.945791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.945931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.946067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.946293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.946579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.946797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.946898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.146 qpair failed and we were unable to recover it. 00:30:38.146 [2024-11-28 15:25:37.947011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.146 [2024-11-28 15:25:37.947120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.947228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.947451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.947653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.947917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.947999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.948132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.948376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.948628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.948821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.948919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.949040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.949284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.949539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.949786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.949890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.949981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.950215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.950435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.950661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.950798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.950888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.951181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.951374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.951620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.951819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.951951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.952064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.952285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.952535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.952759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.952869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.953006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.953250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.953471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.147 qpair failed and we were unable to recover it. 00:30:38.147 [2024-11-28 15:25:37.953650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.147 [2024-11-28 15:25:37.953789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.953815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.953907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.953995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.954131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.954317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.954555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.954833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.954944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.955060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.955283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.955514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.955713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.955879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.955952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.956215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.956399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.956574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.956751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.956854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.956932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.957202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.957391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.957606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.957801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.957906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.958023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.958240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.958457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.958722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.958826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.958938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.959145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.959374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.959660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.959764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.959915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.960004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.960029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.148 qpair failed and we were unable to recover it. 00:30:38.148 [2024-11-28 15:25:37.960137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.148 [2024-11-28 15:25:37.960242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.960339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.960536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.960788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.960890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.960978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.961206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.961423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.961725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.961860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.961937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.962169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.962423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.962639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.962781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.962879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.963159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.963398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.963646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.963890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.963981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.964091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.964314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.964529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.964774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.964917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.965007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.965251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.965484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.965705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.965844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.965969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.966191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.966416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.966617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.149 qpair failed and we were unable to recover it. 00:30:38.149 [2024-11-28 15:25:37.966847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.149 [2024-11-28 15:25:37.966991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.967106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.967349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.967582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.967798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.967909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.968018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.968232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.968435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.968679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.968808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.968922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.969168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.969389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.969596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.969814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.969989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.970103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.970327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.970563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.970849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.970982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.971088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.971288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.971512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.971736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.971864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.971936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.972184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.972413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.972649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.150 [2024-11-28 15:25:37.972779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.150 qpair failed and we were unable to recover it. 00:30:38.150 [2024-11-28 15:25:37.972867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.972938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.972963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.973069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.973273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.973453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.973672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.973866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.973980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.974063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.974285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.974509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.974721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.974858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.974980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.975209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.975437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.975680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.975810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.975894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.976179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.976420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.976679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.976819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.976930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.977121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.977359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.977559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.977789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.977918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.978021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.978244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.978450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.978660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.978860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.978958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.979072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.979154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.151 [2024-11-28 15:25:37.979185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.151 qpair failed and we were unable to recover it. 00:30:38.151 [2024-11-28 15:25:37.979264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.979347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.979373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.979449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.979592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.979617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.979698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.979838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.979863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.980003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.980219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.980513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.980786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.980917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.980996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.981241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.981428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.981651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.981777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.981866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.982154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.982380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.982626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.982804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.982909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.983023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.983207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.983394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.983627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.983829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.983967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.984053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.984278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.984490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.984703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.984812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.984921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.985196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.985411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.985661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.152 [2024-11-28 15:25:37.985767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.152 qpair failed and we were unable to recover it. 00:30:38.152 [2024-11-28 15:25:37.985886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.985969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.985993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.986119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.986320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.986564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.986758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.986866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.986945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.987184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.987400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.987597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.987838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.987937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.988059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.988326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.988533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.988777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.988911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.989021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.989255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.989541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.989731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.989866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.990018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.990219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.990438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.990652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.990859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.990992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.991113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.991312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.991508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.991757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.991898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.991983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.992087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.992119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.992202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.992290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.992317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.153 qpair failed and we were unable to recover it. 00:30:38.153 [2024-11-28 15:25:37.992426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.153 [2024-11-28 15:25:37.992532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.992558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.992674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.992756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.992781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.992886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.992993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.993141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.993367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.993565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.993787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.993899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.993980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.994216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.994445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.994648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.994871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.994982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.995120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.995347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.995582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.995800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.995916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.996033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.996264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.996484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.996668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.996868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.996965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.997106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.997313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.997539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.997760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.997861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.997965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.998185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.998406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.998595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.154 [2024-11-28 15:25:37.998764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.154 qpair failed and we were unable to recover it. 00:30:38.154 [2024-11-28 15:25:37.998850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.998954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.998980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:37.999072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:37.999300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:37.999488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:37.999741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:37.999848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:37.999935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.000137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.000334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.000551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.000804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.000937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.001051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.001258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.001505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.001717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.001823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.001910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.002150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.002406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.002620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.002841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.002979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.003089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.003286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.003482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.003668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.003857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.003960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.004048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.004283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.004500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.155 [2024-11-28 15:25:38.004699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.155 [2024-11-28 15:25:38.004841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.155 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.004930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.005189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.005372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.005555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.005772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.005888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.005970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.006212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.006501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.006764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.006943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.007026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.007221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.007441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.007718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.007834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.007925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.008146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.008347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.008589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.008809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.008941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.009032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.009281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.009496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.009744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.009897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.010043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.010269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.010458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.010647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.010856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.010992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.011081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.011342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.011533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.011757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.011895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.156 qpair failed and we were unable to recover it. 00:30:38.156 [2024-11-28 15:25:38.011984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.156 [2024-11-28 15:25:38.012089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.012198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.012382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.012623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.012878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.012982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.013065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.013258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.013467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.013655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.013845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.013962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.014055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.014288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.014541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.014749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.014895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.015013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.015276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.015489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.015742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.015870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.015984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.016226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.016441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.016669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.016853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.016992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.017071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.017349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.017597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.017837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.017953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.018070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.018299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.018523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.018718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.018856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.157 [2024-11-28 15:25:38.018973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.019058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.157 [2024-11-28 15:25:38.019083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.157 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.019202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.019315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.019341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.019452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.019562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.019587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.019672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.019758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.019784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.019899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.020124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.020381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.020567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.020776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.020909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.021020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.021230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.021416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.021651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.021813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.021938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.022146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.022349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.022582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.022799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.022905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.023017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.023249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.023463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.023683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.023819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.023898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.024119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.024297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.024518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.024633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.024799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.025014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.025056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.025221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.025368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.025406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.025552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.025695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.025741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.025869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.026152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.026343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.158 qpair failed and we were unable to recover it. 00:30:38.158 [2024-11-28 15:25:38.026587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.158 [2024-11-28 15:25:38.026698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.026726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.026824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.026932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.026960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.027047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.027265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.027447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.027671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.027891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.027999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.028087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.028369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.028570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.028789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.028893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.028977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.029179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.029368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.029585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.029788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.029921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.030000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.030295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.030507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.030686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.030897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.030976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.031104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.031293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.031501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.031709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.031828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.031968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.032085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.032119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.032232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.032312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.032339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.032419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.032497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.159 [2024-11-28 15:25:38.032522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.159 qpair failed and we were unable to recover it. 00:30:38.159 [2024-11-28 15:25:38.032627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.032712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.032737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.032819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.032904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.032931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.033010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.033231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.033453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.033696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.033878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.033987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.034105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.034277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.034487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.034735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.034842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.034954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.035188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.035435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.035685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.035892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.035985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.036160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.036384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.036581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.036802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.036905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.036991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.037077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.037128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.160 qpair failed and we were unable to recover it. 00:30:38.160 [2024-11-28 15:25:38.037243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.160 [2024-11-28 15:25:38.037353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.037379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.037460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.037573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.037599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.037680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.037769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.037795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.037902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.038124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.038359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.038587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.038836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.038952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.039070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.039276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.039480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.039755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.039918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.039999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.040200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.040393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.040587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.040860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.040973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.041053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.041331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.041548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.041766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.041870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.041975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.042157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.042348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.042561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.042762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.042896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.043013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.043091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.043130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.043237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.043380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.043406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.043482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.043561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.161 [2024-11-28 15:25:38.043588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.161 qpair failed and we were unable to recover it. 00:30:38.161 [2024-11-28 15:25:38.043678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.043772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.043798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.043904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.043978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.044087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.044283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.044499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.044693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.044804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.044912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.045139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.045355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.045535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.045723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.045826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.045940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.046147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.046372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.046626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.046848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.046958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.047038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.047285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.047508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.047754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.047925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.048061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.048268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.048512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.048763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.048904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.049044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.049284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.049478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.049706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.049813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.049908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.050032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.162 [2024-11-28 15:25:38.050058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.162 qpair failed and we were unable to recover it. 00:30:38.162 [2024-11-28 15:25:38.050185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.050295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.050321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.050453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.050561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.050587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.050697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.050780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.050804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.050908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.051156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.051386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.051616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.051829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.051931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.052048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.052258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.052472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.052658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.052882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.052992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.053110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.053291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.053539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.053745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.053878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.053987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.054241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.054429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.054657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.054836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.054948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.055031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.055238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.055429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.055615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.055807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.055965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.056048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.056127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.056161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.163 qpair failed and we were unable to recover it. 00:30:38.163 [2024-11-28 15:25:38.056247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.056373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.163 [2024-11-28 15:25:38.056399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.056515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.056618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.056648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.056720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.056793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.056819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.056911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.057188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.057422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.057622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.057837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.057948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.058042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.058301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.058524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.058727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.058913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.058995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.059104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.059286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.059511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.059702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.059874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.059981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.060059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.060281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.060457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.060685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.060797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.060888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.061009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.061035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.061144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.061257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.061284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.164 qpair failed and we were unable to recover it. 00:30:38.164 [2024-11-28 15:25:38.061412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.164 [2024-11-28 15:25:38.061495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.061521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.061609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.061701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.061727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.061841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.061949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.061976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.062088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.062303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.062557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.062775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.062885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.062963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.063197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.063505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.063705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.063910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.063990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.064136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.064377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.064606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.064828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.064971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.065108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.065319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.065538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.065771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.065871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.065985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.066249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.066472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.066692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.066909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.066994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.067131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.067367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.067582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.067828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.165 [2024-11-28 15:25:38.067937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.165 qpair failed and we were unable to recover it. 00:30:38.165 [2024-11-28 15:25:38.068029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.068209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.068406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.068618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.068864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.068993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.069071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.069268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.069511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.069727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.069916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.069988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.070144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.070333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.070529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.070750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.070888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.070972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.071198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.071431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.071620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.071837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.071971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.072065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.072297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.072501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.072688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.072889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.072997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.073076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.073317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.073553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.073803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.073911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.073997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.074088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.166 [2024-11-28 15:25:38.074127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.166 qpair failed and we were unable to recover it. 00:30:38.166 [2024-11-28 15:25:38.074243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.074323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.074360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.074450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.074561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.074588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.074700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.074787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.074814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.074951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.075190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.075442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.075630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.075878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.075979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.076065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.076343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.076547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.076777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.076886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.076999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.077220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.077452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.077676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.077876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.077995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.078110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.078388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.078607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.078879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.078991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.079073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.079264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.079522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.079722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.079839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.079919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.080118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.080416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.167 [2024-11-28 15:25:38.080628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.167 [2024-11-28 15:25:38.080735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.167 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.080818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.080906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.080932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.081038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.081310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.081534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.081715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.081854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.081936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.082176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.082395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.082646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.082829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.082964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.083052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.083259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.083492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.083775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.083887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.083982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.084203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.084412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.084600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.084832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.084992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.085080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.085328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.085554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.085739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.085904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.085984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.086105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.086142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.086228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.086333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.086363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.168 qpair failed and we were unable to recover it. 00:30:38.168 [2024-11-28 15:25:38.086467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.168 [2024-11-28 15:25:38.086555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.086582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.086669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.086749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.086776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.086915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.087210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.087466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.087690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.087827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.087933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.088126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.088386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.088616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.088865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.088979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.089123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.089369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.089626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.089844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.089987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.090127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.090312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.090544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.090773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.090887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.090992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.091230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.091455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.091671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.091805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.091890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.092181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.092433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.092693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.092825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.092909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.093025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.093051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.169 [2024-11-28 15:25:38.093170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.093259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.169 [2024-11-28 15:25:38.093285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.169 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.093383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.093475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.093501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.093618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.093734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.093760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.093875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.093983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.094118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.094332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.094553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.094787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.094925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.095039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.095275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.095499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.095760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.095868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.095979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.096207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.096402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.096634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.096855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.096987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.097074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.097298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.097522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.097751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.097857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.097968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.098211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.098463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.098639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.098853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.098984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.099064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.099325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.099562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.170 [2024-11-28 15:25:38.099778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.170 [2024-11-28 15:25:38.099919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.170 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.100029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.100280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.100525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.100780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.100920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.101036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.101248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.101427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.101647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.101857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.101961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.102037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.102265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.102461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.102668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.102835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.102917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.103143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.103357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.103577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.103812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.103946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.104026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.104241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.104469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.104712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.104846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.104958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.105156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.105344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.105542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.105733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.105884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.106004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.106118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.106145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.171 qpair failed and we were unable to recover it. 00:30:38.171 [2024-11-28 15:25:38.106238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.171 [2024-11-28 15:25:38.106355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.106381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.106467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.106550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.106577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.106678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.106794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.106820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.106911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.106998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.107118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.107377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.107656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.107834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.107939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.108053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.108317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.108539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.108757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.108870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.108960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.109182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.109398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.109582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.109772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.109877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.109960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.110159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.110361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.110584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.110817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.110921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.111005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.111199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.111394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.111582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.111787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.111925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.112002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.112074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.112106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.112187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.112304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.112331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.172 qpair failed and we were unable to recover it. 00:30:38.172 [2024-11-28 15:25:38.112444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.172 [2024-11-28 15:25:38.112552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.112578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.112650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.112728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.112753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.112833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.112910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.112935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.113044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.113321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.113552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.113756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.113902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.113988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.114255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.114432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.114625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.114848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.114987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.115129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.115338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.115598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.115854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.115974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.116137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.116406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.116656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.116899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.116998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.117119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.117354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.117601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.117851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.117985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.118012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.118163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.118264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.118293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.173 qpair failed and we were unable to recover it. 00:30:38.173 [2024-11-28 15:25:38.118415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.118536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.173 [2024-11-28 15:25:38.118568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.118653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.118752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.118782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.118879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.119128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.119371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.119637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.119854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.119996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.120103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.120347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.120565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.120747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.120885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.120966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.121187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.121380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.121576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.121824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.121925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.122038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.122224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.122438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.122694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.122877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.122988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.123117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.123321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.123508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.123746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.123868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.123962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.124161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.124414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.124615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.174 qpair failed and we were unable to recover it. 00:30:38.174 [2024-11-28 15:25:38.124834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.174 [2024-11-28 15:25:38.124943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.124970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.125054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.125284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.125537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.125760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.125929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.126015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.126275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.126540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.126823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.126932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.127048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.127247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.127514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.127716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.127826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.127948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.128175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.128401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.128602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.128788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.128930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.129009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.129236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.129466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.129698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.129921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.129999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.130110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.130302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.130525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.130746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.130870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.130959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.131081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.131114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.131229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.131309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.131335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.175 qpair failed and we were unable to recover it. 00:30:38.175 [2024-11-28 15:25:38.131411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.175 [2024-11-28 15:25:38.131525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.131556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.131646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.131767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.131794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.131907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.131992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.132126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.132342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.132539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.132741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.132851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.132961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.133181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.133410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.133597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.133799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.133902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.134013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.134213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.134427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.134639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.134860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.134973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.135054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.135267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.135487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.135689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.135903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.135992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.136109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.136308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.136529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.136731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.136841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.136925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.137016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.137042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.137191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.137304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.137330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.176 qpair failed and we were unable to recover it. 00:30:38.176 [2024-11-28 15:25:38.137443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.137520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.176 [2024-11-28 15:25:38.137546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.137627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.137711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.137737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.137811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.137887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.137913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.138005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.138227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.138411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.138615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.138837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.138955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.139045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.139264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.139493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.139741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.139851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.139948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.140198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.140427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.140655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.140885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.140997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.141113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.141360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.141576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.141771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.141908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.141989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.142262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.142462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.142647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.142891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.142997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.143024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.143147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.143237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.143264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.177 qpair failed and we were unable to recover it. 00:30:38.177 [2024-11-28 15:25:38.143342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.143428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.177 [2024-11-28 15:25:38.143455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.143571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.143650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.143676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.143763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.143870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.143896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.143977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.144211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.144420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.144664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.144870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.144974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.145089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.145381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.145607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.145834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.145955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.146063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.146376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.146566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.146782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.146893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.146981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.147184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.147365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.147581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.147796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.147938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.148019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.148232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.148428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.148622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.148836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.148977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.149003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.149080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.149170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.149197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.178 qpair failed and we were unable to recover it. 00:30:38.178 [2024-11-28 15:25:38.149275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.149360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.178 [2024-11-28 15:25:38.149386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.149479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.149592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.149618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.149698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.149840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.149867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.149984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.150250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.150440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.150662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.150795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.150875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.151141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.151370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.151600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.151828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.151935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.152046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.152271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.152503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.152698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.152864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.152944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.153138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.153331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.153516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.153792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.153900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.153979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.154187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.154407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.154666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.154890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.154996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.155079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.155320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.155542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.179 qpair failed and we were unable to recover it. 00:30:38.179 [2024-11-28 15:25:38.155788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.179 [2024-11-28 15:25:38.155903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.155930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.156077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.156311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.156540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.156795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.156958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.157040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.157278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.157498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.157751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.157884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.157964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.158190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.158380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.158599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.158802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.158922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.159002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.159258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.159478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.159692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.159903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.159990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.160106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.160295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.160520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.160731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.160870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.160988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.161220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.161402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.161590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.161840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.161960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.162081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.162189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.180 [2024-11-28 15:25:38.162215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.180 qpair failed and we were unable to recover it. 00:30:38.180 [2024-11-28 15:25:38.162295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.162378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.162404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.162507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.162619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.162650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.162725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.162862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.162888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.162973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.163207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.163427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.163642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.163841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.163955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.164071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.164279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.164454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.164641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.164874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.164978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.165121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.165312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.165560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.165822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.165959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.166075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.166330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.166556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.166801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.166906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.167010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.167259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.167471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.167651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.167834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.167967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.168046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.168139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.168167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.168280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.168358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.168384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.168462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.168540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.181 [2024-11-28 15:25:38.168565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.181 qpair failed and we were unable to recover it. 00:30:38.181 [2024-11-28 15:25:38.168665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.168753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.168780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.168874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.168971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.168997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.169117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.169344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.169543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.169730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.169873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.169984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.170199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.170393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.170574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.170824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.170953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.171059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.171264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.171483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.171716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.171829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.171952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.172227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.172504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.172703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.172814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.172925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.173177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.173367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.173584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.173774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.173909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.174019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.174105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.174132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.182 qpair failed and we were unable to recover it. 00:30:38.182 [2024-11-28 15:25:38.174246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.182 [2024-11-28 15:25:38.174361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.174387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.174470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.174541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.174567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.174651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.174729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.174755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.174873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.174979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.175121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.175321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.175543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.175784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.175885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.175973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.176193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.176372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.176627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.176844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.176984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.177122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.177338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.177565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.177782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.177947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.178054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.178329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.178542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.178788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.178893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.179012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.179219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.179428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.179681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.179857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.179960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.180069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.180212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.180239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.180324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.180408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.180434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.180557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.180645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.183 [2024-11-28 15:25:38.180671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.183 qpair failed and we were unable to recover it. 00:30:38.183 [2024-11-28 15:25:38.180767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.180842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.180868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.180976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.181241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.181448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.181725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.181821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.181935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.182154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.182381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.182627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.182868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.182983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.183085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.183301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.183543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.183731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.183837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.183948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.184203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.184401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.184615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.184837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.184982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.185128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.185322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.185530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.185814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.185955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.186111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.186332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.186565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.186812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.186944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.187024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.187161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.187188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.184 [2024-11-28 15:25:38.187276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.187381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.184 [2024-11-28 15:25:38.187407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.184 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.187493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.187564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.187590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.187706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.187820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.187846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.187964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.188216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.188427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.188648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.188907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.188994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.189115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.189329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.189540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.189821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.189965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.190083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.190339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.190547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.190757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.190924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.191002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.191209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.191462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.191650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.191843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.191984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.192125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.192355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.192548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.192768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.192868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.192947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.193178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.193426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.193670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.185 qpair failed and we were unable to recover it. 00:30:38.185 [2024-11-28 15:25:38.193864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.185 [2024-11-28 15:25:38.193975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.194086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.194337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.194594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.194793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.194962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.195104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.195220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.195247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.195386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.195500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.195526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.195664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.195748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.195774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.195871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.196120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.196354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.196599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.196834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.196966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.197107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.197327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.197585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.197860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.197999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.198125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.198346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.198576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.198787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.198929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.199036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.199276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.199527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.199779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.199944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.200029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.200251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.200488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.200736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.200878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.186 qpair failed and we were unable to recover it. 00:30:38.186 [2024-11-28 15:25:38.200991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.186 [2024-11-28 15:25:38.201111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.201249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.201522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.201819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.201930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.202046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.202294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.202590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.202797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.202937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.203076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.203279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.203515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.203723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.203828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.203934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.204107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.204328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.204568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.204856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.204997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.205081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.205322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.205550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.205765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.205871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.206015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.206258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.206487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.206733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.206837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.187 [2024-11-28 15:25:38.206917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.207033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.187 [2024-11-28 15:25:38.207058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.187 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.207145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.207339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.207597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.207824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.207927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.208076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.208326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.208549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.208794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.208957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.209078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.209303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.209523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.209755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.209861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.209934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.210203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.210410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.210611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.210850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.210964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.211074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.211344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.211550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.211759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.211900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.212015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.212268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.212525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.212776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.212995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.213121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.213418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.213744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.213896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.188 qpair failed and we were unable to recover it. 00:30:38.188 [2024-11-28 15:25:38.213998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.188 [2024-11-28 15:25:38.214113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.214140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.214230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.214385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.214411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.214552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.214767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.214794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.214913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.214997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.215140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.215385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.215640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.215857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.215958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.216104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.216303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.216554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.216813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.216922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.217030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.217261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.217483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.217706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.217811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.217947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.218246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.218471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.218664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.218771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.218921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.219161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.219392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.219676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.219783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.219898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.220172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.220419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.220641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.220867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.220984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.189 [2024-11-28 15:25:38.221010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.189 qpair failed and we were unable to recover it. 00:30:38.189 [2024-11-28 15:25:38.221098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.221346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.221573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.221821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.221951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.222036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.222248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.222417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.222627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.222842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.222984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.223121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.223396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.223608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.223843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.223975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.224057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.224321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.224536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.224843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.224948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.225056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.225287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.225534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.225758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.225920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.226004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.226248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.226507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.226839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.226944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.227052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.227254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.227524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.190 [2024-11-28 15:25:38.227733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.190 [2024-11-28 15:25:38.227865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.190 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.227971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.228203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.228392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.228630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.228827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.228955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.229041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.229224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.229474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.229691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.229825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.229942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.230226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.230509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.230722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.230840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.230955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.231247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1121e00 is same with the state(5) to be set 00:30:38.191 [2024-11-28 15:25:38.231414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.231656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.231886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.231990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.232072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.232288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.232469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.232659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.232847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.232945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.233046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.233195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.233232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.233358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.233453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.233483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.233621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.233703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.191 [2024-11-28 15:25:38.233736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.191 qpair failed and we were unable to recover it. 00:30:38.191 [2024-11-28 15:25:38.233819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.233925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.233957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.234060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.234329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.234599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.234820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.234976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.235157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.235467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.235715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.235914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.235996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.236135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.236349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.236557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.236764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.236900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.236975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.237171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.237366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.237609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.237829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.237965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.238043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.238227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.238458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.238695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.238831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.238917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.239125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.239329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.239548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.239766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.239905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.239979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.240091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.240135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.240240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.240352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.192 [2024-11-28 15:25:38.240377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.192 qpair failed and we were unable to recover it. 00:30:38.192 [2024-11-28 15:25:38.240483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.240568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.240593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.240676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.240787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.240813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.240903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.240989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.241132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.241331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.241576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.241769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.241882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.241990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.242210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.242476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.242676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.242787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.242901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.243161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.243435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.243620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.243844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.243939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.244062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.244323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.244582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.244803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.244915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.244991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.245209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.245489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.245731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.245838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.245955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.246195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.246409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.246630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.246846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.193 [2024-11-28 15:25:38.246963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.193 qpair failed and we were unable to recover it. 00:30:38.193 [2024-11-28 15:25:38.247083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.247278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.247473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.247680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.247801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.247910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.248126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.248368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.248617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.248818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.248958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.249053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.249252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.249448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.249726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.249858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.249939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.250196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.250383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.250631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.250819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.250926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.251011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.251236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.251495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.251690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.251896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.251981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.252088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.252317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.252559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.252809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.252941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.253035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.253115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.253143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.253224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.253336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.194 [2024-11-28 15:25:38.253363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.194 qpair failed and we were unable to recover it. 00:30:38.194 [2024-11-28 15:25:38.253446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.253557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.253583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.253662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.253772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.253802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.253891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.253999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.254140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.254330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.254553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.254770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.254899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.254978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.255210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.255418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.255644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.255839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.255979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.256066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.256294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.256498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.256689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.256824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.256974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.257238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.257436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.257685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.257913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.257996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.258115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.258369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.258586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.258796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.258933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.259013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.259262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.259449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.259689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.195 [2024-11-28 15:25:38.259797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.195 qpair failed and we were unable to recover it. 00:30:38.195 [2024-11-28 15:25:38.259905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.260120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.260357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.260583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.260834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.260938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.261023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.261243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.261459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.261674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.261787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.261903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.262181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.262376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.262564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.262788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.262908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.263028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.263294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.263485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.263681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.263875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.263982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.264064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.264292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.264515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.264707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.264845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.264953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.265046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.265072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.265184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.265289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.265320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.196 qpair failed and we were unable to recover it. 00:30:38.196 [2024-11-28 15:25:38.265409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.196 [2024-11-28 15:25:38.265502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.265541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.265661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.265767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.265804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.265959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.266184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.266405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.266615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.266837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.266942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.267017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.267219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.267399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.267603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.267822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.267931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.268016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.268206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.268455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.268670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.268810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.268928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.269185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.269414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.269661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.269871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.269979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.270089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.270372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.270624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.270823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.270927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.271014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.271256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.271435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.271690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.271823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.197 qpair failed and we were unable to recover it. 00:30:38.197 [2024-11-28 15:25:38.271911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.197 [2024-11-28 15:25:38.272016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.272120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.272345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.272588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.272836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.272935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.273046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.273269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.273491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.273752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.273859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.273931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.274243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.274498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.274730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.274872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.274948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.275183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.275493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.275753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.275892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.276034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.276259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.276507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.276718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.276855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.276938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.277171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.277420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.277636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.277831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.277937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.278012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.278254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.278533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.278727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.278858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.278936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.279055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.198 [2024-11-28 15:25:38.279082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.198 qpair failed and we were unable to recover it. 00:30:38.198 [2024-11-28 15:25:38.279187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.279386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.279622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.279815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.279920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.280017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.280291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.280552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.280833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.280978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.281059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.281306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.281566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.281812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.281961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.282054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.282355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.282603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.282812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.282950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.283059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.283240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.283449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.283730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.283878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.283996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.284219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.284438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.284660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.284888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.284988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.285080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.285319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.285601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.285821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.285988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.286100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.286194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.286224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.286306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.286420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.286446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.199 qpair failed and we were unable to recover it. 00:30:38.199 [2024-11-28 15:25:38.286565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.199 [2024-11-28 15:25:38.286678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.286704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.286787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.286909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.286935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.287054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.287292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.287521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.287807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.287951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.288098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.288376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.288601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.288880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.288988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.289131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.289351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.289561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.289767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.289910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.290023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.290273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.290461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.290664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.290836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.290929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.291167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.291432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.291676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.291846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.291932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.292189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.292449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.292713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.292834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.292948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.293037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.293065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.293194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.293285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.200 [2024-11-28 15:25:38.293312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.200 qpair failed and we were unable to recover it. 00:30:38.200 [2024-11-28 15:25:38.293436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.293528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.293555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.293685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.293826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.293852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.293963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.294158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.294511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.294816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.294958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.295074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.295269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.295295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.295482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.295594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.295622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.295809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.295996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.296113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.296441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.296701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.296853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.296939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.297171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.297429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.297657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.297871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.297987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.298103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.298327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.298532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.298748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.298919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.299012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.299235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.299413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.299684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.299828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.299941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.300184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.300409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.300634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.300811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.300954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.301065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.301147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.301173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.301257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.301370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.301396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.301514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.301663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.201 [2024-11-28 15:25:38.301689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.201 qpair failed and we were unable to recover it. 00:30:38.201 [2024-11-28 15:25:38.301780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.301889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.301926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.302046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.302302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.302503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.302747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.302852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.302963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.303221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.303466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.303671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.303893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.303975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.304117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.304292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.304522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.304753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.304865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.304948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.305173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.305393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.305614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.305830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.305971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.306192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.306501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.306721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.306933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.307046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.307207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.307233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.307346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.307535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.307561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.307650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.307732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.307759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.307892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.308194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.308442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.308694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.308800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.308883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.309159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.309381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.309601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.309850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.202 [2024-11-28 15:25:38.309957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.202 qpair failed and we were unable to recover it. 00:30:38.202 [2024-11-28 15:25:38.310068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.310258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.310479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.310680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.310791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.310899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.311177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.311383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.311605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.311793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.311925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.312030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.312273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.312495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.312712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.312875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.312990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.313246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.313501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.313733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.313859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.313935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.314177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.314390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.314675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.314807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.314938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.315217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.315510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.315773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.315914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.316026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.316250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.316469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.316682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.316911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.316994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.317144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.317323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.317632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.317772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.203 [2024-11-28 15:25:38.317891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.318004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.203 [2024-11-28 15:25:38.318030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.203 qpair failed and we were unable to recover it. 00:30:38.204 [2024-11-28 15:25:38.318146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.204 qpair failed and we were unable to recover it. 00:30:38.204 [2024-11-28 15:25:38.318342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.204 qpair failed and we were unable to recover it. 00:30:38.204 [2024-11-28 15:25:38.318577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.204 qpair failed and we were unable to recover it. 00:30:38.204 [2024-11-28 15:25:38.318806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.318923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.204 qpair failed and we were unable to recover it. 00:30:38.204 [2024-11-28 15:25:38.319003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.319110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.204 [2024-11-28 15:25:38.319157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.204 qpair failed and we were unable to recover it. 00:30:38.204 [2024-11-28 15:25:38.319265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.319456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.319527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.488 qpair failed and we were unable to recover it. 00:30:38.488 [2024-11-28 15:25:38.319717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.319851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.319892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.488 qpair failed and we were unable to recover it. 00:30:38.488 [2024-11-28 15:25:38.320034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.320181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.320220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.488 qpair failed and we were unable to recover it. 00:30:38.488 [2024-11-28 15:25:38.320368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.320469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.320507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.488 qpair failed and we were unable to recover it. 00:30:38.488 [2024-11-28 15:25:38.320652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.320794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.320860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.488 qpair failed and we were unable to recover it. 00:30:38.488 [2024-11-28 15:25:38.321020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.321187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.488 [2024-11-28 15:25:38.321231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.321358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.321484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.321520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.321678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.321794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.321821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.321934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.322188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.322417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.322617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.322825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.322940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.323024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.323265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.323461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.323690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.323832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.323933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.324132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.324330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.324543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.324762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.324897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.324973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.325238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.325458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.325705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.325838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.325954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.326195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.326436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.326666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.326888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.326991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.327085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.327171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.327197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.327280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.327366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.327391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.327504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.327620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.489 [2024-11-28 15:25:38.327647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.489 qpair failed and we were unable to recover it. 00:30:38.489 [2024-11-28 15:25:38.327741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.327837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.327865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.327989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.328206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.328448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.328723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.328868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.328962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.329220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.329490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.329819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.329989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.330121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.330389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.330645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.330847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.330979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.331071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.331347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.331578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.331803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.331971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.332045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.332293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.332527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.332745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.332857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.332983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.333237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.333545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.333777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.333923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.334019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.334278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.334511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.490 [2024-11-28 15:25:38.334740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.490 [2024-11-28 15:25:38.334910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.490 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.335055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.335250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.335490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.335671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.335842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.335922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.336162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.336427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.336621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.336799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.336933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.337006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.337234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.337462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.337746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.337887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.337976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.338191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.338452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.338691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.338881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.338998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.339105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.339356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.339577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.339813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.339956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.340047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.340262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.340523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.340779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.340887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.341002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.341130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.341166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.341306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.341420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.341447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.491 qpair failed and we were unable to recover it. 00:30:38.491 [2024-11-28 15:25:38.341562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.341709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.491 [2024-11-28 15:25:38.341736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.341813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.341900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.341927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.342020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.342218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.342462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.342718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.342832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.342955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.343228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.343427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.343650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.343894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.343994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.344090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.344380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.344638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.344850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.344983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.345089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.345344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.345618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.345823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.345928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.346013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.346217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.346473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.346698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.346813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.346930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.347202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.347459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.347793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.347920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.348052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.348179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.348207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.348352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.348464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.348490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.492 qpair failed and we were unable to recover it. 00:30:38.492 [2024-11-28 15:25:38.348605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.492 [2024-11-28 15:25:38.348745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.348772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.348920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.349113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.349327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.349703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.349856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.349971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.350185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.350399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.350754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.350985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.351114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.351346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.351681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.351845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.351960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.352224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.352477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.352724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.352863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.352978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.353231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.353487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.353739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.353881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.354013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.354194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.354482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.354740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.354910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.493 qpair failed and we were unable to recover it. 00:30:38.493 [2024-11-28 15:25:38.354996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.355099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.493 [2024-11-28 15:25:38.355126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.355246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.355332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.355358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.355479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.355588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.355614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.355756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.355831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.355857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.355976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.356203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.356414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.356681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.356854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.356969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.357190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.357435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.357665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.357810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.357933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.358159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.358424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.358688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.358853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.358968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.359290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.359473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.359707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.359847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.359933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.360195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.360415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.360712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.360884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.361008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.361296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.361478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.361699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.361838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.361985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.362097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.362124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.494 qpair failed and we were unable to recover it. 00:30:38.494 [2024-11-28 15:25:38.362206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.494 [2024-11-28 15:25:38.362315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.362341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.362450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.362537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.362563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.362681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.362794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.362821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.362905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.363129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.363393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.363668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.363839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.363955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.364180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.364409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.364657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.364793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.364874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.365244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.365500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.365764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.365898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.366049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.366328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.366553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.366781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.366920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.367030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.367266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.367490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.367682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.367870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.367986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.368131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.368372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.368617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.368878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.368987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.369012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.369121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.369216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.369242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.495 qpair failed and we were unable to recover it. 00:30:38.495 [2024-11-28 15:25:38.369350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.495 [2024-11-28 15:25:38.369456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.369482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.369620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.369737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.369764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.369847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.369976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.370118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.370382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.370633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.370891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.370974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.371086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.371324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.371594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.371783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.371891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.372004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.372269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.372465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.372711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.372845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.372991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.373230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.373457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.373749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.373868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.373977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.374209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.374464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.374711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.374876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.374991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.375254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.375509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.375784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.375960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.376073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.376163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.376190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.376276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.376364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.496 [2024-11-28 15:25:38.376390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.496 qpair failed and we were unable to recover it. 00:30:38.496 [2024-11-28 15:25:38.376536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.376624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.376651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.376759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.376871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.376896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.376974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.377204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.377418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.377658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.377835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.377908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.378195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.378469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.378703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.378844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.378992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.379227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.379445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.379682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.379834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.379951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.380264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.380450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.380635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.380762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.380903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.381233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.381529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.381775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.381885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.381997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.382086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.382121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.382230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.382374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.382400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.497 qpair failed and we were unable to recover it. 00:30:38.497 [2024-11-28 15:25:38.382506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.382617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.497 [2024-11-28 15:25:38.382643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.382724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.382871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.382897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.382973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.383197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.383401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.383630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.383881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.383994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.384182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.384408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.384598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.384778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.384916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.385057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.385288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.385584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.385845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.385992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.386108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.386323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.386541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.386822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.386921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.387039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.387261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.387490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.387702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.387804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.387960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.388165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.388383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.388642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.388809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.388953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.389062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.389089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.389238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.389365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.498 [2024-11-28 15:25:38.389391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.498 qpair failed and we were unable to recover it. 00:30:38.498 [2024-11-28 15:25:38.389507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.389616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.389642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.389725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.389815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.389841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.389915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.389996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.390128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.390418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.390668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.390872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.390989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.391128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.391347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.391581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.391829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.391931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.392004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.392259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.392490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.392746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.392917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.393008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.393272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.393500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.393726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.393879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.394028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.394250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.394469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.394721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.394865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.394949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.395190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.395421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.395654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.499 [2024-11-28 15:25:38.395797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.499 qpair failed and we were unable to recover it. 00:30:38.499 [2024-11-28 15:25:38.395879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.395988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.396131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.396384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.396632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.396863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.396974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.397087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.397338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.397586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.397873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.397988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.398194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.398470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.398720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.398827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.398937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.399166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.399388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.399671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.399801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.399908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.400121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.400377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.400602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.400882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.400973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.401139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.401344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.500 qpair failed and we were unable to recover it. 00:30:38.500 [2024-11-28 15:25:38.401590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.500 [2024-11-28 15:25:38.401690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.401777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.401861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.401888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.402001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.402237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.402484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.402769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.402932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.403063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.403333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.403520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.403714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.403810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.403895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.404144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.404361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.404547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.404761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.404868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.404953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.405212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.405432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.405668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.405785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.405892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.406122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.406381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.406631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.406823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.406966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.407073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.407336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.407554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.407785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.407928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.408069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.408218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.408246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.501 qpair failed and we were unable to recover it. 00:30:38.501 [2024-11-28 15:25:38.408368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.501 [2024-11-28 15:25:38.408506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.408531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.408644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.408747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.408773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.408883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.408964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.408990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.409111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.409332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.409528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.409779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.409899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.410012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.410272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.410477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.410686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.410895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.410992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.411102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.411337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.411525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.411809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.411946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.412089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.412200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.412232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.412317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.412426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.412451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.502 [2024-11-28 15:25:38.412558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.412633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.502 [2024-11-28 15:25:38.412658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.502 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.412772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.412876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.412903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.412985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.413257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.413477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.413724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.413865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.413980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.414297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.414545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.414800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.414934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.415026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.415211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.415409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.415652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.415793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.415884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.416138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.416392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.416637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.416896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.416981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.417156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.417382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.417600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.417842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.417985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.418069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.418332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.418562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.418855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.418961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.419071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.419194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.419221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.503 qpair failed and we were unable to recover it. 00:30:38.503 [2024-11-28 15:25:38.419334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.419447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.503 [2024-11-28 15:25:38.419474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.419596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.419675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.419702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.419824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.419908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.419935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.420078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.420287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.420498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.420718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.420829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.420941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.421148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.421354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.421650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.421906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.421984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.422117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.422343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.422568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.422790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.422902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.423047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.423292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.423551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.423782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.423950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.424029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.424248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.424469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.424712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.424824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.504 qpair failed and we were unable to recover it. 00:30:38.504 [2024-11-28 15:25:38.424934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.425019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.504 [2024-11-28 15:25:38.425044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.425121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.425327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.425540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.425762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.425865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.425971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.426243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.426498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.426724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.426868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.426985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.427243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.427439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.427646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.427903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.427974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.428083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.428309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.428555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.428795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.428948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.429033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.429262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.429513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.429765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.429894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.430003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.430231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.430472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.430689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.430823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.505 [2024-11-28 15:25:38.430943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.431015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.505 [2024-11-28 15:25:38.431041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.505 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.431128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.431371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.431594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.431812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.431922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.432044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.432306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.432564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.432784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.432885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.433026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.433319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.433558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.433808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.433941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.434049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.434320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.434531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.434800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.434939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.435059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.435273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.435499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.435739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.435878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.435959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.436251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.436492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.436701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.436830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.436940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.437019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.437045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.437128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.437251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.437277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.437367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.437483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.506 [2024-11-28 15:25:38.437509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.506 qpair failed and we were unable to recover it. 00:30:38.506 [2024-11-28 15:25:38.437601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.437677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.437702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.437775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.437847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.437873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.437961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.438182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.438403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.438639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.438878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.438993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.439108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.439323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.439503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.439706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.439876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.439975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.440267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.440487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.440743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.440915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.440996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.441210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.441460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.441670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.441876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.441974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.442064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.442152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.442180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.442298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.442406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.442432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.507 qpair failed and we were unable to recover it. 00:30:38.507 [2024-11-28 15:25:38.442559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.442642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.507 [2024-11-28 15:25:38.442669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.442742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.442816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.442842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.442962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.443193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.443383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.443578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.443831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.443938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.444050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.444290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.444510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.444684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.444823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.444929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.445188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.445448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.445651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.445865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.445966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.446053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.446285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.446498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.446717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.446853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.446934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.447228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.447504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.447800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.447937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.448019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.448126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.448164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.508 [2024-11-28 15:25:38.448287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.448362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.508 [2024-11-28 15:25:38.448392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.508 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.448532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.448613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.448639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.448749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.448854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.448880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.448960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.449233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.449467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.449687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.449876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.449990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.450168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.450367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.450640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.450867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.450981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.451119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.451306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.451556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.451814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.451981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.452060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.452277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.452498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.452728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.452867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.452973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.453212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.453465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.453698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.453841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.453947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.454157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.454385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.454584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.509 [2024-11-28 15:25:38.454825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.509 [2024-11-28 15:25:38.454963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.509 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.455077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.455336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.455538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.455778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.455891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.456001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.456203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.456435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.456713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.456819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.456908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.457158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.457458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.457714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.457834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.457944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.458177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.458466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.458695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.458831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.458917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.459184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.459397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.459642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.459901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.459985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.460131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.460364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.460556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.460761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.460890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.460976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.461201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.461392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.510 [2024-11-28 15:25:38.461651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.510 [2024-11-28 15:25:38.461782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.510 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.461887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.462119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.462305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.462529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.462774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.462880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.462955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.463187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.463423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.463660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.463778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.463882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.464133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.464376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.464623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.464785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.464925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.465151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.465431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.465656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.465877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.465987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.466099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.466350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.466574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.466779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.466895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.467035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.467237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.467426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.467654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.467868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.467994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.468070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.468166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.468193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.468299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.468432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.511 [2024-11-28 15:25:38.468462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.511 qpair failed and we were unable to recover it. 00:30:38.511 [2024-11-28 15:25:38.468552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.468695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.468723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.468804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.468882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.468909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.468996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.469249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.469510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.469723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.469872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.469985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.470216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.470451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.470676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.470784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.470873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.471163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.471361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.471573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.471794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.471932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.472037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.472291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.472497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.472706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.472836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.472943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.473370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.473628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.473881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.473995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.474109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.474223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.474249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.474340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.474486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.474512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.512 qpair failed and we were unable to recover it. 00:30:38.512 [2024-11-28 15:25:38.474628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.512 [2024-11-28 15:25:38.474734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.474759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.474845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.474962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.474987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.475128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.475218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.475243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.475359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.478323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.478542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.478786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.478895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.478983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.479207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.479438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.479682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.479871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.479970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.480086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.480321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.480499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.480735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.480870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.480944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.481235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.481462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.481691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.481835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.481948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.482145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.482333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.482538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.482789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.482895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.482973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.483206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.483487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.513 [2024-11-28 15:25:38.483736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.513 [2024-11-28 15:25:38.483845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.513 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.483924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.484160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.484379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.484601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.484819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.484930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.485017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.485238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.485481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.485686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.485834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.485924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.486138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.486359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.486542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.486735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.486870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.486952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.487167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.487410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.487600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.487874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.487978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.488153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.488455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.488740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.488876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.488964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.489271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.489529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.489757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.489865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.489980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.490071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.490102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.514 qpair failed and we were unable to recover it. 00:30:38.514 [2024-11-28 15:25:38.490191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.514 [2024-11-28 15:25:38.490278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.490396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.490589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.490778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.490886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.491027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.491301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.491503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.491700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.491882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.491983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.492008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.515 [2024-11-28 15:25:38.492149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.492226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.515 [2024-11-28 15:25:38.492252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.515 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.492379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.492458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.492483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.492597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.492712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.492737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.492848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.492932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.492963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.493105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.493301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.493500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.493679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.493868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.493998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.494084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.494316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.494572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.494805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.494910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.494986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.495089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.495125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.495210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.495299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.495325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.516 qpair failed and we were unable to recover it. 00:30:38.516 [2024-11-28 15:25:38.495437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.516 [2024-11-28 15:25:38.495551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.495576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.495654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.495734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.495760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.495866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.495947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.495972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.496058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.496278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.496520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.496755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.496866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.496957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.497179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.497391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.497587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.497795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.497902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.497990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.498182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.498389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.498601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.498809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.498954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.517 qpair failed and we were unable to recover it. 00:30:38.517 [2024-11-28 15:25:38.499033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.517 [2024-11-28 15:25:38.499111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.499230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.499520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.499708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.499808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.499917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.500144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.500332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.500567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.500758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.500862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.500983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.501232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.501455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.501661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.501873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.501982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.502091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.502309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.502496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.518 qpair failed and we were unable to recover it. 00:30:38.518 [2024-11-28 15:25:38.502783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.518 [2024-11-28 15:25:38.502921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.502947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.503058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.503296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.503525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.503765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.503883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.503990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.504224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.504423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.504651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.504874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.504986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.505132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.505322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.505611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.505836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.505947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.506032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.506233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.506477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.519 qpair failed and we were unable to recover it. 00:30:38.519 [2024-11-28 15:25:38.506660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.519 [2024-11-28 15:25:38.506743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.506769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.506846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.506938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.506965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.507078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.507323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.507562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.507770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.507870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.507949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.508142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.508349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.508542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.508767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.508898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.508978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.509185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.509470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.509699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.509872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.509959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.510171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.510409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.510660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.510902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.510983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.511119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.511335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.511587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.511802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.511904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.511984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.512268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.512502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.512711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.512845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.512953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.513056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.513081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.513213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.513344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.513375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.520 [2024-11-28 15:25:38.513469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.513554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.520 [2024-11-28 15:25:38.513583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.520 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.513673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.513790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.513816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.513894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.513981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.514104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.514375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.514594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.514809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.514971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.515058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.515252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.515478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.515711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.515885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.515999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.516113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.516340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.516648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.516894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.516979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.517087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.517317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.517550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.517741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.517887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.517967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.518205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.518416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.518644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.518835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.518973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.519090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.519327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.519562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.521 qpair failed and we were unable to recover it. 00:30:38.521 [2024-11-28 15:25:38.519788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.521 [2024-11-28 15:25:38.519873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.519900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.520014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.520263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.520523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.520716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.520878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.520961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.521218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.521420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.521703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.521814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.521928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.522178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.522424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.522710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.522858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.522932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.523166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.523414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.523637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.523834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.523986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.524013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.524125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.524206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.524232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.522 qpair failed and we were unable to recover it. 00:30:38.522 [2024-11-28 15:25:38.524321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.522 [2024-11-28 15:25:38.524432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.524458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.524539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.524678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.524705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.524791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.524906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.524937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.525053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.525268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.525499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.525727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.525910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.525991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.526104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.526296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.526512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.526709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.526818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.523 [2024-11-28 15:25:38.526905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.527020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.523 [2024-11-28 15:25:38.527051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.523 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.527173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.527360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.527580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.527803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.527947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.528030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.528224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.528417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.528626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.524 [2024-11-28 15:25:38.528848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.524 [2024-11-28 15:25:38.528969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.524 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.529089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.525 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.529373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.525 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.529602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.525 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.529826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.529934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.525 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.530011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.530088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.530119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.525 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.530205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.530288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.525 [2024-11-28 15:25:38.530314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.525 qpair failed and we were unable to recover it. 00:30:38.525 [2024-11-28 15:25:38.530391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.530472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.530499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.530641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.530723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.530749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.530856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.530996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.531103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.531379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.531563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.531781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.531887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.532031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.532257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.532476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.532719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.526 qpair failed and we were unable to recover it. 00:30:38.526 [2024-11-28 15:25:38.532917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.532990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.526 [2024-11-28 15:25:38.533017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.533123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.533350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.533596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.533775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.533894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.533975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.534199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.534446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.528 [2024-11-28 15:25:38.534715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.528 [2024-11-28 15:25:38.534817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.528 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.534930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.529 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.535183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.529 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.535416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.529 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.535642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.529 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.535865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.535977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.529 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.536120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.536209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.536236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.529 qpair failed and we were unable to recover it. 00:30:38.529 [2024-11-28 15:25:38.536334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.536473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.529 [2024-11-28 15:25:38.536500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.530 qpair failed and we were unable to recover it. 00:30:38.530 [2024-11-28 15:25:38.536585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.530 [2024-11-28 15:25:38.536690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.530 [2024-11-28 15:25:38.536716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.530 qpair failed and we were unable to recover it. 00:30:38.530 [2024-11-28 15:25:38.536801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.530 [2024-11-28 15:25:38.536888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.530 [2024-11-28 15:25:38.536915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.530 qpair failed and we were unable to recover it. 00:30:38.530 [2024-11-28 15:25:38.536988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-28 15:25:38.537175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-28 15:25:38.537361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-28 15:25:38.537598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-28 15:25:38.537852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.537989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-28 15:25:38.538069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.538196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.538224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-28 15:25:38.538350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.531 [2024-11-28 15:25:38.538437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.538463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-28 15:25:38.538586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.538659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.538683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-28 15:25:38.538790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.538902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.538927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-28 15:25:38.539040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-28 15:25:38.539289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-28 15:25:38.539514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-28 15:25:38.539700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.532 [2024-11-28 15:25:38.539787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.539814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.539901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.540154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.540352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.540553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.540736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.540872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.540985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.541068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.533 [2024-11-28 15:25:38.541104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-28 15:25:38.541195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.534 qpair failed and we were unable to recover it. 00:30:38.534 [2024-11-28 15:25:38.541424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.534 qpair failed and we were unable to recover it. 00:30:38.534 [2024-11-28 15:25:38.541645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.534 qpair failed and we were unable to recover it. 00:30:38.534 [2024-11-28 15:25:38.541843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.541977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.542003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.534 qpair failed and we were unable to recover it. 00:30:38.534 [2024-11-28 15:25:38.542110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.542200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.534 [2024-11-28 15:25:38.542226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.534 qpair failed and we were unable to recover it. 00:30:38.535 [2024-11-28 15:25:38.542313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.542427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.542454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.535 qpair failed and we were unable to recover it. 00:30:38.535 [2024-11-28 15:25:38.542538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.542617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.542643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.535 qpair failed and we were unable to recover it. 00:30:38.535 [2024-11-28 15:25:38.542766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.542925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.542958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.535 qpair failed and we were unable to recover it. 00:30:38.535 [2024-11-28 15:25:38.543078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.543208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.543235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.535 qpair failed and we were unable to recover it. 00:30:38.535 [2024-11-28 15:25:38.543356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.543462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.535 [2024-11-28 15:25:38.543487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.535 qpair failed and we were unable to recover it. 00:30:38.536 [2024-11-28 15:25:38.543598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.543673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.543699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.536 qpair failed and we were unable to recover it. 00:30:38.536 [2024-11-28 15:25:38.543813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.543914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.543940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.536 qpair failed and we were unable to recover it. 00:30:38.536 [2024-11-28 15:25:38.544050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.536 qpair failed and we were unable to recover it. 00:30:38.536 [2024-11-28 15:25:38.544302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.536 qpair failed and we were unable to recover it. 00:30:38.536 [2024-11-28 15:25:38.544556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.536 qpair failed and we were unable to recover it. 00:30:38.536 [2024-11-28 15:25:38.544733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.536 [2024-11-28 15:25:38.544802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.544828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.544946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.545185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.545446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.545637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.545853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.545992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.546077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.546195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.546222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.546334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.546442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.546469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.537 [2024-11-28 15:25:38.546552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.546638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.537 [2024-11-28 15:25:38.546664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.537 qpair failed and we were unable to recover it. 00:30:38.538 [2024-11-28 15:25:38.546771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.546855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.546882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.538 qpair failed and we were unable to recover it. 00:30:38.538 [2024-11-28 15:25:38.547000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.547090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.547121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.538 qpair failed and we were unable to recover it. 00:30:38.538 [2024-11-28 15:25:38.547207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.547323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.547348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.538 qpair failed and we were unable to recover it. 00:30:38.538 [2024-11-28 15:25:38.547455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.547596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.538 [2024-11-28 15:25:38.547621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.547741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.547849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.547874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.547952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.548158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.548387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.548568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.548749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.548843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.548932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.549018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.539 [2024-11-28 15:25:38.549044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.539 qpair failed and we were unable to recover it. 00:30:38.539 [2024-11-28 15:25:38.549155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.549341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.549582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.549802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.549910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.550021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.550235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.550434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.540 [2024-11-28 15:25:38.550679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.540 [2024-11-28 15:25:38.550783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.540 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.550891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.551117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.551361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.551547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.551767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.551876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.551963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.552036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.552061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.541 [2024-11-28 15:25:38.552156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.552232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.541 [2024-11-28 15:25:38.552258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.541 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.552334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.552445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.552470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.552577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.552661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.552686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.552778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.552860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.552885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.552969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.553184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.553402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.553625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.553855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.553962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.554056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.554294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.554490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.554734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.554863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.554949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.555183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.555378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.555556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.555801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.555906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.542 qpair failed and we were unable to recover it. 00:30:38.542 [2024-11-28 15:25:38.556044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.556127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.542 [2024-11-28 15:25:38.556153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.556241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.556345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.556378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.556476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.556559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.556588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.556726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.556857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.556887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.557032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.557278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.557470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.557650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.557878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.557981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.558067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.558300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.558576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.558841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.558959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.559078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.559318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.559540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.559761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.559899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.560003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.560215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.560438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.560663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.560862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.560979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.561006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.561117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.561195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.561222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.561295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.561409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.561436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.543 qpair failed and we were unable to recover it. 00:30:38.543 [2024-11-28 15:25:38.561552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.543 [2024-11-28 15:25:38.561635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.561662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.561776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.561887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.561913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.562031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.562273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.562470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.562693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.562809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.562896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.563137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.563346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.563626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.563824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.563988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.544 qpair failed and we were unable to recover it. 00:30:38.544 [2024-11-28 15:25:38.564064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.564204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.544 [2024-11-28 15:25:38.564230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.564315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.564400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.564426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.564538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.564618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.564643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.564725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.564805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.564831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.564948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.565177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.565397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.565631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.565824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.565956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.566030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.566272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.566462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.566679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.566900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.566983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.567098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.567316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.567535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.567729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.567874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.567964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.568104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.568131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.545 [2024-11-28 15:25:38.568241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.568324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.545 [2024-11-28 15:25:38.568349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.545 qpair failed and we were unable to recover it. 00:30:38.546 [2024-11-28 15:25:38.568473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.568589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.568614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.546 qpair failed and we were unable to recover it. 00:30:38.546 [2024-11-28 15:25:38.568697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.568777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.568802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.546 qpair failed and we were unable to recover it. 00:30:38.546 [2024-11-28 15:25:38.568884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.568962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.568987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.546 qpair failed and we were unable to recover it. 00:30:38.546 [2024-11-28 15:25:38.569059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.569141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.546 [2024-11-28 15:25:38.569167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.546 qpair failed and we were unable to recover it. 00:30:38.546 [2024-11-28 15:25:38.569262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.547 qpair failed and we were unable to recover it. 00:30:38.547 [2024-11-28 15:25:38.569484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.547 qpair failed and we were unable to recover it. 00:30:38.547 [2024-11-28 15:25:38.569710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.547 qpair failed and we were unable to recover it. 00:30:38.547 [2024-11-28 15:25:38.569907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.569983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.570009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.547 qpair failed and we were unable to recover it. 00:30:38.547 [2024-11-28 15:25:38.570120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.570214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.570242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.547 qpair failed and we were unable to recover it. 00:30:38.547 [2024-11-28 15:25:38.570328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.570410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.547 [2024-11-28 15:25:38.570437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.547 qpair failed and we were unable to recover it. 00:30:38.548 [2024-11-28 15:25:38.570520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.570634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.570660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.548 qpair failed and we were unable to recover it. 00:30:38.548 [2024-11-28 15:25:38.570747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.570858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.570884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.548 qpair failed and we were unable to recover it. 00:30:38.548 [2024-11-28 15:25:38.570965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.571048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.571074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.548 qpair failed and we were unable to recover it. 00:30:38.548 [2024-11-28 15:25:38.571162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.571252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.571279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.548 qpair failed and we were unable to recover it. 00:30:38.548 [2024-11-28 15:25:38.571388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.548 [2024-11-28 15:25:38.571525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.571550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.549 qpair failed and we were unable to recover it. 00:30:38.549 [2024-11-28 15:25:38.571662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.571774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.571800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.549 qpair failed and we were unable to recover it. 00:30:38.549 [2024-11-28 15:25:38.571940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.549 qpair failed and we were unable to recover it. 00:30:38.549 [2024-11-28 15:25:38.572181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.549 qpair failed and we were unable to recover it. 00:30:38.549 [2024-11-28 15:25:38.572488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.549 qpair failed and we were unable to recover it. 00:30:38.549 [2024-11-28 15:25:38.572712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.549 [2024-11-28 15:25:38.572817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.572844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.550 qpair failed and we were unable to recover it. 00:30:38.550 [2024-11-28 15:25:38.572933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.550 qpair failed and we were unable to recover it. 00:30:38.550 [2024-11-28 15:25:38.573131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.550 qpair failed and we were unable to recover it. 00:30:38.550 [2024-11-28 15:25:38.573366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.550 qpair failed and we were unable to recover it. 00:30:38.550 [2024-11-28 15:25:38.573562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.550 qpair failed and we were unable to recover it. 00:30:38.550 [2024-11-28 15:25:38.573756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.550 [2024-11-28 15:25:38.573876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.573903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.551 qpair failed and we were unable to recover it. 00:30:38.551 [2024-11-28 15:25:38.574008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.551 qpair failed and we were unable to recover it. 00:30:38.551 [2024-11-28 15:25:38.574227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.551 qpair failed and we were unable to recover it. 00:30:38.551 [2024-11-28 15:25:38.574449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.551 qpair failed and we were unable to recover it. 00:30:38.551 [2024-11-28 15:25:38.574651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.551 [2024-11-28 15:25:38.574821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.551 qpair failed and we were unable to recover it. 00:30:38.551 [2024-11-28 15:25:38.574898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.574975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.575115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.575342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.575534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.575806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.575951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.576033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.576139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.576165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.576250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.576360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.576386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.576527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.576613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.552 [2024-11-28 15:25:38.576640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.552 qpair failed and we were unable to recover it. 00:30:38.552 [2024-11-28 15:25:38.576729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.576849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.576876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.576963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.577229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.577434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.577683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.577874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.577982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.578066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.578161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.578189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.553 qpair failed and we were unable to recover it. 00:30:38.553 [2024-11-28 15:25:38.578270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.553 [2024-11-28 15:25:38.578411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.578437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.554 qpair failed and we were unable to recover it. 00:30:38.554 [2024-11-28 15:25:38.578522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.578629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.578655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.554 qpair failed and we were unable to recover it. 00:30:38.554 [2024-11-28 15:25:38.578765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.578850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.578875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.554 qpair failed and we were unable to recover it. 00:30:38.554 [2024-11-28 15:25:38.578989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.554 qpair failed and we were unable to recover it. 00:30:38.554 [2024-11-28 15:25:38.579214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.554 qpair failed and we were unable to recover it. 00:30:38.554 [2024-11-28 15:25:38.579456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.554 qpair failed and we were unable to recover it. 00:30:38.554 [2024-11-28 15:25:38.579682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.554 [2024-11-28 15:25:38.579827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.579922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.580143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.580362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.580606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.580784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.580898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.581016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.581126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.581152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.581240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.581353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.581379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.555 qpair failed and we were unable to recover it. 00:30:38.555 [2024-11-28 15:25:38.581463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.581578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.555 [2024-11-28 15:25:38.581604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.581679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.581754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.581781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.581865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.581950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.581976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.582056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.582288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.582522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.582736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.556 [2024-11-28 15:25:38.582902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.556 qpair failed and we were unable to recover it. 00:30:38.556 [2024-11-28 15:25:38.582986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.557 qpair failed and we were unable to recover it. 00:30:38.557 [2024-11-28 15:25:38.583207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.557 qpair failed and we were unable to recover it. 00:30:38.557 [2024-11-28 15:25:38.583411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.557 qpair failed and we were unable to recover it. 00:30:38.557 [2024-11-28 15:25:38.583690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.583823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.557 qpair failed and we were unable to recover it. 00:30:38.557 [2024-11-28 15:25:38.583968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.584059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.584085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.557 qpair failed and we were unable to recover it. 00:30:38.557 [2024-11-28 15:25:38.584227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.557 [2024-11-28 15:25:38.584310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.584337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.584447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.584519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.584544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.584684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.584763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.584789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.584933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.585203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.585384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.585605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.558 qpair failed and we were unable to recover it. 00:30:38.558 [2024-11-28 15:25:38.585838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.558 [2024-11-28 15:25:38.585912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.585942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.559 qpair failed and we were unable to recover it. 00:30:38.559 [2024-11-28 15:25:38.586026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.559 qpair failed and we were unable to recover it. 00:30:38.559 [2024-11-28 15:25:38.586226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.559 qpair failed and we were unable to recover it. 00:30:38.559 [2024-11-28 15:25:38.586446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.559 qpair failed and we were unable to recover it. 00:30:38.559 [2024-11-28 15:25:38.586670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.559 qpair failed and we were unable to recover it. 00:30:38.559 [2024-11-28 15:25:38.586891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.586980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.559 [2024-11-28 15:25:38.587006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.559 qpair failed and we were unable to recover it. 00:30:38.559 [2024-11-28 15:25:38.587084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.587275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.587561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.587784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.587925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.588038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.588262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.588520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.560 [2024-11-28 15:25:38.588758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.560 [2024-11-28 15:25:38.588856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.560 qpair failed and we were unable to recover it. 00:30:38.561 [2024-11-28 15:25:38.588939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.561 qpair failed and we were unable to recover it. 00:30:38.561 [2024-11-28 15:25:38.589139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.561 qpair failed and we were unable to recover it. 00:30:38.561 [2024-11-28 15:25:38.589321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.561 qpair failed and we were unable to recover it. 00:30:38.561 [2024-11-28 15:25:38.589509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.561 qpair failed and we were unable to recover it. 00:30:38.561 [2024-11-28 15:25:38.589737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.589871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.561 qpair failed and we were unable to recover it. 00:30:38.561 [2024-11-28 15:25:38.589945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.590029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.561 [2024-11-28 15:25:38.590055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.561 qpair failed and we were unable to recover it. 00:30:38.562 [2024-11-28 15:25:38.590173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.562 [2024-11-28 15:25:38.590262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.563 qpair failed and we were unable to recover it. 00:30:38.563 [2024-11-28 15:25:38.590394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.563 qpair failed and we were unable to recover it. 00:30:38.563 [2024-11-28 15:25:38.590644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.563 qpair failed and we were unable to recover it. 00:30:38.563 [2024-11-28 15:25:38.590839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.590959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.563 qpair failed and we were unable to recover it. 00:30:38.563 [2024-11-28 15:25:38.591042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.591152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.591177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.563 qpair failed and we were unable to recover it. 00:30:38.563 [2024-11-28 15:25:38.591288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.591377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.591403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.563 qpair failed and we were unable to recover it. 00:30:38.563 [2024-11-28 15:25:38.591525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.563 [2024-11-28 15:25:38.591611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.591637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.564 qpair failed and we were unable to recover it. 00:30:38.564 [2024-11-28 15:25:38.591743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.591867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.591893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.564 qpair failed and we were unable to recover it. 00:30:38.564 [2024-11-28 15:25:38.592042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.592154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.592180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.564 qpair failed and we were unable to recover it. 00:30:38.564 [2024-11-28 15:25:38.592296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.592408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.564 [2024-11-28 15:25:38.592435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.564 qpair failed and we were unable to recover it. 00:30:38.564 [2024-11-28 15:25:38.592553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.592630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.592660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.565 qpair failed and we were unable to recover it. 00:30:38.565 [2024-11-28 15:25:38.592805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.592887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.592912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.565 qpair failed and we were unable to recover it. 00:30:38.565 [2024-11-28 15:25:38.592995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.565 qpair failed and we were unable to recover it. 00:30:38.565 [2024-11-28 15:25:38.593212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.565 qpair failed and we were unable to recover it. 00:30:38.565 [2024-11-28 15:25:38.593438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.565 qpair failed and we were unable to recover it. 00:30:38.565 [2024-11-28 15:25:38.593652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.565 [2024-11-28 15:25:38.593759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.593784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.566 qpair failed and we were unable to recover it. 00:30:38.566 [2024-11-28 15:25:38.593868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.593989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.566 qpair failed and we were unable to recover it. 00:30:38.566 [2024-11-28 15:25:38.594090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.566 qpair failed and we were unable to recover it. 00:30:38.566 [2024-11-28 15:25:38.594326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.566 qpair failed and we were unable to recover it. 00:30:38.566 [2024-11-28 15:25:38.594515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.566 qpair failed and we were unable to recover it. 00:30:38.566 [2024-11-28 15:25:38.594704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.566 [2024-11-28 15:25:38.594842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.566 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.594923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.595109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.595298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.595522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.595724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.595855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.595940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.596174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.596390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.567 qpair failed and we were unable to recover it. 00:30:38.567 [2024-11-28 15:25:38.596615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.567 [2024-11-28 15:25:38.596727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.568 qpair failed and we were unable to recover it. 00:30:38.568 [2024-11-28 15:25:38.596816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.596958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.596983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.568 qpair failed and we were unable to recover it. 00:30:38.568 [2024-11-28 15:25:38.597129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.568 qpair failed and we were unable to recover it. 00:30:38.568 [2024-11-28 15:25:38.597360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.568 qpair failed and we were unable to recover it. 00:30:38.568 [2024-11-28 15:25:38.597550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.568 qpair failed and we were unable to recover it. 00:30:38.568 [2024-11-28 15:25:38.597779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.568 [2024-11-28 15:25:38.597883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.597992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.598206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.598402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.598598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.598820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.598934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.599043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.599132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.599160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.599242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.599357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.599384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.569 [2024-11-28 15:25:38.599466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.599546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.569 [2024-11-28 15:25:38.599573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.569 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.599651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.599723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.599749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.599829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.599913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.599939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.600054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.600283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.600506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.600773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.600879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.600988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.601268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.601465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.570 [2024-11-28 15:25:38.601689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.570 [2024-11-28 15:25:38.601796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.570 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.601911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.602121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.602308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.602492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.602717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.602855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.602966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.603079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.603111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.603197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.603274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.571 [2024-11-28 15:25:38.603300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.571 qpair failed and we were unable to recover it. 00:30:38.571 [2024-11-28 15:25:38.603380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.603456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.603483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.572 qpair failed and we were unable to recover it. 00:30:38.572 [2024-11-28 15:25:38.603569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.603690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.603717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.572 qpair failed and we were unable to recover it. 00:30:38.572 [2024-11-28 15:25:38.603858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.603939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.603966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.572 qpair failed and we were unable to recover it. 00:30:38.572 [2024-11-28 15:25:38.604078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.604175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.604202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.572 qpair failed and we were unable to recover it. 00:30:38.572 [2024-11-28 15:25:38.604278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.604369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.572 [2024-11-28 15:25:38.604394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.572 qpair failed and we were unable to recover it. 00:30:38.572 [2024-11-28 15:25:38.604472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.604559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.604585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.573 qpair failed and we were unable to recover it. 00:30:38.573 [2024-11-28 15:25:38.604668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.604748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.604774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.573 qpair failed and we were unable to recover it. 00:30:38.573 [2024-11-28 15:25:38.604889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.604965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.604991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.573 qpair failed and we were unable to recover it. 00:30:38.573 [2024-11-28 15:25:38.605070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.605147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.573 [2024-11-28 15:25:38.605173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.574 qpair failed and we were unable to recover it. 00:30:38.574 [2024-11-28 15:25:38.605280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.605398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.605423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.574 qpair failed and we were unable to recover it. 00:30:38.574 [2024-11-28 15:25:38.605566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.605656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.605681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.574 qpair failed and we were unable to recover it. 00:30:38.574 [2024-11-28 15:25:38.605826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.605915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.605940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.574 qpair failed and we were unable to recover it. 00:30:38.574 [2024-11-28 15:25:38.606027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.606140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.606168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.574 qpair failed and we were unable to recover it. 00:30:38.574 [2024-11-28 15:25:38.606313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.606438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.574 [2024-11-28 15:25:38.606463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.574 qpair failed and we were unable to recover it. 00:30:38.575 [2024-11-28 15:25:38.606545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.606704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.606730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.575 qpair failed and we were unable to recover it. 00:30:38.575 [2024-11-28 15:25:38.606809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.606894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.606930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.575 qpair failed and we were unable to recover it. 00:30:38.575 [2024-11-28 15:25:38.607027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.575 qpair failed and we were unable to recover it. 00:30:38.575 [2024-11-28 15:25:38.607253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.575 qpair failed and we were unable to recover it. 00:30:38.575 [2024-11-28 15:25:38.607471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.575 qpair failed and we were unable to recover it. 00:30:38.575 [2024-11-28 15:25:38.607716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.575 [2024-11-28 15:25:38.607797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.607823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.576 qpair failed and we were unable to recover it. 00:30:38.576 [2024-11-28 15:25:38.607911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.608026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.608051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.576 qpair failed and we were unable to recover it. 00:30:38.576 [2024-11-28 15:25:38.608137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.608217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.608244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.576 qpair failed and we were unable to recover it. 00:30:38.576 [2024-11-28 15:25:38.608352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.608467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.576 [2024-11-28 15:25:38.608495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.576 qpair failed and we were unable to recover it. 00:30:38.576 [2024-11-28 15:25:38.608588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.608705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.608731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.608813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.608889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.608915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.609015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.609247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.609475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.609698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.609815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.609933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.610014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.610041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.610127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.610210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.610236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.577 qpair failed and we were unable to recover it. 00:30:38.577 [2024-11-28 15:25:38.610330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.577 [2024-11-28 15:25:38.610436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.610462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.610578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.610651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.610677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.610757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.610843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.610868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.610983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.611258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.611451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.611663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.611775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.611889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.612156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.612344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.578 qpair failed and we were unable to recover it. 00:30:38.578 [2024-11-28 15:25:38.612559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.578 [2024-11-28 15:25:38.612703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.579 qpair failed and we were unable to recover it. 00:30:38.579 [2024-11-28 15:25:38.612820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.579 [2024-11-28 15:25:38.612900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.579 [2024-11-28 15:25:38.612926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.579 qpair failed and we were unable to recover it. 00:30:38.579 [2024-11-28 15:25:38.613038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.579 [2024-11-28 15:25:38.613133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.579 [2024-11-28 15:25:38.613160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.579 qpair failed and we were unable to recover it. 00:30:38.579 [2024-11-28 15:25:38.613250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.579 [2024-11-28 15:25:38.613330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.579 [2024-11-28 15:25:38.613356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.579 qpair failed and we were unable to recover it. 00:30:38.580 [2024-11-28 15:25:38.613466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.613551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.613577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.580 qpair failed and we were unable to recover it. 00:30:38.580 [2024-11-28 15:25:38.613652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.613730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.613755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.580 qpair failed and we were unable to recover it. 00:30:38.580 [2024-11-28 15:25:38.613840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.613930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.613956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.580 qpair failed and we were unable to recover it. 00:30:38.580 [2024-11-28 15:25:38.614036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.614151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.614181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.580 qpair failed and we were unable to recover it. 00:30:38.580 [2024-11-28 15:25:38.614273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.614385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.614411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.580 qpair failed and we were unable to recover it. 00:30:38.580 [2024-11-28 15:25:38.614521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.580 [2024-11-28 15:25:38.614602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.614628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.581 qpair failed and we were unable to recover it. 00:30:38.581 [2024-11-28 15:25:38.614718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.614840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.614867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.581 qpair failed and we were unable to recover it. 00:30:38.581 [2024-11-28 15:25:38.614988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.581 qpair failed and we were unable to recover it. 00:30:38.581 [2024-11-28 15:25:38.615183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.581 qpair failed and we were unable to recover it. 00:30:38.581 [2024-11-28 15:25:38.615421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.581 qpair failed and we were unable to recover it. 00:30:38.581 [2024-11-28 15:25:38.615683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.581 [2024-11-28 15:25:38.615763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.615789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.582 qpair failed and we were unable to recover it. 00:30:38.582 [2024-11-28 15:25:38.615868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.615985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.616011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.582 qpair failed and we were unable to recover it. 00:30:38.582 [2024-11-28 15:25:38.616140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.616260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.616301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.582 qpair failed and we were unable to recover it. 00:30:38.582 [2024-11-28 15:25:38.616477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.616581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.582 [2024-11-28 15:25:38.616619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.582 qpair failed and we were unable to recover it. 00:30:38.582 [2024-11-28 15:25:38.616770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.616931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.616969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.583 [2024-11-28 15:25:38.617139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.583 [2024-11-28 15:25:38.617365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.583 [2024-11-28 15:25:38.617590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.583 [2024-11-28 15:25:38.617779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.617877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.583 [2024-11-28 15:25:38.617997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.618123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.618158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.583 [2024-11-28 15:25:38.618293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.618429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.583 [2024-11-28 15:25:38.618466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.583 qpair failed and we were unable to recover it. 00:30:38.584 [2024-11-28 15:25:38.618563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.584 [2024-11-28 15:25:38.618650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.584 [2024-11-28 15:25:38.618677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.584 qpair failed and we were unable to recover it. 00:30:38.584 [2024-11-28 15:25:38.618787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.618928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.618953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.619079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.619348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.619568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.619765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.619889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.620000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.620108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.620136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.620278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.620358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.620384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.585 qpair failed and we were unable to recover it. 00:30:38.585 [2024-11-28 15:25:38.620461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.585 [2024-11-28 15:25:38.620539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.620565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.620647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.620752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.620778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.620863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.620952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.620978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.621085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.621350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.621576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.621803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.621914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.621993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.622075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.622111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.586 qpair failed and we were unable to recover it. 00:30:38.586 [2024-11-28 15:25:38.622230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.586 [2024-11-28 15:25:38.622308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.587 [2024-11-28 15:25:38.622334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.587 qpair failed and we were unable to recover it. 00:30:38.587 [2024-11-28 15:25:38.622419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.587 [2024-11-28 15:25:38.622533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.587 [2024-11-28 15:25:38.622558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.587 qpair failed and we were unable to recover it. 00:30:38.587 [2024-11-28 15:25:38.622640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.587 [2024-11-28 15:25:38.622756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.587 [2024-11-28 15:25:38.622783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.587 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.622876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.622970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.622995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.623111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.623375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.623574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.623787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.623924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.624000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.624187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.624416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.624602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.624820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.588 [2024-11-28 15:25:38.624935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.588 qpair failed and we were unable to recover it. 00:30:38.588 [2024-11-28 15:25:38.625053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.625287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.625544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.625793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.625898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.626022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.626274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.626481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.626702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.626823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.626942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.627147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.627342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.627560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.627788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.627891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.627982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.628230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.628446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.628639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.628753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.628888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.629112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.629349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.629575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.629862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.629979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.630060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.630313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.630503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.630760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.630896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.631001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.631203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.631390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.631609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.631828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.631965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.632052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.632153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.632179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.589 [2024-11-28 15:25:38.632271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.632410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.589 [2024-11-28 15:25:38.632435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.589 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.632527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.632634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.632661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.632752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.632857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.632884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.632998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.633240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.633485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.633762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.633910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.634019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.634254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.634472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.634697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.634819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.634909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.635111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.635312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.635491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.635687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.635870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.635984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.636091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.636294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.636547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.636767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.636882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.636960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.637173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.637438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.637685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.637845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.637950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.638237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.638459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.638710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.638859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.638958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.639044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.639075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.639177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.639300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.639328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.590 qpair failed and we were unable to recover it. 00:30:38.590 [2024-11-28 15:25:38.639459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.590 [2024-11-28 15:25:38.639588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.639620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.639736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.639852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.639882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.639981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.640226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.640435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.640631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.640867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.640982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.641105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.641331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.641556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.641801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.641911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.642022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.642225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.642417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.642650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.642786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.642929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.643124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.643326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.643560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.643781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.643915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.644007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.644241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.644465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.644662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.644780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.644883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.645001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.645032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.645127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.645227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.645260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.591 qpair failed and we were unable to recover it. 00:30:38.591 [2024-11-28 15:25:38.645359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.591 [2024-11-28 15:25:38.645469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.645496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.645577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.645649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.645674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.645781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.645898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.645924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.645999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.646236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.646454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.646682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.646816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.646961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.647190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.647406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.647696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.647889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.647997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.648023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.648102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.648184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.648211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.594 qpair failed and we were unable to recover it. 00:30:38.594 [2024-11-28 15:25:38.648325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.648437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.594 [2024-11-28 15:25:38.648463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.648571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.648658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.648684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.648801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.648914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.648941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.649054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.649261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.649491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.649754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.649888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.649982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.650224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.650439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.650713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.650919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.650997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.651113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.651350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.651538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.651810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.651934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.652028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.652281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.652508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.652724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.652866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.652981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.653208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.653427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.653628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.653773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.653918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.654171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.654395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.654618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.654843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.654952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.655037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.655308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.655518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.655752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.655852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.655932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.656146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.656403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.656713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.656881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.656979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.657231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.657491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.595 qpair failed and we were unable to recover it. 00:30:38.595 [2024-11-28 15:25:38.657698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.595 [2024-11-28 15:25:38.657819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.657846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.657941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.658174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.658436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.658718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.658863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.658980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.659277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.659530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.659793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.659902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.660000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.660301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.660550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.660801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.660921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.661037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.661253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.661457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.661725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.661865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.661973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.662236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.662424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.662636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.662851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.662999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.663115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.663391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.663593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.663796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.663941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.664032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.664252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.664469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.664722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.664831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.664941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.665154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.665411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.665630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.665849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.665953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.666038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.666250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.666477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.666725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.666824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.666935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.667183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.667416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.667644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.667884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.667991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.668075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.668287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.668546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.668750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.668882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.668962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.669205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.669419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.669642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.669870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.669977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.670118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.670224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.670251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.670362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.670446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.670472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.596 qpair failed and we were unable to recover it. 00:30:38.596 [2024-11-28 15:25:38.670594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.596 [2024-11-28 15:25:38.670706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.670733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.670852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.670960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.670987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.671073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.671344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.671588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.671812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.671944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.672016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.672251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.672429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.672678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.672813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.672929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.673142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.673400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.673607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.673851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.673954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.674035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.674287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.674506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.674761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.674873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.674981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.675176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.675423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.675649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.675788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.675897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.676210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.676455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.676653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.676879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.676990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.677075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.677286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.677542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.677766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.677879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.677983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.678242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.678430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.678605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.678818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.678923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.679018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.679271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.679484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.679698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.679842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.679957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.680157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.680411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.680657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.680834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.680975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.681088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.681279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.681456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.681699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.681801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.681924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.682058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.682084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.597 [2024-11-28 15:25:38.682206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.682291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.597 [2024-11-28 15:25:38.682322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.597 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.682466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.682551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.682577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.682660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.682739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.682765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.682886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.683177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.683422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.683681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.683785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.683926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.684244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.684429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.684721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.684836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.684927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.685221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.685409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.685628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.685868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.685978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.686128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.686351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.686615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.686841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.686974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.687089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.687358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.687576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.687804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.687945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.688055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.688285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.688533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.688717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.688880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.689021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.689278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.689509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.689725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.689862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.689973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.690188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.690380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.690676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.690864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.690973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.691090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.691313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.691525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.691730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.691873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.691968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.692314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.692570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.692802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.692916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.693033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.693261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.693480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.693725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.693912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.693992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.694159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.694374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.694658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.694890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.694978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.695005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.695125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.695216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.695242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.598 [2024-11-28 15:25:38.695329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.695415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.598 [2024-11-28 15:25:38.695442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.598 qpair failed and we were unable to recover it. 00:30:38.599 [2024-11-28 15:25:38.695530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.599 [2024-11-28 15:25:38.695642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.599 [2024-11-28 15:25:38.695668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.599 qpair failed and we were unable to recover it. 00:30:38.599 [2024-11-28 15:25:38.695755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.599 [2024-11-28 15:25:38.695870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.599 [2024-11-28 15:25:38.695897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.599 qpair failed and we were unable to recover it. 00:30:38.599 [2024-11-28 15:25:38.696013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.696282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.696467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.696689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.696904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.696982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.697085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.697282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.697477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.697671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.697854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.697994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.698112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.698316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.698600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.698791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.698899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.698982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.699200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.699390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.699640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.699886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.699994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.700076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.700284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.700504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.700689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.700818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.700912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.701106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.701404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.701624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.895 [2024-11-28 15:25:38.701731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.895 qpair failed and we were unable to recover it. 00:30:38.895 [2024-11-28 15:25:38.701809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.701893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.701919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.702012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.702257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.702440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.702621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.702805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.702936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.703012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.703260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.703537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.703730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.703894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.704011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.704219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.704443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.704661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.704811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.704916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.705176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.705437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.705721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.705818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.705965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.706197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.706431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.706674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.706893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.706974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.707137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.707335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.707579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.707817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.707923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.708003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.708140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.708167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.896 [2024-11-28 15:25:38.708247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.708359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.896 [2024-11-28 15:25:38.708385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.896 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.708459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.708564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.708589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.708706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.708814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.708840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.708946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.709192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.709416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.709651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.709878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.709979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.710122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.710324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.710509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.710733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.710832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.710947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.711220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.711440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.711680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.711850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.711934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.712157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.712340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.712598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.712760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.712888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.713123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.713363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.713616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.713750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.713866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.714162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.714401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.714611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.714865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.714995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.897 [2024-11-28 15:25:38.715115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.715237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.897 [2024-11-28 15:25:38.715263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.897 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.715371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.715444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.715470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.715583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.715690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.715716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.715836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.715911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.715937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.716008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.716230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.716487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.716714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.716848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.716930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.717209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.717380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.717600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.717819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.717929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.718042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.718326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.718549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.718791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.718923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.718999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.719227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.719476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.719694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.719802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.719945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.720186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.720418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.720633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.720852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.720960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.721066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.721276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.721519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.898 [2024-11-28 15:25:38.721718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.898 [2024-11-28 15:25:38.721852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.898 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.721933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.722143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.722332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.722554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.722825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.722937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.723049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.723275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.723525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.723757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.723898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.724012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.724227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.724445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.724678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.724794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.724887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.725117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.725310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.725489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.725729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.725869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.725948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.726211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.726471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.726665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.726831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.726919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.727062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.727087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.727222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.727374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.727402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.899 [2024-11-28 15:25:38.727497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.727578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.899 [2024-11-28 15:25:38.727604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.899 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.727694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.727773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.727799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.727939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.728206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.728430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.728632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.728884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.728995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.729139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.729352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.729631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.729865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.729980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.730062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.730293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.730527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.730704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.730890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.730996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.731089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.731347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.731583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.731828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.731976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.732106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.732331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.732523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.732808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.732912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.732996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.733255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.733441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.733646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.733853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.733957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.900 [2024-11-28 15:25:38.734048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.734160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.900 [2024-11-28 15:25:38.734186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.900 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.734273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.734351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.734377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.734463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.734576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.734602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.734682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.734762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.734790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.734897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.735127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.735367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.735583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.735836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.735971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.736082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.736283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.736476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.736697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.736800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.736916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.737169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.737415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.737599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.737799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.737966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.738040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.738240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.738490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.738725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.738838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.738917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.739148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.739399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.739617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.739803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.739936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.740049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.740147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.740174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.740256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.740343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.740369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.901 [2024-11-28 15:25:38.740486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.740606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.901 [2024-11-28 15:25:38.740632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.901 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.740720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.740809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.740834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.740915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.741188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.741394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.741617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.741817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.741922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.742010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.742276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.742519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.742742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.742878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.742992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.743219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.743462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.743668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.743877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.743985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.744082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.744336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.744542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.744762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.744902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.744981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.745247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.745469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.745662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.745795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.745877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.746127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.746375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.746602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.746843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.746943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.902 [2024-11-28 15:25:38.747057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.747172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.902 [2024-11-28 15:25:38.747199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.902 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.747288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.747497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.747685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.747910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.747999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.748102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.748323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.748565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.748773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.748879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.748985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.749181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.749401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.749655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.749910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.749989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.750131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.750357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.750580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.750827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.750958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.751038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.751230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.751452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.751647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.751870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.751978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.752085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.752311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.752546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.752807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.752926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.753017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.753107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.753134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.753225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.753336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.903 [2024-11-28 15:25:38.753362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.903 qpair failed and we were unable to recover it. 00:30:38.903 [2024-11-28 15:25:38.753472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.753542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.753568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.753657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.753734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.753760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.753845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.753919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.753945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.754065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.754297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.754543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.754740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.754873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.754984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.755207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.755438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.755657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.755855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.755962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.756044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.756271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.756503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.756752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.756855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.756942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.757180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.757385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.757628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.757878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.757986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.758060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.758327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.758521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.758743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.758857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.758963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.759107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.904 [2024-11-28 15:25:38.759134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.904 qpair failed and we were unable to recover it. 00:30:38.904 [2024-11-28 15:25:38.759227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.759441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.759689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.759914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.759996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.760114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.760340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.760619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.760752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.760860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.761141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.761371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.761593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.761795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.761906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.762023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.762248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.762465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.762686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.762824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.762914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.763122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.763350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.763557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.763802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.763912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.764005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.764239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.764433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.764637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.764852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.764988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.765061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.765174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.765200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.765288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.765361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.765391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.765506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.765595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.905 [2024-11-28 15:25:38.765621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.905 qpair failed and we were unable to recover it. 00:30:38.905 [2024-11-28 15:25:38.765732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.765848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.765874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.765957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.766208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.766423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.766696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.766804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.766922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.767140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.767342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.767591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.767785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.767922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.768012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.768204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.768397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.768593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.768789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.768885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.768966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.769221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.769456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.769644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.769860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.769990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.770091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.770399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.770587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.770795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.770934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.771024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.771310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.771564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.771777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.771886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.771994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.772101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.906 [2024-11-28 15:25:38.772128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.906 qpair failed and we were unable to recover it. 00:30:38.906 [2024-11-28 15:25:38.772222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.772303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.772329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.772422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.772540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.772566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.772649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.772785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.772811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.772901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.773127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.773352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.773551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.773780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.773889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.773978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.774245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.774439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.774692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.774875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.774983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.775089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.775305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.775512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.775698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.775799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.775937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.776123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.776344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.776562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.776758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.776872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.777012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.777238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.777457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.777733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.777841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.777925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.778006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.778031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.778111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.778252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.778277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.778388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.778497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.907 [2024-11-28 15:25:38.778523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.907 qpair failed and we were unable to recover it. 00:30:38.907 [2024-11-28 15:25:38.778601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.778679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.778705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.778792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.778878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.778907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.778987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.779182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.779393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.779577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.779783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.779890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.779994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.780218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.780404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.780611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.780854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.780962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.781041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.781247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.781490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.781675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.781806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.781949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.782173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.782380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.782586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.782822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.782954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.783035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.783255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.783427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.783665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.783795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.783908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.784015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.908 [2024-11-28 15:25:38.784040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.908 qpair failed and we were unable to recover it. 00:30:38.908 [2024-11-28 15:25:38.784128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.784369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.784593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.784799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.784932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.785039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.785267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.785508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.785745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.785852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.785958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.786187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.786400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.786640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.786882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.786986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.787088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.787306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.787551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.787827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.787939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.788023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.788280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.788530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.788842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.788979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.789087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.789338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.789528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.789742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.789879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.789992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.790190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.790382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.790631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.909 [2024-11-28 15:25:38.790734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.909 qpair failed and we were unable to recover it. 00:30:38.909 [2024-11-28 15:25:38.790817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.790909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.790934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.791041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.791297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.791524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.791738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.791875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.792012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.792218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.792408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.792593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.792826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.792962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.793068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.793259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.793453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.793658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.793871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.793975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.794086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.794359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.794575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.794823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.794924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.795039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.795245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.795477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.795729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.795863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.795984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.796231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.796479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.796749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.796846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.796925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.797035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.797062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.910 [2024-11-28 15:25:38.797155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.797231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.910 [2024-11-28 15:25:38.797256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.910 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.797362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.797439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.797465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.797540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.797648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.797674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.797798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.797905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.797931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.798018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.798243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.798500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.798710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.798843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.798960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.799208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.799439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.799636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.799856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.799988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.800104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.800312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.800562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.800838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.800944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.801063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.801276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.801530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.801755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.801890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.801967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.802237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.802474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.802699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.802838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.802928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.803183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.803445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.803673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.803787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.911 [2024-11-28 15:25:38.803912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.804026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.911 [2024-11-28 15:25:38.804052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.911 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.804178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.804422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.804726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.804911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.804985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.805091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.805310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.805530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.805741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.805873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.805970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.806212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.806455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.806698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.806837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.806933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.807219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.807460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.807657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.807808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.807916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.808146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.808403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.808664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.808893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.808990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.809075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.809270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.809297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.809413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.809526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.809552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.809637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.809823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.809849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.809961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.810364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.810612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.810817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.810969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.811077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.811219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.912 [2024-11-28 15:25:38.811246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.912 qpair failed and we were unable to recover it. 00:30:38.912 [2024-11-28 15:25:38.811387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.811526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.811552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.811626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.811736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.811761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.811869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.811950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.811976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.812065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.812325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.812609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.812818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.812972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.813077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.813338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.813599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.813827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.813956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.814029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.814270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.814482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.814685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.814854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.814941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.815198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.815456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.815706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.815846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.815958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.816197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.816476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.816700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.816841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.816956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.817063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.817089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.817186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.817296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.913 [2024-11-28 15:25:38.817322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.913 qpair failed and we were unable to recover it. 00:30:38.913 [2024-11-28 15:25:38.817428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.817536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.817562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.817667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.817749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.817775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.817888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.817998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.818105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.818343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.818590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.818816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.818982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.819057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.819264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.819517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.819761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.819900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.819988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.820257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.820529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.820779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.820912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.821013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.821257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.821482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.821742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.821877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.821958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.822073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.822106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.822296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.822412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.822438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.822556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.822742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.822769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.822999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.823240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.823473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.823697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.823835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.823930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.824067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.824097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.824219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.824327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.824353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.914 qpair failed and we were unable to recover it. 00:30:38.914 [2024-11-28 15:25:38.824490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.914 [2024-11-28 15:25:38.824607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.824634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.824719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.824804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.824831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.824957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.825186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.825433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.825618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.825837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.825973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.826060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.826301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.826496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.826719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.826885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.827032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.827264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.827451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.827664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.827909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.827982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.828156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.828430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.828623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.828836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.828966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.829054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.829322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.829512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.829731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.829893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.829972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.830191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.830467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.830659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.830873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.830987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.915 qpair failed and we were unable to recover it. 00:30:38.915 [2024-11-28 15:25:38.831062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.915 [2024-11-28 15:25:38.831197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.831310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.831558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.831804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.831934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.832005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.832221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.832472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.832688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.832855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.832935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.833138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.833377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.833604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.833799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.833943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.834040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.834277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.834521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.834746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.834857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.834944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.835176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.835350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.835688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.835835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.835948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.836228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.836485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.836706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.836804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.836893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.837192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.837443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.837655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.916 qpair failed and we were unable to recover it. 00:30:38.916 [2024-11-28 15:25:38.837901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.916 [2024-11-28 15:25:38.837988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.838141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.838359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.838581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.838788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.838897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.838977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.839209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.839464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.839690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.839823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.839936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.840198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.840481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.840734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.840837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.840909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.841155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.841375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.841569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.841754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.841861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.841969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.842202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.842393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.842567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.842789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.842894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.843003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.843260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.843473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.917 qpair failed and we were unable to recover it. 00:30:38.917 [2024-11-28 15:25:38.843660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.917 [2024-11-28 15:25:38.843737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.843765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.843875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.843953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.843980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.844106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.844352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.844543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.844778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.844913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.845030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.845257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.845465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.845692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.845908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.845987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.846120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.846324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.846543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.846773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.846872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.846957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.847155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.847332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.847552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.847741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.847847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.847967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.848196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.848413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.848646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.848862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.848994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.849068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.849291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.849570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.918 [2024-11-28 15:25:38.849807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.918 [2024-11-28 15:25:38.849973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.918 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.850055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.850268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.850445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.850689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.850897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.850990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.851104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.851211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.851238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.851361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.851502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.851529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.851658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.851814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.851841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.851952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.852203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.852478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.852730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.852841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.853025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.853279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.853511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.853748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.853857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.853971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.854207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.854470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.854730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.854872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.854999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.855279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.855525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.855855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.855982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.856098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.856349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.856631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.856837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.856934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.919 qpair failed and we were unable to recover it. 00:30:38.919 [2024-11-28 15:25:38.857054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.857138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.919 [2024-11-28 15:25:38.857166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.857324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.857425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.857455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.857537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.857619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.857647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.857732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.857841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.857868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.858008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.858286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.858544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.858815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.858947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.859061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.859297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.859563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.859810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.859989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.860102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.860344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.860569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.860779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.860932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.861053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.861277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.861469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.861661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.861803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.861911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.862146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.862374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.862599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.862846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.862989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.863120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.863348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.863572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.863846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.863988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.920 qpair failed and we were unable to recover it. 00:30:38.920 [2024-11-28 15:25:38.864086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.920 [2024-11-28 15:25:38.864169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.864280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.864532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.864748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.864888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.864972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.865222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.865477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.865761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.865901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.866012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.866236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.866444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.866641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.866781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.866890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.867124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.867408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.867596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.867811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.867996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.868115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.868369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.868576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.868825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.868939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.869021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.869270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.869492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.869712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.869857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.869934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.870198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.870388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.870636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.921 [2024-11-28 15:25:38.870734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.921 qpair failed and we were unable to recover it. 00:30:38.921 [2024-11-28 15:25:38.870843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.870959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.870986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.871120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.871372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.871623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.871808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.871916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.872030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.872295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.872496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.872754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.872884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.872995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.873232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.873462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.873688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.873833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.873914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.874170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.874397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.874653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.874796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.874889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.875120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.875379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.875641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.875763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.875904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.876190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.876478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.876710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.876840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.922 [2024-11-28 15:25:38.876924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.877017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.922 [2024-11-28 15:25:38.877043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.922 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.877166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.877378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.877557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.877820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.877957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.878044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.878259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.878478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.878704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.878842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.878957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.879191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.879476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.879704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.879873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.879983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.880212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.880523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.880732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.880885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.880997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.881244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.881476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.881788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.881955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.882040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.882322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.882544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.882790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.882922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.883031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.883283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.883498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.883686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.923 [2024-11-28 15:25:38.883789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.923 qpair failed and we were unable to recover it. 00:30:38.923 [2024-11-28 15:25:38.883870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.883960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.883988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.884064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.884285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.884526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.884748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.884859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.884942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.885229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.885449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.885655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.885826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.885991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.886080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.886376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.886577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.886799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.886910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.887053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.887299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.887540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.887787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.887889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.887994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.888216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.888484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.888718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.888887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.889029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.889275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.889505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.889762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.889866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.889984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.890066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.890099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.890187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.890273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.890300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.924 [2024-11-28 15:25:38.890409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.890491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.924 [2024-11-28 15:25:38.890519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.924 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.890627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.890747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.890774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.890927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.891192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.891381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.891640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.891850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.891958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.892066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.892327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.892570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.892818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.892965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.893080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.893364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.893598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.893839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.893977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.894116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.894364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.894576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.894821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.894968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.895082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.895323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.895596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.895860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.895978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.896085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.896337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.896554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.896799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.896931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.897013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.897121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.897147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.897258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.897375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.897402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.925 [2024-11-28 15:25:38.897487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.897598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.925 [2024-11-28 15:25:38.897625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.925 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.897705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.897793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.897822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.897907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.898176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.898398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.898634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.898871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.898980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.899085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.899336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.899610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.899887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.899993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.900106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.900354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.900652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.900891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.900997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.901077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.901292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.901512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.901775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.901908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.901983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.902226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.902431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.902674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.902845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.903007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.903212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.903459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.926 [2024-11-28 15:25:38.903647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.926 [2024-11-28 15:25:38.903817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.926 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.903893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.904153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.904339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.904569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.904849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.904988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.905068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.905205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.905250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.905378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.905576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.905625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.905765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.905875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.905901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.906009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.906241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.906432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.906683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.906791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.906930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.907149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.907386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.907657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.907815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.907924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.908287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.908517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.908757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.908893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.909007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.909230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.909472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.909715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.909823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.909936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.910140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.910369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.910572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.927 qpair failed and we were unable to recover it. 00:30:38.927 [2024-11-28 15:25:38.910814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.927 [2024-11-28 15:25:38.910926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.910954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.911071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.911319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.911499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.911739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.911903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.912022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.912113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.912141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.912222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.912295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.912320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.912402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.912524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.912550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.912628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.913482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.913523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.913652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.913790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.913816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.913929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.914238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.914489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.914740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.914872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.914968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.915189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.915428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.915673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.915813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.915929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.916154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.916387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.916614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.916813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.916950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.917058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.917325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.917549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.917766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.917872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.917985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.918100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.918127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.918207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.918316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.918342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.928 qpair failed and we were unable to recover it. 00:30:38.928 [2024-11-28 15:25:38.918428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.928 [2024-11-28 15:25:38.918533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.918558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.918681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.918787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.918812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.918911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.918991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.919105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.919383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.919605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.919840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.919976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.920116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.920335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.920520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.920751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.920857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.920974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.921179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.921435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.921656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.921910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.921990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.922164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.922355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.922607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.922858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.922993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.923079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.923316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.923546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.923734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.923862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.923979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.924249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.924476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.924682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.929 [2024-11-28 15:25:38.924825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.929 qpair failed and we were unable to recover it. 00:30:38.929 [2024-11-28 15:25:38.924938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.925181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.925419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.925733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.925871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.925951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.926188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.926418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.926642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.926859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.926990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.927075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.927358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.927572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.927800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.927906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.928016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.928268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.928516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.928735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.928896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.928970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.929230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.929486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.929658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.929886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.929996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.930145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.930369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.930610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.930856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.930993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.931019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.931105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.931229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.930 [2024-11-28 15:25:38.931273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.930 qpair failed and we were unable to recover it. 00:30:38.930 [2024-11-28 15:25:38.931365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.931441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.931466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.931612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.931697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.931722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.931830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.931936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.931962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.932046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.932234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.932470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.932687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.932826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.932965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.933185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.933379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.933585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.933836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.933983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.934131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.934312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.934545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.934794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.934948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.935057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.935302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.935546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.935824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.935962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.936089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.936328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.936548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.936757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.936859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.936973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.937055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.937081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.931 qpair failed and we were unable to recover it. 00:30:38.931 [2024-11-28 15:25:38.937207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.931 [2024-11-28 15:25:38.937292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.937318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.937448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.937579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.937609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.937764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.937886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.937915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.938010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.938299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.938553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.938782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.938924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.939018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.939125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.939151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.939285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.939456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.939485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.939602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.939723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.939752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.939906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.940147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.940326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.940564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.940841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.940979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.941114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.941383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.941601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.941849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.941984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.942105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.942184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.942210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.942294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.942426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.942455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.942575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.942694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.942724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.942917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.943214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.943439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.943703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.943865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.943984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.944075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.944123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.944236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.944339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.944364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.944514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.944596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.932 [2024-11-28 15:25:38.944621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.932 qpair failed and we were unable to recover it. 00:30:38.932 [2024-11-28 15:25:38.944764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.944854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.944882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.944962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.945228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.945419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.945663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.945807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.945917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.946196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.946453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.946703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.946893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.947009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.947288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.947542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.947828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.947975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.948063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.948265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.948562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.948816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.948963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.949104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.949358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.949593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.933 qpair failed and we were unable to recover it. 00:30:38.933 [2024-11-28 15:25:38.949896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.933 [2024-11-28 15:25:38.949982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.950178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.950401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.950681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.950830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.950985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.951275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.951493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.951783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.951960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.952077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.952337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.952594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.952815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.952966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.953070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.953269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.953439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.953720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.953862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.953979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.954265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.954572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.954841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.954993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.934 [2024-11-28 15:25:38.955082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.955228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.934 [2024-11-28 15:25:38.955255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.934 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.955412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.955532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.955557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.955673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.955782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.955808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.955887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.955970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.955995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.956106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.956305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.956530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.956769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.956907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.956983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.957252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.957541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.957790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.957936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.958046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.958178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.958204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.958315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.958426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.958451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.958619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.958735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.958763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.958921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.959226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.959540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.959779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.959891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.960005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.960306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.960596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.960840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.960942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.961028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.961249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.961508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.935 [2024-11-28 15:25:38.961714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.935 [2024-11-28 15:25:38.961847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.935 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.962007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.962291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.962483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.962750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.962862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.962997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.963244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.963490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.963687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.963801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.963889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.964206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.964426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.964647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.964818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.964934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.965160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.965331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.965552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.965807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.965952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.966043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.966339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.966571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.966800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.966899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.967039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.967303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.967543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.967753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.967882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.936 qpair failed and we were unable to recover it. 00:30:38.936 [2024-11-28 15:25:38.967999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.936 [2024-11-28 15:25:38.968082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.968243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.968553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.968769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.968872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.968945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.969240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.969433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.969691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.969843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.969921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.970133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.970404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.970676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.970802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.970930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.971209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.971460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.971714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.971829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.971927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.972195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.972466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.972686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.972840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.972990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.973339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.973548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.973849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.973987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.974176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.974425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.974691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.974905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.974986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.975011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.975158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.975261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.937 [2024-11-28 15:25:38.975288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.937 qpair failed and we were unable to recover it. 00:30:38.937 [2024-11-28 15:25:38.975367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.975489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.975516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.975649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.975761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.975786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.975907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.976165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.976386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.976623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.976869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.976973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.977079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.977268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.977493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.977756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.977888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.977996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.978210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.978427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.978648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.978890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.978997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.979162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.979355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.979592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.979799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.979926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.980006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.980233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.980430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.980641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.980780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.980900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.981152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.981380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.981591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.981820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.981920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.981997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.982074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.982104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.938 qpair failed and we were unable to recover it. 00:30:38.938 [2024-11-28 15:25:38.982207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.938 [2024-11-28 15:25:38.982341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.982369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.982464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.982572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.982597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.982691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.982773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.982798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.982875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.982990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.983098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.983343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.983535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.983724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.983848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.983960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.984158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.984343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.984529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.984732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.984946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.985133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.985271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.985296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.985390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.985503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.985528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.985619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.985806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.985831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.986017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.986210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.986412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.986709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.986918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.986988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.987127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.987338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.987617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.987835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.987985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.988077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.988373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.988611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.988869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.988979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.989066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.989189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.989214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.989289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.989401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.989427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.939 [2024-11-28 15:25:38.989510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.989625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.939 [2024-11-28 15:25:38.989649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.939 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.989758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.989848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.989874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.989980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.990201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.990392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.990620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.990796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.990902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.991008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.991229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.991460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.991669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.991886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.991991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.992107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.992329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.992538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.992805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.992900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.992986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.993239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.993448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.993627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.993845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.993953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.994065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.994323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.994574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.994759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.994867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.994979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.995233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.995441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.995632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.995842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.995973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.940 qpair failed and we were unable to recover it. 00:30:38.940 [2024-11-28 15:25:38.996106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.996202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.940 [2024-11-28 15:25:38.996227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.996310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.996393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.996417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.996505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.996590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.996615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.996704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.996798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.996822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.996904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.997140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.997340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.997544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.997749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.997905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.998003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.998208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.998432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.998696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.998819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.998913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.999149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.999385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.999629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.999812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:38.999907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:38.999981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:39.000056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:39.000080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:39.000176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:39.000256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:39.000282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:39.000381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:39.000463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.941 [2024-11-28 15:25:39.000488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.941 qpair failed and we were unable to recover it. 00:30:38.941 [2024-11-28 15:25:39.000569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.000643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.000668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.000783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.000875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.000900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.001017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.001223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.001435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.001689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.001903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.001982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.002126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.002340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.002523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.002740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.002842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.002930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.003165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.003418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.003635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.003850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.003978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.004085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.004296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.004497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.004674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.004895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.004995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.005105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.005303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.005546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.005757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.005901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.006012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.006257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.006468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.942 qpair failed and we were unable to recover it. 00:30:38.942 [2024-11-28 15:25:39.006711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.942 [2024-11-28 15:25:39.006803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.006918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.007175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.007386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.007577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.007768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.007872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.007959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.008138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.008334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.008553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.008747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.008852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.008957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.009162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.009387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.009611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.009793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.009895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.010010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.010195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.010402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.010621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.010804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.010937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.011043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.011245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.011454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.011702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.011889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.011994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.012132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.012380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.012606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.943 [2024-11-28 15:25:39.012801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.943 [2024-11-28 15:25:39.012939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.943 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.013022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.013200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.013395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.013591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.013808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.013948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.014039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.014298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.014511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.014724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.014832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.014909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.015120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.015344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.015594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.015806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.015932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.016015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.016265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.016494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.016698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.016815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.016957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.017145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.017330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.017544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.017760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.017912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.018037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.018261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.018471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.018680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.018780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.018892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.019033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.019057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.944 [2024-11-28 15:25:39.019158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.019229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.944 [2024-11-28 15:25:39.019254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.944 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.019362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.019466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.019490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.019638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.019729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.019754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.019835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.019948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.019973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.020060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.020281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.020543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.020735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.020848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.020959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.021173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.021397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.021601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.021817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.021952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.022025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.022210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.022427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.022646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.022865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.022977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.023081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.023311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.023504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.023699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.023809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.023922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.024172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.024400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.945 qpair failed and we were unable to recover it. 00:30:38.945 [2024-11-28 15:25:39.024647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.945 [2024-11-28 15:25:39.024749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.024856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.024937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.024962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.025045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.025290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.025481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.025764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.025881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.025965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.026168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.026380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.026588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.026819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.026947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.027029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.027233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.027516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.027717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.027883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.028039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.028220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.028418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.028637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.028825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.028954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.029066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.029323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.029527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.029708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.029852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.029956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.030184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.030399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.030578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.030789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.030899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.946 qpair failed and we were unable to recover it. 00:30:38.946 [2024-11-28 15:25:39.031044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.031130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.946 [2024-11-28 15:25:39.031154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.031234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.031441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.031637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.031892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.031997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.032085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.032337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.032532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.032709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.032843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.032919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.033222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.033411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.033663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.033851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.033953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.034076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.034311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.034563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.034786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.034921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.035002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.035199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.035416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.035596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.035766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.035902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.036107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.036317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.036566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.036761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.036869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.036965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.037074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.037105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.037195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.037279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.037303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.947 [2024-11-28 15:25:39.037419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.037500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.947 [2024-11-28 15:25:39.037525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.947 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.037609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.037722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.037748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.037860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.037972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.037997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.038126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.038376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.038594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.038848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.038984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.039101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.039293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.039508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.039723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.039830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.039917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.040169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.040345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.040564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.040746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.040853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.040966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.041187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.041394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.041683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.041865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.041975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.042082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.042298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.042486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.042727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.042823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.042903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.043128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.043335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.043546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.043785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.948 [2024-11-28 15:25:39.043893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.948 qpair failed and we were unable to recover it. 00:30:38.948 [2024-11-28 15:25:39.044000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.044227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.044435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.044626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.044870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.044969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.045069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.045294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.045510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.045726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.045858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.045938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.046140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.046359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.046577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.046758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.046866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.046950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.047132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.047333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.047577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.047784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.047888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.047979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.048204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.048411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.048661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.048891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.048997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.049076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.049314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.049526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.049767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.049877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.049969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.050057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.949 [2024-11-28 15:25:39.050082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.949 qpair failed and we were unable to recover it. 00:30:38.949 [2024-11-28 15:25:39.050217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.050353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.050377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.050463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.050598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.050623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.050735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.050820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.050845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.050981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.051198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.051396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.051608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.051825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.051963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.052049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.052260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.052433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.052711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.052837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.052948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.053145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.053367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.053556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.053799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.053906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.053992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.054258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.054448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.054625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.054844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.054943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.055020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.055217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.055436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.055606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.950 [2024-11-28 15:25:39.055740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.950 qpair failed and we were unable to recover it. 00:30:38.950 [2024-11-28 15:25:39.055811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.055888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.055912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.055993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.056251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.056461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.056645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.056868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.056972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.057057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.057298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.057528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.057721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.057910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.057989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.058105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.058324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.058518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.058756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.058884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.058997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.059205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.059427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.059706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.059807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.059915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.060198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.060439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.060651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.060840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.060942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.061023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.061281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.061499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.061703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.061891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.951 [2024-11-28 15:25:39.061996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.951 qpair failed and we were unable to recover it. 00:30:38.951 [2024-11-28 15:25:39.062087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.062319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.062563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.062781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.062894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.062979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.063209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.063453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.063618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.063816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.063918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.064064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.064332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.064523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.064756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.064892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.065010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.065223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.065469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.065693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.065802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.065940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.066179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.066378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.066649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.066846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.066962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.067051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.067301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.067496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.067697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.067808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.067915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.068134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.068328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.952 qpair failed and we were unable to recover it. 00:30:38.952 [2024-11-28 15:25:39.068548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.952 [2024-11-28 15:25:39.068654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.068678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.068797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.068873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.068897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.068981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.069222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.069477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.069675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.069883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.069995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.070145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.070364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.070598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.070782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.070914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.070995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.071242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.071459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.071679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.071873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.071985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.072108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.072290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.072548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.072778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.072879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.072987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.073222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.073443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.073652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.073867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.073985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.074084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.074291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.074479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.074702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.074811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.953 qpair failed and we were unable to recover it. 00:30:38.953 [2024-11-28 15:25:39.074889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.953 [2024-11-28 15:25:39.075002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.075104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.075298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.075551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.075806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.075934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.076068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.076296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.076494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.076760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.076869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.076955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.077160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.077370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.077581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.077793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.077903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.078018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.078255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.078448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.078704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.078812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.078914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.079122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.079329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.079535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.079728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.079843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.079926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.080121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.080342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.954 [2024-11-28 15:25:39.080567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.954 [2024-11-28 15:25:39.080663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.954 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.080740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.080815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.080840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.080927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.081185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.081445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.081663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.081770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.081861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.082116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.082319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.082519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.082723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.082837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.082945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.083199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.083391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.083588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.083779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.083914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.084054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.084276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.084499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.084713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.084825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.084897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.085123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.085357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.085601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.085867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.085970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.086120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.086357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.086554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.086735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.086880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.955 qpair failed and we were unable to recover it. 00:30:38.955 [2024-11-28 15:25:39.086993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.955 [2024-11-28 15:25:39.087082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.087208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.087444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.087670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.087883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.087986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.088070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.088278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.088479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.088711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.088881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.088998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.089086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.089120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.089218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.089306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.089332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:38.956 [2024-11-28 15:25:39.089439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.089520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:38.956 [2024-11-28 15:25:39.089546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:38.956 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.089635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.089717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.089748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.089845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.089944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.089970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.090050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.090268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.090473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.090726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.090846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.090975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.091243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.091444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.091631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.091864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.091988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.092071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.092309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.092500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.092718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.092899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.092981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.093091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.093295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.093494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.093695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.093895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.093985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.094112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.094345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.094559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.253 qpair failed and we were unable to recover it. 00:30:39.253 [2024-11-28 15:25:39.094775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.253 [2024-11-28 15:25:39.094881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.094958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.095220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.095425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.095632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.095815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.095979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.096116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.096362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.096669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.096878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.096976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.097066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.097311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.097563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.097751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.097860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.097945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.098160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.098374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.098618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.098836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.098943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.099076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.099336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.099577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.099798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.099934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.100026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.100265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.100492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.100735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.100871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.100987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.101070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.101101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.101199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.101283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.101308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.254 qpair failed and we were unable to recover it. 00:30:39.254 [2024-11-28 15:25:39.101425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.254 [2024-11-28 15:25:39.101534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.101558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.101672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.101754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.101778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.101870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.101987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.102155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.102343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.102554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.102833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.102941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.103075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.103296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.103518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.103788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.103912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.103999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.104272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.104490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.104691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.104860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.104932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.105190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.105380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.105606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.105870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.105981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.106104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.106349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.106630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.106826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.106928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.107061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.107312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.107579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.107818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.107971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.255 [2024-11-28 15:25:39.108073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.108174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.255 [2024-11-28 15:25:39.108203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.255 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.108294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.108402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.108428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.108509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.108644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.108668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.108779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.108909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.108936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.109027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.109273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.109477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.109720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.109902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.109975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.110206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.110373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.110554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.110764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.110878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.110964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.111217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.111458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.111638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.111745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.111866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.112150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.112386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.112637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.112843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.112961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.113039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.113266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.113518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.113707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.113807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.113913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.114142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.114362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.256 [2024-11-28 15:25:39.114617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.256 [2024-11-28 15:25:39.114778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.256 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.114882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.114987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.115125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.115463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.115757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.115872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.115956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.116232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.116462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.116684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.116847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.116946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.117218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.117547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.117771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.117911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.117985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.118190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.118391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.118606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.118823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.118946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.119033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.119321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.119596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.119819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.119938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.120122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.120209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.120235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.120327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.120412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.120437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.257 [2024-11-28 15:25:39.120550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.120632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.257 [2024-11-28 15:25:39.120657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.257 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.120793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.120878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.120907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.120982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.121227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.121414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.121619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.121825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.121910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.122119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.122351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.122586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.122780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.122906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.123012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.123243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.123455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.123658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.123865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.123986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.124106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.124332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.124547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.124773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.124928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.125060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.125308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.125566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.125790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.125956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.126122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.126365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.126546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.126810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.126923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.127054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.127130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.127160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.258 [2024-11-28 15:25:39.127243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.127321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.258 [2024-11-28 15:25:39.127345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.258 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.127476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.127601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.127628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.127755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.127836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.127860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.127945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.128160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.128344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.128559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.128770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.128902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.129004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.129212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.129463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.129736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.129837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.129973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.130193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.130394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.130645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.130849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.130990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.131131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.131316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.131566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.131755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.131884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.131995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.132216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.132425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.132643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.132912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.132984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.133126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.133356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.133591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.259 [2024-11-28 15:25:39.133809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.259 [2024-11-28 15:25:39.133924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.259 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.134002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.134221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.134472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.134671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.134824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.134941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.135189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.135377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.135615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.135787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.135946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.136144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.136363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.136550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.136724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.136897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.136993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.137104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.137289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.137506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.137690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.137865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.137997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.138081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.138320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.138599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.138811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.138979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.139081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.139289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.139478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.139719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.139832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.139914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.140002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.140028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.260 [2024-11-28 15:25:39.140125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.140241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.260 [2024-11-28 15:25:39.140265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.260 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.140343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.140422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.140446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.140554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.140693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.140721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.140800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.140871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.140899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.141030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.141313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.141524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.141762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.141868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.141952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.142232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.142457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.142675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.142806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.142945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.143249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.143480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.143699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.143805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.143933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.144180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.144356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.144579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.144754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.144879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.145002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.145276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.145494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.145783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.145890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.145981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.146201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.146401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.146656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.146769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.261 [2024-11-28 15:25:39.146903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.147004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.261 [2024-11-28 15:25:39.147030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.261 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.147136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.147374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.147571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.147796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.147944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.148044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.148273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.148469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.148643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.148884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.148991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.149124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.149375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.149618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.149801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.149909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.150051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.150320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.150595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.150785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.150893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.150974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.151230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.151411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.151614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.151834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.151940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.152044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.152231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.152437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.262 [2024-11-28 15:25:39.152618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.262 [2024-11-28 15:25:39.152726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.262 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.152803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.152891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.152915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.152994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.153213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.153398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.153604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.153840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.153947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.154030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.154287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.154547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.154740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.154895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.155014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.155235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.155415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.155705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.155846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.155956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.156193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.156465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.156714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.156852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.156984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.157276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.157456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.157654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.157765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.157899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.158158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.158351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.158590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.158807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.158937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.159032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.159179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.159204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.159323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.159418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.263 [2024-11-28 15:25:39.159445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.263 qpair failed and we were unable to recover it. 00:30:39.263 [2024-11-28 15:25:39.159593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.159668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.159694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.159810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.159917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.159942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.160026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.160245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.160425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.160678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.160895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.160992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.161102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.161348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.161529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.161799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.161925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.162005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.162252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.162449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.162692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.162827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.162926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.163151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.163381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.163608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.163788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.163925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.164009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.164256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.164447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.164640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.164859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.164999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.165123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.165320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.165552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.165797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.264 [2024-11-28 15:25:39.165904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.264 qpair failed and we were unable to recover it. 00:30:39.264 [2024-11-28 15:25:39.166041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.166280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.166506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.166720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.166855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.166977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.167175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.167390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.167658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.167799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.167880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.168174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.168393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.168647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.168844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.168990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.169099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.169298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.169528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.169736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.169873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.169973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.170169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.170398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.170582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.170796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.170897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.171025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.171256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.171503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.171771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.171876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.171955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.172201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.172424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.265 qpair failed and we were unable to recover it. 00:30:39.265 [2024-11-28 15:25:39.172636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.265 [2024-11-28 15:25:39.172735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.172760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.172862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.172936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.172959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.173098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.173335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.173512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.173762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.173928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.174030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.174252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.174473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.174662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.174910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.174991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.175091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.175293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.175561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.175779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.175910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.175982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.176224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.176459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.176669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.176826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.176938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.177216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.177427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.177689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.177798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.177933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.178045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.178069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.178158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.178238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.178262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.266 [2024-11-28 15:25:39.178339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.178433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.266 [2024-11-28 15:25:39.178458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.266 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.178582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.178658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.178683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.178755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.178882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.178907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.178995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.179269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.179474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.179686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.179813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.179934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.180119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.180328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.180561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.180739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.180875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.180967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.181225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.181467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.181670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.181859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.181998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.182147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.182348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.182600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.182813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.182929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.183007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.183267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.183480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.183703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.183821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.183934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.184190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.184426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.184634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.184820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.267 [2024-11-28 15:25:39.184929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.267 qpair failed and we were unable to recover it. 00:30:39.267 [2024-11-28 15:25:39.185071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.185318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.185544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.185764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.185897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.186003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.186209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.186396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.186641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.186848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.186946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.187041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.187262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.187441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.187631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.187816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.187917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.188033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.188282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.188471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.188651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.188873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.188986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.189100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.189337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.189513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.189757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.189866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.189958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.190176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.190367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.190577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.190761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.190891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.190990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.191089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.268 [2024-11-28 15:25:39.191122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.268 qpair failed and we were unable to recover it. 00:30:39.268 [2024-11-28 15:25:39.191202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.191399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.191605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.191781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.191896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.192005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.192256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.192470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.192664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.192902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.192985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.193105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.193284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.193488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.193697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.193885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.193981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.194055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.194242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.194426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.194664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.194851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.194988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.195062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.195283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.195461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.195651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.195875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.195974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.196061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.196281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.196506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.196719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.196847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.196932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.197013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.197035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.269 qpair failed and we were unable to recover it. 00:30:39.269 [2024-11-28 15:25:39.197122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.269 [2024-11-28 15:25:39.197204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.197316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.197511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.197737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.197875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.197953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.198161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.198369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.198607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.198881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.198987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.199101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.199314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.199577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.199816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.199954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.200102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.200301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.200547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.200737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.200840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.200960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.201189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.201427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.201650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.201860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.201976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.202051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.202244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.202424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.202601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.202821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.202962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.203056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.203145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.203170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.203252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.203329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.203355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.270 qpair failed and we were unable to recover it. 00:30:39.270 [2024-11-28 15:25:39.203440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.270 [2024-11-28 15:25:39.203519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.203545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.203660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.203776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.203801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.203882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.204119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.204304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.204533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.204738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.204839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.204949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.205153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.205382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.205562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.205762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.205896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.206005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.206227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.206444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.206643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.206857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.206975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.207083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.207284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.207502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.207694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.207884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.207997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.208176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.208374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.208608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.208820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.271 [2024-11-28 15:25:39.208918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.271 qpair failed and we were unable to recover it. 00:30:39.271 [2024-11-28 15:25:39.209030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.209247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.209427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.209638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.209822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.209963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.210040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.210302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.210525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.210772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.210882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.210991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.211221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.211436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.211628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.211815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.211956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.212038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.212250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.212442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.212665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.212890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.212995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.213116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.213344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.213552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.213731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.213916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.213996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.214127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.214310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.214565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.214776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.214872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.272 qpair failed and we were unable to recover it. 00:30:39.272 [2024-11-28 15:25:39.214955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.215026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.272 [2024-11-28 15:25:39.215051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.215130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.215390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.215612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.215862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.215967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.216105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.216246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.216270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.216389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.216468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.216492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.216627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.216777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.216818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.216973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.217202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.217397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.217673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.217863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.217981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.218150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.218345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.218558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.218835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.218999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.219105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.219321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.219608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.219807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.219911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.219993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.220249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.220470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.220670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.220807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.220906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.221115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.221382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.221645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.273 qpair failed and we were unable to recover it. 00:30:39.273 [2024-11-28 15:25:39.221875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.221967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.273 [2024-11-28 15:25:39.222008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.222113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.222387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.222560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.222786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.222964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.223065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.223180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.223206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.223317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.223473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.223498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.223635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.223730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.223757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.223936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.224202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.224449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.224787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.224916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.225052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.225285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.225462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.225678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.225883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.225989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.226099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.226315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.226520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.226731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.226860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.226941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.227139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.227344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.227551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.227845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.227995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.228107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.228296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.228483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.274 qpair failed and we were unable to recover it. 00:30:39.274 [2024-11-28 15:25:39.228733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.274 [2024-11-28 15:25:39.228829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.228899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.229123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.229392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.229609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.229794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.229924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.230064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.230278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.230517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.230727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.230917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.230995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.231103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.231332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.231605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.231907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.231996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.232108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.232359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.232596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.232794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.232900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.233013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.233214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.233408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.233649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.233874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.233987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.234069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.234153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.234179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.234292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.234376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.234401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.275 qpair failed and we were unable to recover it. 00:30:39.275 [2024-11-28 15:25:39.234549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.275 [2024-11-28 15:25:39.234639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.234666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.234758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.234839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.234866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.234957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.235187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.235374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.235569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.235822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.235948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.236031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.236282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.236533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.236738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.236867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.236944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.237270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.237535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.237742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.237862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.237978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.238243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.238448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.238639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.238750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.238868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.239175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.239393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.239639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.239890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.239981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.240107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.240287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.240469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.240683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.240793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.276 qpair failed and we were unable to recover it. 00:30:39.276 [2024-11-28 15:25:39.240890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.276 [2024-11-28 15:25:39.241005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.241135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.241326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.241582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.241822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.241972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.242078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.242299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.242553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.242811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.242977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.243068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.243318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.243525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.243737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.243889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.244019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.244245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.244561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.244825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.244975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.245144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.245366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.245607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.245804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.245944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.246065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.246182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.246208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.246313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.246389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.246415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.246597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.246725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.246753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.246864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.247224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.247430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.247683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.247847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.247947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.248065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.277 [2024-11-28 15:25:39.248102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.277 qpair failed and we were unable to recover it. 00:30:39.277 [2024-11-28 15:25:39.248188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.248360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.248389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.248474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.248587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.248615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.248717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.248843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.248872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.248969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.249208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.249489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.249678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.249808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.249890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.250197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.250479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.250736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.250877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.250984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.251239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.251498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.251714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.251879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.251979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.252248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.252515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.252720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.252860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.252954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.253223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.253463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.253713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.253829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.253931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.254172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.254398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.254679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.254842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.254949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.255061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.255085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.255173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.255287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.278 [2024-11-28 15:25:39.255312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.278 qpair failed and we were unable to recover it. 00:30:39.278 [2024-11-28 15:25:39.255484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.255596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.255621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.255726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.255884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.255909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.255987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.256207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.256449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.256689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.256841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.256941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.257184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.257414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.257645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.257889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.257997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.258117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.258226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.258251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.258328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.258490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.258530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.258640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.258754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.258779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.258909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.259189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.259478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.259698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.259858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.259994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.260250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.260462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.260658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.260821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.260933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.261151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.261347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.261557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.261864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.261964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.262048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.262203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.262228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.262313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.262389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.279 [2024-11-28 15:25:39.262414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.279 qpair failed and we were unable to recover it. 00:30:39.279 [2024-11-28 15:25:39.262498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.262582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.262606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.262711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.262819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.262843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.262932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.263235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.263489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.263731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.263843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.263929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.264190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.264450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.264697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.264806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.264902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.265213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.265429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.265680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.265818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.265899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.266105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.266331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.266604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.266826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.266951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.267056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.267285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.267539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.267775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.267901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.268030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.268150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.268191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.268273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.268347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.268371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.280 [2024-11-28 15:25:39.268456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.268575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.280 [2024-11-28 15:25:39.268599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.280 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.268683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.268784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.268810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.268912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.268993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.269168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.269446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.269691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.269895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.269988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.270104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.270393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.270614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.270802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.270932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.271040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.271292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.271546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.271746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.271857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.271975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.272238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.272442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.272686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.272813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.272930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.273179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.273371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.273649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.273831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.273957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.274131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.274265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.274289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.274394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.274522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.274550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.274671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.274783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.274810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.274890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.275000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.275026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.275194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.275301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.275326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.275426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.275540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.281 [2024-11-28 15:25:39.275566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.281 qpair failed and we were unable to recover it. 00:30:39.281 [2024-11-28 15:25:39.275703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.275815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.275839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.275914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.276152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.276331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.276641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.276859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.276975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.277085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.277276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.277495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.277731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.277855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.277966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.278171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.278362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.278544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.278832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.278957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.279118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.279248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.279272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.279382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.279492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.279516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.279646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.279787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.279814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.279945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.280146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.280412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.280693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.280812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.280945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.281157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.281339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.281618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.281865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.281997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.282105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.282180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.282204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.282287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.282409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.282 [2024-11-28 15:25:39.282436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.282 qpair failed and we were unable to recover it. 00:30:39.282 [2024-11-28 15:25:39.282526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.282672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.282699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.282809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.282914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.282938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.283027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.283291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.283502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.283731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.283836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.283924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.284145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.284414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.284682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.284791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.284915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.285156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.285461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.285742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.285883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.285964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.286205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.286504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.286763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.286921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.287015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.287255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.287469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.287752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.287887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.287977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.288234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.288482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.288692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.288833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.288937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.289120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.289403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.283 qpair failed and we were unable to recover it. 00:30:39.283 [2024-11-28 15:25:39.289649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.283 [2024-11-28 15:25:39.289725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.289749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.289839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.290137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.290345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.290548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.290789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.290933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.291057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.291282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.291588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.291806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.291920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.292029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.292295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.292524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.292704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.292847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.292949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.293189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.293404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.293611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.293822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.293955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.294108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.294372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.294558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.294791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.294909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.295033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.295169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.295194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.295270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.295384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.295408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.295546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.295699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.295726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.284 qpair failed and we were unable to recover it. 00:30:39.284 [2024-11-28 15:25:39.295903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.284 [2024-11-28 15:25:39.296018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.296152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.296443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.296703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.296848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.296974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.297221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.297486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.297700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.297824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.297901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.298163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.298368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.298553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.298794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.298919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.298995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.299320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.299586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.299813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.299967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.300073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.300356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.300539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.300811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.300918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.301049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.301146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.301173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.301309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.301386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.301410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.301520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.301762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.301790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.301930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.302198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.302449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.302661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.302881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.302979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.303006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.285 qpair failed and we were unable to recover it. 00:30:39.285 [2024-11-28 15:25:39.303133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.285 [2024-11-28 15:25:39.303254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.303282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.303383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.303537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.303560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.303669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.303761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.303790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.303922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.304105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.304352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.304524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.304792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.304941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.305035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.305347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.305536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.305813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.305930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.306080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.306191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.306215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.306319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.306456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.306481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.306635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.306749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.306776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.306903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.307127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.307418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.307653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.307806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.307921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.308178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.308462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.308718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.308902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.309026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.309279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.309562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.309806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.309942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.310016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.310125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.310150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.310244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.310340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.310366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.286 qpair failed and we were unable to recover it. 00:30:39.286 [2024-11-28 15:25:39.310497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.286 [2024-11-28 15:25:39.310584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.310607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.310692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.310844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.310868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.311035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.311336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.311590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.311840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.311993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.312144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.312426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.312609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.312826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.312970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.313121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.313199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.313225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.313351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.313466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.313490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.313601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.313735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.313760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.313965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.314221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.314525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.314749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.314913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.315042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.315286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.315521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.315805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.315942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.316053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.316322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.316527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.316792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.316903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.317029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.317284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.317529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.317784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.317943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.287 qpair failed and we were unable to recover it. 00:30:39.287 [2024-11-28 15:25:39.318034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.318122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.287 [2024-11-28 15:25:39.318168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.318267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.318360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.318387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.318514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.318598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.318624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.318758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.318836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.318862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.318952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.319246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.319507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.319780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.319888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.320013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.320233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.320491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.320725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.320864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.320976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.321219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.321491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.321776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.321881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.321957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.322171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.322458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.322733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.322898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.323066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.323335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.323572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.323780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.323905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.324028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.324337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.324576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.324809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.324936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.325063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.325220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.325248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.288 qpair failed and we were unable to recover it. 00:30:39.288 [2024-11-28 15:25:39.325366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.325464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.288 [2024-11-28 15:25:39.325491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.325608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.325686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.325712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.325856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.325944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.325968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.326072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.326302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.326533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.326858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.326998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.327142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.327373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.327581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.327770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.327869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.327942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.328212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.328450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.328679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.328845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.328974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.329241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.329428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.329645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.329780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.329938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.330194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.330438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.330655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.330758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.330914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.331120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.331373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.289 qpair failed and we were unable to recover it. 00:30:39.289 [2024-11-28 15:25:39.331622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.289 [2024-11-28 15:25:39.331711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.331737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.331863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.331977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.332120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.332364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.332648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.332868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.332970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.333114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.333388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.333637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.333855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.333985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.334148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.334351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.334662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.334799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.334898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.335157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.335368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.335637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.335830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.335991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.336076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.336323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.336662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.336888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.336982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.337104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.337307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.337552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.337796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.337948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.338106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.338201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.338225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.338340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.338474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.338501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.338673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.338807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.338831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.290 qpair failed and we were unable to recover it. 00:30:39.290 [2024-11-28 15:25:39.338974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.339079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.290 [2024-11-28 15:25:39.339118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.339251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.339422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.339447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.339584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.339709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.339737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.339842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.339952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.339976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.340059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.340308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.340514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.340727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.340852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.340925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.341134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.341375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.341589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.341810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.341970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.342053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.342236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.342446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.342684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.342919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.342996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.343149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.343408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.343661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.343811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.343900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.344141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.344365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.344596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.344757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.344871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.345148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.345361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.345619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.291 qpair failed and we were unable to recover it. 00:30:39.291 [2024-11-28 15:25:39.345865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.291 [2024-11-28 15:25:39.345984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.346059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.346302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.346511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.346799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.346908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.347042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.347270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.347512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.347720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.347859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.347943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.348193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.348384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.348662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.348843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.348952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.349166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.349424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.349702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.349815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.349898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.350217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.350462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.350743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.350870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.350980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.351254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.351470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.351753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.351907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.352022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.352331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.352517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.352730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.352908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.292 [2024-11-28 15:25:39.353024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.353151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.292 [2024-11-28 15:25:39.353193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.292 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.353305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.353411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.353435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.353544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.353621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.353646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.353842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.354206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.354419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.354683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.354799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.354929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.355277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.355527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.355768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.355885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.355998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.356241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.356434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.356649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.356742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.356922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.357154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.357411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.357689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.357846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.357971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.358186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.358417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.358694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.358832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.358948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.359222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.359426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.293 [2024-11-28 15:25:39.359663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.293 [2024-11-28 15:25:39.359842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.293 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.359977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.360215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.360445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.360650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.360816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.360932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.361145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.361402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.361614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.361769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.361926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.362187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.362371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.362556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.362783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.362947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.363075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.363347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.363568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.363783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.363898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.363979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.364269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.364505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.364738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.364885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.365023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.365281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.365497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.365718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.365878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.365962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.366227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.366407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.366619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.294 [2024-11-28 15:25:39.366721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.294 qpair failed and we were unable to recover it. 00:30:39.294 [2024-11-28 15:25:39.366828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.366934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.366958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.367060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.367310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.367528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.367739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.367837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.367951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.368187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.368433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.368669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.368831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.368947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.369157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.369393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.369615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.369767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.369910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.370190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.370432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.370710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.370830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.370937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.371143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.371447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.371713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.371865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.371970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.372263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.372528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.372807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.372982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.373099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.373301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.373517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.295 [2024-11-28 15:25:39.373749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.295 [2024-11-28 15:25:39.373911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.295 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.373985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.374193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.374435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.374647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.374836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.374972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.375218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.375488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.375731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.375873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.376008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.376268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.376534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.376761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.376905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.377031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.377213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.377394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.377676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.377795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.377900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.378107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.378329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.378601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.378790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.378913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.379248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.379579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.379837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.379993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.380100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.380319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.380584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.380845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.380961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.381123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.381268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.296 [2024-11-28 15:25:39.381308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.296 qpair failed and we were unable to recover it. 00:30:39.296 [2024-11-28 15:25:39.381430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.381575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.381603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.381696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.381772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.381799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.381944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.382175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.382404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.382662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.382887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.382989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.383162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.383443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.383731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.383889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.384055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.384309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.384595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.384826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.384946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.385024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.385268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.385562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.385798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.385947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.386040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.386263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.386564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.386840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.386943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.387083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.387278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.387537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.387786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.387896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.387997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.388084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.388119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.388251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.388357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.388382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.297 [2024-11-28 15:25:39.388510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.388663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.297 [2024-11-28 15:25:39.388691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.297 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.388774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.388866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.388893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.389017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.389320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.389535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.389745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.389888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.390021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.390270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.390480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.390688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.390838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.390959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.391190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.391407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.391693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.391847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.391941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.392215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.392426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.392698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.392880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.392969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.393288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.393502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.393722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.393818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.393930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.394195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.394384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.394663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.394781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.394934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.395055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.395113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.395222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.395364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.298 [2024-11-28 15:25:39.395388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.298 qpair failed and we were unable to recover it. 00:30:39.298 [2024-11-28 15:25:39.395487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.395627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.395651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.395762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.395847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.395890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.395981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.396233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.396523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.396741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.396871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.396980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.397251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.397427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.397683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.397834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.397911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.398204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.398462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.398727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.398842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.398966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.399225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.399510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.399700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.399849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.400001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.400137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.400162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.299 [2024-11-28 15:25:39.400236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.400317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.299 [2024-11-28 15:25:39.400342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.299 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.400452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.400591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.400619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.400743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.400854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.400881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.401005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.401234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.401428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.401637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.401762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.401882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.402146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.402368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.402621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.402865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.402995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.403135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.403322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.403548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.403754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.403909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.404029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.404236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.404421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.404650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.404917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.404990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.405169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.405427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.405664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.405871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.405968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.406043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.406360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.406576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.406884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.406989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.407014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.300 qpair failed and we were unable to recover it. 00:30:39.300 [2024-11-28 15:25:39.407121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.300 [2024-11-28 15:25:39.407250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.407277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.407404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.407527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.407554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.407634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.407722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.407750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.407906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.408192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.408417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.408640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.408803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.408885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.409111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.409389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.409593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.409860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.409976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.410064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.410335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.410594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.410786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.410923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.411033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.411284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.411565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.411831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.411935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.412059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.412289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.412481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.412716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.412822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.412900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.413193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.413457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.413765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.413870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.413974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.414099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.414128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.301 qpair failed and we were unable to recover it. 00:30:39.301 [2024-11-28 15:25:39.414219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.414315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.301 [2024-11-28 15:25:39.414356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.414473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.414551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.414575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.414717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.414819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.414842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.414975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.415263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.415540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.415774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.415908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.415988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.416285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.416565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.416850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.416978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.417058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.417347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.417638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.417886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.417991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.418156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.418354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.418636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.418864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.418993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.419132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.419362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.419606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.419833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.419930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.420036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.420210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.420238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.420360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.420485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.420511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.420638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.420790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.420817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.420964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.421264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.421533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.302 qpair failed and we were unable to recover it. 00:30:39.302 [2024-11-28 15:25:39.421764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.302 [2024-11-28 15:25:39.421925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.422087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.422299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.422524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.422790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.422954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.423060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.423317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.423554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.423819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.423946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.424021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.424241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.424487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.424754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.424861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.425013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.425239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.425471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.425724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.425886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.426030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.426169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.426211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.426374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.426514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.426538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.426631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.426790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.426814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.426912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.427247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.427500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.427718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.427854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.427929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.428023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.428050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.303 qpair failed and we were unable to recover it. 00:30:39.303 [2024-11-28 15:25:39.428192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.303 [2024-11-28 15:25:39.428280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.428305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.428474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.428587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.428615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.428739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.428852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.428879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.428959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.429207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.429491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.429791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.429893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.429971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.430234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.430462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.430680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.430874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.430990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.431117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.431311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.431523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.431753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.431896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.431997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.432253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.432534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.432799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.432940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.433063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.433283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.433491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.433740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.433891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.434007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.434134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.434159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.434316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.434464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.434491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.434644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.434812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.434836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.434942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.435079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.435110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.435190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.435327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.435352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.304 qpair failed and we were unable to recover it. 00:30:39.304 [2024-11-28 15:25:39.435476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.304 [2024-11-28 15:25:39.435560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.435587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.435756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.435876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.435901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.435980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.436221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.436437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.436648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.436830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.436945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.437075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.437280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.437508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.437797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.437973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.438130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.438389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.438620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.438864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.438992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.439125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.439327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.439577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.439861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.439983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.440118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.440357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.440578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.440822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.440938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.441026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.441221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.441471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.441748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.441867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.441970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.442084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.442116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.442210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.442345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.442373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.305 qpair failed and we were unable to recover it. 00:30:39.305 [2024-11-28 15:25:39.442454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.305 [2024-11-28 15:25:39.442544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.442571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.442665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.442781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.442808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.442907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.442988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.443102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.443381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.443656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.443892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.443999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.444164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.444417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.444681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.444869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.444986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.445183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.445494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.445729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.445912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.446041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.446257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.446482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.446724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.446865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.446976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.447202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.447502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.447753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.306 [2024-11-28 15:25:39.447916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.306 qpair failed and we were unable to recover it. 00:30:39.306 [2024-11-28 15:25:39.448005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.448317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.448543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.448741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.448846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.448979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.449223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.449431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.449669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.449778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.449891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.450106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.450326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.450548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.450797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.450938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.451024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.451252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.451478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.451669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.451863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.451976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.452058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.452269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.452530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.452714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.452877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.605 qpair failed and we were unable to recover it. 00:30:39.605 [2024-11-28 15:25:39.452990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.605 [2024-11-28 15:25:39.453072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.453206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.453415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.453607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.453852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.453967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.454048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.454281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.454493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.454758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.454874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.454962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.455218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.455523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.455719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.455885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.455991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.456177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.456466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.456738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.456877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.456996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.457289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.457530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.457735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.457904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.457976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.458195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.458391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.458660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.458774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.458902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.459161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.459377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.459635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.606 qpair failed and we were unable to recover it. 00:30:39.606 [2024-11-28 15:25:39.459863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.606 [2024-11-28 15:25:39.459958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.459983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.460090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.460303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.460542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.460768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.460947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.461042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.461308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.461549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.461788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.461976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.462056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.462283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.462574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.462842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.462951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.463100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.463208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.463233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.463318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.463391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.463417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.463533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.463717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.463742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.463882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.464170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.464354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.464628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.464879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.464996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.465120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.465315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.465574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.465849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.465995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.466110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.466299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.466556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.466804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.466924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.607 qpair failed and we were unable to recover it. 00:30:39.607 [2024-11-28 15:25:39.467037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.607 [2024-11-28 15:25:39.467167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.467282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.467488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.467755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.467870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.468001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.468232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.468461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.468728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.468871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.468951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.469232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.469444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.469654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.469869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.469980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.470162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.470463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.470778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.470887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.471022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.471105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.471132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.471246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.471352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.471393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.471580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.471750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.471784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.471926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.472246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.472454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.472659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.472850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.472941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.473208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.473477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.473811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.473928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.474076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.474223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.474252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.608 qpair failed and we were unable to recover it. 00:30:39.608 [2024-11-28 15:25:39.474347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.474462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.608 [2024-11-28 15:25:39.474488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.474614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.474741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.474769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.474894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.475207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.475459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.475671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.475863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.476018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.476268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.476546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.476819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.476933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.477056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.477376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.477666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.477882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.477988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.478129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.478356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.478673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.478834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.478943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.479215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.479442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.479699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.479834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.479968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.480233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.480461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.609 [2024-11-28 15:25:39.480681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.609 [2024-11-28 15:25:39.480818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.609 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.480900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.481138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.481333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.481509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.481694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.481825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.481938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.482184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.482504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.482732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.482843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.482926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.483158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.483336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.483559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.483785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.483892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.484000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.484192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.484424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.484700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.484801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.484930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.485238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.485431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.485693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.485842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.485957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.486190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.486398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.486721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.486845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.486952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.487059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.487085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.487208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.487292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.487318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.610 [2024-11-28 15:25:39.487397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.487472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.610 [2024-11-28 15:25:39.487497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.610 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.487582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.487677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.487703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.487811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.487886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.487912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.488039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.488239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.488465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.488715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.488878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.489004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.489248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.489497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.489772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.489919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.490028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.490252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.490455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.490654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.490842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.490950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.491178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.491360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.491625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.491811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.491942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.492208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.492516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.492767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.492878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.493042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.493286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.493552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.493756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.493890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.493998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.494167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.494193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.494275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.494385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.494415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.611 [2024-11-28 15:25:39.494498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.494617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.611 [2024-11-28 15:25:39.494646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.611 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.494742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.494838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.494867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.495004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.495227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.495449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.495726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.495830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.495942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.496154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.496363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.496640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.496795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.496891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.497165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.497430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.497618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.497808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.497913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.498051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.498276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.498486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.498780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.498886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.498972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.499167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.499436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.499659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.499873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.499973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.500099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.500334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.500595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.500838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.500982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.501007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.501112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.501209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.501237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.501330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.501443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.612 [2024-11-28 15:25:39.501469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.612 qpair failed and we were unable to recover it. 00:30:39.612 [2024-11-28 15:25:39.501553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.501663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.501688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.501816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.501931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.501956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.502038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.502232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.502492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.502709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.502839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.502962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.503316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.503543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.503813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.503937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.504066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.504328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.504552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.504772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.504888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.504998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.505220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.505477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.505680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.505816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.505930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.506186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.506380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.506605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.506830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.506987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.507120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.507392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.507650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.507835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.507939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.508032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.508120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.508149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.508254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.508327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.613 [2024-11-28 15:25:39.508353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.613 qpair failed and we were unable to recover it. 00:30:39.613 [2024-11-28 15:25:39.508465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.508552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.508578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.508688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.508797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.508826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.508962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.509164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.509349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.509530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.509822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.509949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.510078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.510280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.510470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.510644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.510782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.510941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.511236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.511431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.511677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.511857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.511953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.512182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.512428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.512656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.512895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.512974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.513106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.513298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.513571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.513841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.513971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.514051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.514157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.514183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.514288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.514365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.514390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.614 qpair failed and we were unable to recover it. 00:30:39.614 [2024-11-28 15:25:39.514503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.614 [2024-11-28 15:25:39.514650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.514678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.514813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.514901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.514927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.515004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.515277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.515523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.515795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.515894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.515975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.516178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.516371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.516556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.516790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.516934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.517025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.517240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.517450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.517667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.517803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.517932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.518166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.518393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.518651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.518800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.518939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.519216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.519431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.519620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.519837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.519997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.520139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.520221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.520247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.520363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.520475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.520501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.520655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.520793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.520819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.520927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.521021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.521068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.521173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.521268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.521295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.615 qpair failed and we were unable to recover it. 00:30:39.615 [2024-11-28 15:25:39.521450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.615 [2024-11-28 15:25:39.521531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.521556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.521664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.521747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.521773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.521855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.521987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.522117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.522347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.522558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.522800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.522918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.523070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.523308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.523528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.523706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.523816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.523904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.524226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.524419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.524636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.524818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.524950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.525078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.525349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.525589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.525857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.525976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.526077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.526285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.526524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.526833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.526989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.527171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.527281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.527307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.527413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.527566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.527591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.527719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.527840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.527868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.527972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.528059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.528087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.528235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.528318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.616 [2024-11-28 15:25:39.528344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.616 qpair failed and we were unable to recover it. 00:30:39.616 [2024-11-28 15:25:39.528427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.528534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.528560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.528667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.528749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.528777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.528861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.528997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.529111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.529329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.529576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.529770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.529897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.529980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.530199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.530482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.530727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.530830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.531007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.531287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.531489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.531722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.531843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.531949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.532183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.532397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.532649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.532905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.532980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.533140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.533349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.533606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.533877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.533993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.534078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.534317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.534595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.534832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.534949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.535084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.535188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.617 [2024-11-28 15:25:39.535214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.617 qpair failed and we were unable to recover it. 00:30:39.617 [2024-11-28 15:25:39.535328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.535412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.535455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.535542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.535679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.535710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.535824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.535908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.535933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.536035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.536256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.536472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.536709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.536846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.536933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.537174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.537395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.537671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.537778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.537861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.538160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.538373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.538609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.538796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.538902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.538991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.539207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.539441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.539655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.539790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.539919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.540148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.540344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.540540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.540753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.540885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.540974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.541105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.618 [2024-11-28 15:25:39.541131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.618 qpair failed and we were unable to recover it. 00:30:39.618 [2024-11-28 15:25:39.541258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.541354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.541391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.541513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.541643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.541671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.541826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.541918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.541946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.542078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.542316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.542591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.542860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.542977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.543168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.543401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.543619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.543799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.543914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.544201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.544441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.544664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.544908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.544995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.545169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.545412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.545649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.545874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.545997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.546086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.546392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.546631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.546870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.546982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.547077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.547339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.547585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.547787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.547910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.548027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.548165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.548191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.548333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.548446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.619 [2024-11-28 15:25:39.548473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.619 qpair failed and we were unable to recover it. 00:30:39.619 [2024-11-28 15:25:39.548611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.548737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.548766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.548864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.548969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.548995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.549079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.549333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.549546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.549787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.549900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.549982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.550214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.550397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.550698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.550840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.550949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.551206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.551474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.551749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.551918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.552061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.552327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.552503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.552714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.552959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.553074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.553350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.553541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.553729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.553887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.553984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.554273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.554558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.554798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.554946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.555084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.555218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.555244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.555325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.555429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.555455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.620 [2024-11-28 15:25:39.555536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.555621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.620 [2024-11-28 15:25:39.555647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.620 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.555724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.555830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.555858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.555942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.556206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.556441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.556729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.556885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.557009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.557242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.557408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.557633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.557784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.557949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.558188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.558400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.558614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.558816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.558968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.559079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.559352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.559624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.559885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.559987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.560102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.560320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.560548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.560815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.560957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.561061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.561305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.561503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.561755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.561876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.561956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.562068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.562114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.562229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.562313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.562341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.562435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.562551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.621 [2024-11-28 15:25:39.562580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.621 qpair failed and we were unable to recover it. 00:30:39.621 [2024-11-28 15:25:39.562673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.562783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.562813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.562902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.562983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.563079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.563307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.563560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.563777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.563914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.563987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.564242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.564483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.564733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.564860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.564945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.565200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.565407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.565610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.565862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.565970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.566054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.566259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.566497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.566710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.566851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.566931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.567159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.567359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.567571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.567796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.567910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.567989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.568228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.568469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.568677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.568897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.568978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.622 [2024-11-28 15:25:39.569004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.622 qpair failed and we were unable to recover it. 00:30:39.622 [2024-11-28 15:25:39.569119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.569333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.569550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.569805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.569907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.569995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.570250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.570439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.570648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.570889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.570998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.571082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.571312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.571570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.571785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.571930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.572017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.572218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.572433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.572645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.572891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.572993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.573085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.573293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.573520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.573770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.573877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.573951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.574186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.574372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.574581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.623 [2024-11-28 15:25:39.574688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.623 qpair failed and we were unable to recover it. 00:30:39.623 [2024-11-28 15:25:39.574791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.574868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.574894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.574998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.575219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.575412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.575632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.575843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.575963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.576050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.576278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.576472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.576698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.576830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.576946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.577173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.577363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.577584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.577796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.577901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.577986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.578247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.578435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.578654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.578905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.578988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.579132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.579350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.579587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.579815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.579958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.580052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.580248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.580456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.580672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.580892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.580974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.581000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.624 qpair failed and we were unable to recover it. 00:30:39.624 [2024-11-28 15:25:39.581087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.624 [2024-11-28 15:25:39.581204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.581321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.581534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.581741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.581873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.581956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.582152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.582375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.582625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.582872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.582981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.583086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.583319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.583510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.583727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.583858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.584003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.584204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.584428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.584641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.584807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.584915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.585140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.585363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.585587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.585827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.585957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.586045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.586239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.586446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.586646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.586887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.586977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.587003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.587124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.587201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.587227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.587318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.587400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.587426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.625 qpair failed and we were unable to recover it. 00:30:39.625 [2024-11-28 15:25:39.587514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.625 [2024-11-28 15:25:39.587609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.587635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.587741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.587823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.587850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.587945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.588153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.588376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.588599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.588808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.588941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.589048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.589238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.589442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.589698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.589835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.589942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.590245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.590432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.590691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.590829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.590933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.591201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.591446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.591629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.591774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.591910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.592198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.592521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.592827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.592944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.593072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.593404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.593639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.593885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.593971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.594004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.594143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.594250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.594281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.594378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.594467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.594498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.626 qpair failed and we were unable to recover it. 00:30:39.626 [2024-11-28 15:25:39.594646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.626 [2024-11-28 15:25:39.594765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.594794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.594899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.595156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.595368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.595552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.595796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.595940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.596086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.596327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.596577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.596828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.596960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.597045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.597336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.597555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.597769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.597913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.598007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.598228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.598495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.598759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.598900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.599062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.599328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.599555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.599773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.599951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.600044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.600270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.600539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.627 [2024-11-28 15:25:39.600752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.627 [2024-11-28 15:25:39.600896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.627 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.600977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.601238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.601479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.601720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.601845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.601933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.602229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.602488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.602769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.602888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.602966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.603265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.603464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.603694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.603839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.603930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.604184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.604396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.604642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.604857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.604973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.605112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.605332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.605519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.605817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.605922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.606055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.606254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.606555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.606784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.606898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.607008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.607211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.607391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.628 qpair failed and we were unable to recover it. 00:30:39.628 [2024-11-28 15:25:39.607627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.628 [2024-11-28 15:25:39.607742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.607770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.607890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.608209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.608393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.608578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.608704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.608851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.609136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.609384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.609616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.609855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.609995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.610103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.610247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.610274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.610425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.610525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.610554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.610704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.610807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.610835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.610932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.611262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.611477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.611689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.611826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.611900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.612123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.612326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.612597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.612820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.612961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.613067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.613287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.613477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.613697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.613835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.613942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.614043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.614068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.614183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.614261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.614287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.629 [2024-11-28 15:25:39.614380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.614457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.629 [2024-11-28 15:25:39.614487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.629 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.614574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.614654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.614681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.614756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.614859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.614885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.614971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.615167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.615370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.615610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.615840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.615946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.616050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.616290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.616508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.616742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.616880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.616988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.617194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.617404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.617610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.617856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.617988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.618082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.618277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.618526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.618738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.618846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.618927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.619185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.619424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.619642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.619890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.619974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.620138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.620335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.620554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.630 [2024-11-28 15:25:39.620795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.630 [2024-11-28 15:25:39.620901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.630 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.620979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.621233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.621423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.621661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.621868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.621976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.622089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.622291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.622511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.622698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.622805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.622895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.623108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.623311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.623550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.623771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.623883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.623966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.624220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.624448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.624661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.624800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.624919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.625116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.625409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.625612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.625843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.625961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.626042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.626276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.626507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.626777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.626973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.627065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.627158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.627185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.627290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.627370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.631 [2024-11-28 15:25:39.627396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.631 qpair failed and we were unable to recover it. 00:30:39.631 [2024-11-28 15:25:39.627531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.627640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.627667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.627777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.627853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.627879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.627960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.628267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.628491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.628684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.628826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.628935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.629148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.629371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.629591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.629804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.629928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.630018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.630234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.630455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.630672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.630797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.630885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.631119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.631339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.631534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.631748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.631856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.631928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.632152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.632378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.632587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.632853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.632960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.633042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.633157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.632 [2024-11-28 15:25:39.633182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.632 qpair failed and we were unable to recover it. 00:30:39.632 [2024-11-28 15:25:39.633259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.633461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.633683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.633903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.633981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.634110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.634310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.634525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.634740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.634879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.634989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.635209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.635410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.635623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.635840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.635966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.636088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.636348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.636579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.636795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.636934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.637047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.637245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.637429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.637630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.637884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.637994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.638081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.638322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.638565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.638737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.638874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.638954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.639025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.639052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.639138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.639218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.639244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.639360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.639437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.633 [2024-11-28 15:25:39.639463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.633 qpair failed and we were unable to recover it. 00:30:39.633 [2024-11-28 15:25:39.639606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.639687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.639713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.639793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.639872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.639898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.640011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.640250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.640469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.640699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.640815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.640902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.641112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.641317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.641518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.641766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.641866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.641942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.642167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.642380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.642593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.642766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.642894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.643019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.643291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.643476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.643683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.643858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.643956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.644233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.644539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.644753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.644877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.644983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.645241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.645469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.645719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.645848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.645938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.646057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.646090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.634 qpair failed and we were unable to recover it. 00:30:39.634 [2024-11-28 15:25:39.646224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.634 [2024-11-28 15:25:39.646318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.646350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.646464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.646557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.646586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.646711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.646805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.646836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.646948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.647216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.647436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.647743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.647858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.647981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.648234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.648428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.648773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.648926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.649027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.649220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.649475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.649694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.649858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.649957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.650157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.650364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.650649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.650801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.650975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.651241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.651459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.651707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.651865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.652017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.652231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.652447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.652644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.652785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.652952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.653028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.653054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.653159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.653267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.635 [2024-11-28 15:25:39.653293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.635 qpair failed and we were unable to recover it. 00:30:39.635 [2024-11-28 15:25:39.653400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.653485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.653512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.653628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.653773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.653800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.653899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.654209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.654443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.654645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.654875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.654988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.655110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.655345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.655625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.655866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.655981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.656098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.656374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.656599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.656847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.656978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.657127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.657366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.657623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.657845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.657964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.658057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.658270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.658527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.658756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.658904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.658995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.659261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.659508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.659726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.659853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.636 qpair failed and we were unable to recover it. 00:30:39.636 [2024-11-28 15:25:39.659976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.636 [2024-11-28 15:25:39.660085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.660237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.660449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.660706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.660860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.660952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.661203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.661480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.661722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.661848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.661972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.662217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.662442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.662678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.662820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.662908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.663116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.663345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.663596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.663842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.663973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.664071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.664361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.664603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.664815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.664938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.665041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.665276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.665492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.665739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.665843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.665932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.666018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.666045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.666134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.666274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.666300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.637 qpair failed and we were unable to recover it. 00:30:39.637 [2024-11-28 15:25:39.666385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.637 [2024-11-28 15:25:39.666490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.666517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.666599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.666682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.666709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.666796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.666950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.666976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.667101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.667304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.667543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.667745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.667880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.667952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.668210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.668454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.668668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.668890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.668998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.669160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.669406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.669657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.669881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.669989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.670102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.670350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.670563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.670827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.670959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.671041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.671283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.671476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.671655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.671906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.671984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.672154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.672368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.672583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.638 [2024-11-28 15:25:39.672777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.638 [2024-11-28 15:25:39.672921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.638 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.673073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.673274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.673463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.673689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.673793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.673905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.674124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.674310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.674567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.674781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.674890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.674970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.675168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.675422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.675646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.675842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.675976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.676098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.676345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.676562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.676809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.676907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.677018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.677248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.677507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.677740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.677874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.678026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.678364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.678577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.678842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.678956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.679118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.679242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.679269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.679384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.679498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.679525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.639 qpair failed and we were unable to recover it. 00:30:39.639 [2024-11-28 15:25:39.679651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.639 [2024-11-28 15:25:39.679730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.679759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.679858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.680119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.680329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.680618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.680774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.680941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.681160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.681412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.681720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.681858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.682000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.682116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.682147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.682305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.682426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.682455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.682588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.682730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.682757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.682889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.683230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.683504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.683799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.683937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.684067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.684324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.684625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.684832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.684947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.685056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.685255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.685583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.685803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.685946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.686032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.686258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.686537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.686794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.686937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.687027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.687158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.687186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.640 qpair failed and we were unable to recover it. 00:30:39.640 [2024-11-28 15:25:39.687293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.640 [2024-11-28 15:25:39.687423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.687452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.687604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.687692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.687721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.687829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.687946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.687974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.688049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.688278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.688523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.688805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.688943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.689051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.689282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.689569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.689836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.689993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.690142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.690363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.690683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.690866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.691035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.691171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.691198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.691314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.691474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.691504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.691618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.691731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.691760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.691925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.692228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.692469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.692713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.692895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.693020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.693314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.693591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.693838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.693984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.641 [2024-11-28 15:25:39.694067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.694205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.641 [2024-11-28 15:25:39.694232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.641 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.694321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.694402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.694429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.694551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.694739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.694766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.694847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.694936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.694972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.695058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.695168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.695212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.695376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.695484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.695510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.695611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.695776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.695803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.695889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.696140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.696332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.696542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.696838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.696995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.697122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.697364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.697607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.697815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.697983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.698106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.698343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.698579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.698816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.698979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.699104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.699333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.699554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.699833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.699989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.700106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.700381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.700630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.700860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.700992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.701026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.701130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.701227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.701254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.642 qpair failed and we were unable to recover it. 00:30:39.642 [2024-11-28 15:25:39.701372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.701478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.642 [2024-11-28 15:25:39.701504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.701620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.701727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.701754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.701826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.701909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.701936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.702018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.702325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.702519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.702738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.702919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.703016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.703141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.703172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.703313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.703402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.703435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.703550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.703689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.703716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.703874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.704183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.704416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.704634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.704843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.704967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.705050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.705298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.705526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.705723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.705860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.706005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.706136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.706167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.706306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.706440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.706466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.706610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.706734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.706763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.706911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.707254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.707520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.707781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.707902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.708030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.708260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.708549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.643 qpair failed and we were unable to recover it. 00:30:39.643 [2024-11-28 15:25:39.708784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.643 [2024-11-28 15:25:39.708943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.708970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.709050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.709282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.709502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.709738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.709849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.709983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.710276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.710502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.710711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.710866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.710975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.711253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.711516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.711755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.711856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.711933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.712184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.712407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.712649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.712858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.712982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.713165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.713409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.713609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.713825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.713922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.714073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.714111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.714271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.714431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.714473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.714583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.714695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.714723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.714897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.715202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.715497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.715754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.715857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.715963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.716065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.716101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.716195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.716284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.716315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.644 qpair failed and we were unable to recover it. 00:30:39.644 [2024-11-28 15:25:39.716475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.644 [2024-11-28 15:25:39.716597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.716627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.716740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.716880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.716907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.717023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.717231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.717515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.717817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.717987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.718089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.718350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.718599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 841590 Killed "${NVMF_APP[@]}" "$@" 00:30:39.645 [2024-11-28 15:25:39.718700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.718815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.718921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.719058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 15:25:39 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:39.645 [2024-11-28 15:25:39.719232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.719262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.719356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 15:25:39 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:39.645 [2024-11-28 15:25:39.719456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.719486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 15:25:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:39.645 [2024-11-28 15:25:39.719607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.719695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.719724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 15:25:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:39.645 [2024-11-28 15:25:39.719820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.719955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 15:25:39 -- common/autotest_common.sh@10 -- # set +x 00:30:39.645 [2024-11-28 15:25:39.719982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.720223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.720344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.720374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.720464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.720579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.720608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.720709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.720795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.720824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.720955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.721237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.721511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.721778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.721966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.722091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.722180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.722206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.722346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.722462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.722488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.722585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.722757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.722784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.722925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.723151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.723428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.645 qpair failed and we were unable to recover it. 00:30:39.645 [2024-11-28 15:25:39.723631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 [2024-11-28 15:25:39.723710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.645 15:25:39 -- nvmf/common.sh@469 -- # nvmfpid=842284 00:30:39.646 [2024-11-28 15:25:39.723736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.723811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 15:25:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:39.646 15:25:39 -- nvmf/common.sh@470 -- # waitforlisten 842284 00:30:39.646 [2024-11-28 15:25:39.723947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.723975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.724071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 15:25:39 -- common/autotest_common.sh@829 -- # '[' -z 842284 ']' 00:30:39.646 [2024-11-28 15:25:39.724172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.724199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.724306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 15:25:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:39.646 [2024-11-28 15:25:39.724398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.724429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 15:25:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:39.646 [2024-11-28 15:25:39.724507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 15:25:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:39.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:39.646 [2024-11-28 15:25:39.724661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.724703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 15:25:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:39.646 [2024-11-28 15:25:39.724812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 15:25:39 -- common/autotest_common.sh@10 -- # set +x 00:30:39.646 [2024-11-28 15:25:39.724917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.724945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.725033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.725267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.725465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.725734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.725879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.726045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.726325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.726567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.726817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.726964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.727076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.727270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.727499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.727746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.727872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.728035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.728253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.728459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.728697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.728863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.728999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.729268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.729552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.729841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.729978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.730057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.730187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.730215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.730306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.730416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.730443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.730564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.730642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.646 [2024-11-28 15:25:39.730668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.646 qpair failed and we were unable to recover it. 00:30:39.646 [2024-11-28 15:25:39.730748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.730828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.730856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.730973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.731283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.731586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.731841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.731986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.732083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.732306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.732525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.732765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.732897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.733022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.733256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.733506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.733736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.733893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.733986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.734252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.734453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.734704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.734913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.734992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.735127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.735393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.735650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.735778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.735897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.736127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.736380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.736598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.736807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.736947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.737035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.737227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.737453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.737657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.737915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.737999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.647 [2024-11-28 15:25:39.738026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.647 qpair failed and we were unable to recover it. 00:30:39.647 [2024-11-28 15:25:39.738120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.738336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.738581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.738805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.738943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.739022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.739251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.739519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.739739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.739893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.739988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.740259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.740523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.740774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.740909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.741054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.741282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.741497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.741703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.741823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.741918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.742213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.742465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.742682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.742863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.742976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.743088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.743288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.743481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.743677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.743865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.743976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.744082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.744341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.744532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.744746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.744911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.745003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.745091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.648 [2024-11-28 15:25:39.745140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.648 qpair failed and we were unable to recover it. 00:30:39.648 [2024-11-28 15:25:39.745233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.745354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.745381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.745478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.745591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.745618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.745702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.745807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.745834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.745965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.746211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.746395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.746648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.746842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.746953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.747029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.747259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.747467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.747699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.747818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.747903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.748163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.748365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.748554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.748777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.748887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.748967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.749217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.749441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.749695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.749805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.749898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.750157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.750352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.750628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.750815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.750955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.751067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.751355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.751537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.751726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.751828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.751924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.752039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.752065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.649 qpair failed and we were unable to recover it. 00:30:39.649 [2024-11-28 15:25:39.752165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.649 [2024-11-28 15:25:39.752316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.752435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.752626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.752815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.752951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.753038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.753254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.753469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.753655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.753884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.753991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.754084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.754310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.754522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.754781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.754887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.754962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.755262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.755455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.755659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.755880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.755988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.756070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.756257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.756521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.756719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.650 qpair failed and we were unable to recover it. 00:30:39.650 [2024-11-28 15:25:39.756910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.650 [2024-11-28 15:25:39.756988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.757105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.757380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.757586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.757788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.757922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.758030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.758285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.758465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.758715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.758825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.758934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.759154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.759343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.759568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.759805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.759920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.760060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.760273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.760521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.760730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.760874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.760953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.761185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.761370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.761591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.761805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.761902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.762009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.762118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.762145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.762230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.762336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.762362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.651 [2024-11-28 15:25:39.762442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.762518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.651 [2024-11-28 15:25:39.762543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.651 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.762622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.762740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.762766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.762862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.762948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.762974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.763097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.763295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.763534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.763708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.763871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.763952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.764181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.764360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.764604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.764796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.764896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.764980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.765181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.765358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.765627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.765818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.765946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.766060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.766266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.766488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.766725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.766835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.766925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.767110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.767307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.767495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.767682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.767863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.767967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.768080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.768202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.768228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.768316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.768395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.768421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.652 [2024-11-28 15:25:39.768538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.768617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.652 [2024-11-28 15:25:39.768642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.652 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.768736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.768816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.768842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.768919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.769121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.769327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.769534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.769733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.769844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.769926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.770147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.770345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.770527] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:39.653 [2024-11-28 15:25:39.770553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770603] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:39.653 [2024-11-28 15:25:39.770635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.770735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.770905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.770981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.771108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.771300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.771548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.771738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.771869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.772010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.772203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.772417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.772590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.772839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.772975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.773082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.773343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.773626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.773836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.773940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.774014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.774120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.774146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.774231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.774351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.774377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.653 qpair failed and we were unable to recover it. 00:30:39.653 [2024-11-28 15:25:39.774493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.653 [2024-11-28 15:25:39.774604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.774631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.774721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.774798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.774825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.774909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.775194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.775408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.775614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.775862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.775994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.776069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.776322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.776507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.776681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.776878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.776983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.777065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.777263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.777476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.777724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.777856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.777937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.778183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.778425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.778663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.778793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.778885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.779138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.779331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.779553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.779777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.779884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.779964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.780104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.780131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.780211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.780317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.654 [2024-11-28 15:25:39.780348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.654 qpair failed and we were unable to recover it. 00:30:39.654 [2024-11-28 15:25:39.780423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.780529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.780554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.780679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.780785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.780811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.780902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.780976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.781113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.781357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.781601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.781786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.781957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.782038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.782238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.782422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.782616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.782834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.782964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.783051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.783241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.783436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.783657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.783868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.783982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.784115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.784361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.784553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.784775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.784889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.785025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.785257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.785440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.785656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.785786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.785862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.786000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.786026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.786136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.786209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.655 [2024-11-28 15:25:39.786235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.655 qpair failed and we were unable to recover it. 00:30:39.655 [2024-11-28 15:25:39.786321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.786437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.786462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.786538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.786644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.786670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.786789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.786867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.786893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.786986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.787170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.787386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.787639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.787857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.787999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.788076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.788293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.788545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.788858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.788975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.789090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.789339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.789611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.789839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.789985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.790149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.790339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.790583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.790838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.790972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.791059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.791284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.791535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.791755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.791896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.792037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.792292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.792535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.792748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.792851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.792959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.793068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.656 [2024-11-28 15:25:39.793099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.656 qpair failed and we were unable to recover it. 00:30:39.656 [2024-11-28 15:25:39.793208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.793397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.793657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.793870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.793984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.794056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.794290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.794518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.794794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.794953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.795048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.795287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.795502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.795695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.795814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.795952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.796180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.796403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.796632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.796892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.796992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.797106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.797298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.797478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.797718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.797874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.797954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.798214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.798491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.657 [2024-11-28 15:25:39.798747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.657 [2024-11-28 15:25:39.798866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.657 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.798983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.799240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.799440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.799627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.799858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.799990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.800106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.800287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.800478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.800728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.800836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.800932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.801039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.801064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.801159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.801248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.801274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.801357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.801429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.942 [2024-11-28 15:25:39.801455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.942 qpair failed and we were unable to recover it. 00:30:39.942 [2024-11-28 15:25:39.801535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.801611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.801638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.801717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.801794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.801820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.801935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.802158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.802376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.802598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.802844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.802946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.803084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.803271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.803492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.803741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.803855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.803944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.804142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.804381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.804576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.804792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.804907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.804994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.805198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.805382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.805577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.805862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.805966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.806130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.806344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.806584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.806817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.806917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.807003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.807223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.807436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.943 [2024-11-28 15:25:39.807697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.943 [2024-11-28 15:25:39.807808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.943 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.807887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.807999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.808142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.808385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.808693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.808798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.808940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.809136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.809444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.809646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.809862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.809973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.810070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.810283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.810515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.810733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.810895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.810967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 EAL: No free 2048 kB hugepages reported on node 1 00:30:39.944 [2024-11-28 15:25:39.811042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.811217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.811556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.811791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.811960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.812080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.812299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.812600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.812828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.812958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.813066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.813322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.813576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.813790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.813922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.814015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.814101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.814129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.944 [2024-11-28 15:25:39.814249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.814356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.944 [2024-11-28 15:25:39.814383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.944 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.814476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.814592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.814618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.814732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.814857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.814885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.814977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.815214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.815422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.815641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.815759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.815900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.816133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.816396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.816625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.816886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.816975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.817140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.817351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.817573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.817805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.817941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.818027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.818237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.818449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.818651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.818892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.818977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.819098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.819316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.945 qpair failed and we were unable to recover it. 00:30:39.945 [2024-11-28 15:25:39.819554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.945 [2024-11-28 15:25:39.819691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.819803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.819885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.819912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.819987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.820211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.820412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.820613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.820845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.820953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.821026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.821277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.821475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.821700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.821829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.821920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.822205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.822418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.822632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.822823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.822951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.823059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.823263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.823480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.823715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.823824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.823939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.824150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.824334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.824555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.824763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.824871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.824980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.825237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.825466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.825708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.825818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.946 qpair failed and we were unable to recover it. 00:30:39.946 [2024-11-28 15:25:39.825933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.946 [2024-11-28 15:25:39.826009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.826146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.826400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.826599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.826827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.826932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.827018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.827265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.827488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.827705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.827910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.827991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.828115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.828331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.828541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.828783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.828888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.828970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.829209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.829484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.829683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.829892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.829977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.830101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.830346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.830594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.830807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.830920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.831045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.831146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.831173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.947 qpair failed and we were unable to recover it. 00:30:39.947 [2024-11-28 15:25:39.831261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.831369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.947 [2024-11-28 15:25:39.831395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.831508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.831589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.831615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.831729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.831839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.831865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.831961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.832198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.832397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.832574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.832797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.832927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.833051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.833354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.833602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.833818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.833924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.834014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.834302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.834559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.834745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.834906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.834987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.835188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.835418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.835649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.835889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.835993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.836128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.836310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.836523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.836723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.836822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.836929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.837112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.837341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.837532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.948 qpair failed and we were unable to recover it. 00:30:39.948 [2024-11-28 15:25:39.837747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.948 [2024-11-28 15:25:39.837820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.837850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.837990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.838205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.838396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.838605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.838839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.838972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.839055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.839312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.839503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.839812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.839920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.840057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.840271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.840481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.840745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.840878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.840999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.841262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.841493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.841708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.841822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.841908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.842194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.842427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.842627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.842846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.842957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.843069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.843310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.843511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.843753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.843866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.844005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.844119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.844145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.844239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.844354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.949 [2024-11-28 15:25:39.844380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.949 qpair failed and we were unable to recover it. 00:30:39.949 [2024-11-28 15:25:39.844452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.844566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.844591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.844671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.844773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.844799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.844892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.845188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.845414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.845649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.845859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.845973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.846119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.846318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.846518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.846753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.846920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.847062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.847314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.847524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.847792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.847898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.847972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.848194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.848379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.848637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.848853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.848996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.849085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.849244] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:39.950 [2024-11-28 15:25:39.849342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.849539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.849764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.849894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.849971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.850177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.850361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.850544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.950 qpair failed and we were unable to recover it. 00:30:39.950 [2024-11-28 15:25:39.850729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.950 [2024-11-28 15:25:39.850851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.850931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.851124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.851305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.851555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.851756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.851874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.851968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.852199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.852384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.852629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.852868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.852964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.853069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.853288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.853511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.853755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.853864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.853971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.854208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.854428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.854640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.854852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.854965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.855052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.855314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.855561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.855779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.855895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.855986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.856109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.856140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.856265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.856348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.856374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.951 [2024-11-28 15:25:39.856480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.856562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.951 [2024-11-28 15:25:39.856588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.951 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.856706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.856828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.856853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.856936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.857166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.857391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.857613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.857860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.857977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.858070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.858306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.858526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.858723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.858856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.858960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.859173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.859387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.859571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.859819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.859959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.860045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.860246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.860473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.860722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.860831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.860953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.861151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.861361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.861625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.861850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.861967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.862074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.862313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.862497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.952 [2024-11-28 15:25:39.862715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.952 [2024-11-28 15:25:39.862815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.952 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.862911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.863158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.863399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.863646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.863863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.863983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.864127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.864363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.864638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.864863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.864988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.865088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.865295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.865514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.865830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.865937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.866027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.866295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.866607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.866792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.866930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.867041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.867272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.867532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.867785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.867920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.868039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.868305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.868503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.868737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.868852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.868970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.869189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.869446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.953 [2024-11-28 15:25:39.869674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.953 [2024-11-28 15:25:39.869794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.953 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.869882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.869962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.869987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.870071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.870312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.870520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.870762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.870908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.871001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.871285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.871597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.871815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.871917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.872004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.872241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.872499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.872734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.872876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.872988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.873234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.873443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.873702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.873836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.873941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.874183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.874381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.874588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.874816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.874953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.875043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.875241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.875435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.875671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.875883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.875985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.876061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.876162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.876188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.876276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.876391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.954 [2024-11-28 15:25:39.876417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.954 qpair failed and we were unable to recover it. 00:30:39.954 [2024-11-28 15:25:39.876513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.876626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.876652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.876738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.876821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.876847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.876931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.877192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.877401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.877610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.877777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.877890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.878114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.878365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.878583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.878817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.878919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.879034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.879225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.879443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.879638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.879868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.879984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.880122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.880347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.880588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.880837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.880946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.881020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.881294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.881545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.881761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.881927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.882043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.882299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.882512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.882710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.882808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.882931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.883044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.955 [2024-11-28 15:25:39.883070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.955 qpair failed and we were unable to recover it. 00:30:39.955 [2024-11-28 15:25:39.883174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.883356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.883539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.883768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.883875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.883956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.884163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.884362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.884587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.884798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.884933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.885047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.885291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.885518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.885718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.885850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.885941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.886180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.886397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.886645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.886780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.886926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.887117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.887351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.887606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.887738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.887878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.888141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.888344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.888599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.956 qpair failed and we were unable to recover it. 00:30:39.956 [2024-11-28 15:25:39.888827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.956 [2024-11-28 15:25:39.888959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.888989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.889080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.889286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.889472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.889661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.889885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.889992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.890109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.890344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.890560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.890822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.890928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.891038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.891245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.891471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.891666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.891864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.891975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.892120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.892315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.892576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.892799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.892931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.893073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.893302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.893533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.893808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.893926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.894011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.894246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.894466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.894660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.894842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.894985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.895061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.895152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.895178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.957 qpair failed and we were unable to recover it. 00:30:39.957 [2024-11-28 15:25:39.895284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.957 [2024-11-28 15:25:39.895358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.895458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.895689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.895887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.895983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.896076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.896321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.896574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.896794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.896955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.897040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.897270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.897519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.897745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.897848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.897980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.898235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.898426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.898636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.898829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.898926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.899012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.899212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.899428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.899652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.899844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.899949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.900050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.900247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.900512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.900696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.900807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.900919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.901151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.901358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.958 qpair failed and we were unable to recover it. 00:30:39.958 [2024-11-28 15:25:39.901584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.958 [2024-11-28 15:25:39.901684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.901710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.901796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.901905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.901932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.902040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.902241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.902500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.902692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.902804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.902924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.903154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.903393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.903618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.903807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.903950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.904058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.904270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.904519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.904749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.904856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.904969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.905256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.905475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.905678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.905817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.905914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.906142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.906357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.906566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.906795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.906936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.907055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.907300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.907521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.907762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.907867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.907938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.908042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.908068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.959 qpair failed and we were unable to recover it. 00:30:39.959 [2024-11-28 15:25:39.908172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.959 [2024-11-28 15:25:39.908289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.908314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.908440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.908553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.908579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.908721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.908803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.908827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.908920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.908997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.909170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.909373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.909574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.909793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.909897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.909974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.910167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.910345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.910534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.910755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.910889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.910995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.911235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.911444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.911695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.911841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.911961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.912162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.912411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.912606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.912837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.912955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.913059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.913295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.913513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.913801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.913942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.914041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.914244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.914498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.960 qpair failed and we were unable to recover it. 00:30:39.960 [2024-11-28 15:25:39.914720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.960 [2024-11-28 15:25:39.914847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.914876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.914968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.915167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.915407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.915662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.915889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.915994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.916104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.916373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.916627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.916843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.916983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.917068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.917341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.917543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.917843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.917984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.918069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.918300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.918488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.918684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.918898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.918978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.919116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.919314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.919567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.919820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.919980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.920146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.920233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.920260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.920341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.920413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.920439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.961 [2024-11-28 15:25:39.920549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.920643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.961 [2024-11-28 15:25:39.920669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.961 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.920785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.920880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.920910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.921051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.921257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.921485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.921743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.921874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.921948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.922158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.922412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.922664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.922808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.922929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.923118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.923373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.923599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.923792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.923900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.923990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.924214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.924428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.924605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.924832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.924965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.925044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.925266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.925502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.925702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.925835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.925916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.926136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.926360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.926571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.926756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.926860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.962 [2024-11-28 15:25:39.926951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.927032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.962 [2024-11-28 15:25:39.927058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.962 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.927150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.927359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.927600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.927789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.927931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.928042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.928265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.928470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.928722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.928828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.928967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.929222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.929445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.929646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.929793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.929878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.930139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.930352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.930613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.930821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.930962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.931049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.931271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.931501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.931693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.931827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.931966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.932191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.932474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.932732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.932835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.932930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.933198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.933393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.963 [2024-11-28 15:25:39.933623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.963 [2024-11-28 15:25:39.933723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.963 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.933835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.933950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.933976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.934091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.934315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.934580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.934812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.934948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.935091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.935348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.935551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.935804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.935938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.936030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.936234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.936429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.936633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.936848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.936987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.937114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.937326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.937511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.937777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.937893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.937969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.938168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.938360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.938556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.938773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.938902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.938985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.939241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.939448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.939667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.939859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.939995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.940021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.940105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.940204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.964 [2024-11-28 15:25:39.940229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.964 qpair failed and we were unable to recover it. 00:30:39.964 [2024-11-28 15:25:39.940313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.940388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.940414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.940489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.940595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.940620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.940702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.940808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.940834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.940937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.941156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.941350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.941582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.941802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.941950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.942034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.942228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.942422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.942611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:39.965 [2024-11-28 15:25:39.942682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.942766] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:39.965 [2024-11-28 15:25:39.942785] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:39.965 [2024-11-28 15:25:39.942799] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:39.965 [2024-11-28 15:25:39.942813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.942854] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:39.965 [2024-11-28 15:25:39.942921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.943001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.943213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.943410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.943628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.943824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.943957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.944040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.944245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.944468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.944709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.944871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.965 [2024-11-28 15:25:39.944960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.945063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.965 [2024-11-28 15:25:39.945089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.965 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.945236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.945418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.945672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.945853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.945974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.946089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.946207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.946159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:39.966 [2024-11-28 15:25:39.946232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.946219] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:39.966 [2024-11-28 15:25:39.946225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:39.966 [2024-11-28 15:25:39.946348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.946429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.946455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.946561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.946649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.946675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.946766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.950296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.950571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.950880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.950978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.951150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.951404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.951679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.951900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.951991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.952120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.952344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.952580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.952825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.952940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.953037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.953276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.953502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.953741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.953854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.953980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.954234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.954484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.954715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.954891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.954984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.955066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.966 [2024-11-28 15:25:39.955100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.966 qpair failed and we were unable to recover it. 00:30:39.966 [2024-11-28 15:25:39.955193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.957245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.957466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.957720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.957900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.958007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.958254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.958544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.958822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.958950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.959048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.959261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.959495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.959781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.959903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.960030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.962286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.962531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.962814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.962973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.963066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.963331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.963564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.963764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.963886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.964009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.964256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.964499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.964766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.964884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.964983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.965073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.965107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.965193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.966347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.966651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.966894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.966974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.967 [2024-11-28 15:25:39.967003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.967 qpair failed and we were unable to recover it. 00:30:39.967 [2024-11-28 15:25:39.967107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.967192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.967219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.967336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.967429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.967457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.967535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.968106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.968137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.968262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.968356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.968383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.968482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.968574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.968603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.968693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.972305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.972544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.972785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.972940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.973043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.973327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.973534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.973734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.973877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.974003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.974254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.974477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.974692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.974838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.974933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.975151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.975339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.975554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.975748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.975864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.975981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.976206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.976428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.976672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.976903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.976994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.977021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.977158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.977286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.977316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.979106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.979269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.979302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.968 qpair failed and we were unable to recover it. 00:30:39.968 [2024-11-28 15:25:39.979404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.968 [2024-11-28 15:25:39.979505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.979534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.979630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.979758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.979789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.979882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.979976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.980100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.980298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.980516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.980761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.980886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.980986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.981069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.981113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.981211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.981299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.981327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.981416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.981501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.981528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.984106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.984374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.984618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.984829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.984957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.985048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.985315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.985578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.985802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.985908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.985992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.986193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.986388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.986622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.986861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.986969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.987047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.987144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.987173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.987260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.987367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.987394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.987493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.987571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.987597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.987692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.990107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.990146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.990250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.990352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.990382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.990475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.990567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.969 [2024-11-28 15:25:39.990595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.969 qpair failed and we were unable to recover it. 00:30:39.969 [2024-11-28 15:25:39.990687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.990809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.990839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.990920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.991137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.991373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.991608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.991881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.991989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.992109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.992313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.992523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.992760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.992872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.992985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.993074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.993108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.993206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.993301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.993330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.993415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.993510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.993538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.996106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.996333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.996579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.996817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.996975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.997079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.997315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.997519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.997747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.997866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.997980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.998228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.998420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.998634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.970 [2024-11-28 15:25:39.998873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.970 [2024-11-28 15:25:39.998988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.970 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:39.999079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:39.999284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:39.999517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:39.999768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:39.999890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.001169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.001290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.001329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.001453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.001562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.001595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.001696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.001788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.001816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.001912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.002154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.002395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.002611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.002885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.002972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.003102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.003335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.003575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.003794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.003930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.004035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.004264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.004501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.004722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.004843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.004936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.005153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.005389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.005644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.005858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.005983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.006069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.006301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.006514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.971 qpair failed and we were unable to recover it. 00:30:39.971 [2024-11-28 15:25:40.006718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.971 [2024-11-28 15:25:40.006836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.006869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.006950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.007219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.007445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.007661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.007868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.007997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.008124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.008321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.008507] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1121e00 (9): Bad file descriptor 00:30:39.972 [2024-11-28 15:25:40.008655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.008841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.008972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.009268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.009555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.009819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.009947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.010047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.010147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.010180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.010305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.010428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.010467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.010609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.010719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.010759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.010886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.011205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.011435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.011654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.011871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.011982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.012074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.012294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.012488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.012712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.012873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.012988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.013232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.013480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.972 [2024-11-28 15:25:40.013708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.972 [2024-11-28 15:25:40.013834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.972 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.013932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.014180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.014425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.014637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.014877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.014975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.015103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.015357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.015563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.015795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.015922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.016040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.016272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.016499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.016726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.016877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.017004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.017260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.017481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.017698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.017918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.017999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.018117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.018322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.018528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.018749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.018860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.018956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.019174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.019415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.019661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.019884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.019968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.020000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.020127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.020219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.020247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.973 [2024-11-28 15:25:40.020346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.020438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.973 [2024-11-28 15:25:40.020465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.973 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.020588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.020686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.020713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.020796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.020876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.020902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.020990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.021207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.021390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.021604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.021813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.021966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.022049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.022243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.022428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.022654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.022843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.022952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.023029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.023256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.023440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.023629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.023821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.023938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.024020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.024266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.024461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.024670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.024892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.024984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.025142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.025420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.025676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.974 qpair failed and we were unable to recover it. 00:30:39.974 [2024-11-28 15:25:40.025888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.974 [2024-11-28 15:25:40.025974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.026087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.026346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.026597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.026822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.026976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.027078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.027309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.027533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.027771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.027888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.027973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.028223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.028430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.028679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.028891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.028985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.029120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.029346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.029599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.029844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.029961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.030044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.030255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.030458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.030694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.030809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.030915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.031139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.031362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.031575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.031815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.031937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.032033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.032140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.032172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.032273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.032425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.975 [2024-11-28 15:25:40.032454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.975 qpair failed and we were unable to recover it. 00:30:39.975 [2024-11-28 15:25:40.032576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.032732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.032765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.032859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.032979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.033108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.033363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.033613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.033861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.033965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.034056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.034268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.034567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.034782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.034898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.034994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.035241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.035485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.035754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.035867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.035976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.036219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.036433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.036684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.036843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.036931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.037162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.037376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.037621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.037837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.037975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.038082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.038324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.038540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.038768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.038915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.039022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.039115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.039148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.039248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.039336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.976 [2024-11-28 15:25:40.039365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.976 qpair failed and we were unable to recover it. 00:30:39.976 [2024-11-28 15:25:40.039468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.039562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.039589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.039714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.039801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.039832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.039929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.040185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.040450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.040698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.040889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.040976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.041115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.041352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.041563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.041829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.041946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.042034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.042263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.042503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.042785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.042902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.042997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.043204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.043391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.043591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.043783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.043927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.044044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.044232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.044422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.044644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.044872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.044988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.045077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.045269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.045464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.977 qpair failed and we were unable to recover it. 00:30:39.977 [2024-11-28 15:25:40.045679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.977 [2024-11-28 15:25:40.045766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.045791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.045882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.045954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.045979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.046050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.046280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.046484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.046659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.046877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.046982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.047069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.047284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.047479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.047670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.047889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.047996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.048083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.048278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.048477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.048670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.048867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.048968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.049054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.049266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.049464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.049639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.049831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.049941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.050030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.050237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.050447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.050642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.050870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.050975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.051003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.051124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.051228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.051258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.051340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.051426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.978 [2024-11-28 15:25:40.051452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.978 qpair failed and we were unable to recover it. 00:30:39.978 [2024-11-28 15:25:40.051535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.051620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.051645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.051731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.051848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.051874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.051969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.052176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.052363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.052553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.052745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.052853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.052937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.053137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.053322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.053504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.053693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.053877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.053979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.054076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.054295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.054477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.054661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.054851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.054960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.055050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.055244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.055474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.055681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.055864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.055966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.056053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.056170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.056195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.056280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.056359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.056383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.979 qpair failed and we were unable to recover it. 00:30:39.979 [2024-11-28 15:25:40.056468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.979 [2024-11-28 15:25:40.056545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.056569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.056649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.056728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.056753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.056839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.056921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.056952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.057040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.057241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.057418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.057635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.057823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.057922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.058009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.058200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.058445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.058627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.058830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.058941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.059025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.059229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.059412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.059629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.059798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.059894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.059974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.060171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.060359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.060531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.060707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.060813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.060928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.061140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.061359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.061578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.061790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.061887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.061967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.062052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.062077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.980 qpair failed and we were unable to recover it. 00:30:39.980 [2024-11-28 15:25:40.062224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.980 [2024-11-28 15:25:40.062296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.062321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.062415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.062503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.062528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.062650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.062738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.062763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.062883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.062991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.063137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.063333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.063525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.063699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.063898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.063984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.064091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.064283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.064504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.064689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.064889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.064990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.065082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.065279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.065464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.065688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.065875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.065980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.066054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.066289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.066481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.066731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.066911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.066989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.067120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.067306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.067494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.067682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.067797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.067908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.068021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.981 [2024-11-28 15:25:40.068047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.981 qpair failed and we were unable to recover it. 00:30:39.981 [2024-11-28 15:25:40.068141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.068340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.068521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.068700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.068874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.068980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.069066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.069256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.069436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.069645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.069829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.069934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.070014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.070235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.070422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.070608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.070820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.070924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.071016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.071240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.071431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.071614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.071796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.071938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.072025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.072210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.072405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.072604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.072794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.072895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.072980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.073181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.073397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.982 [2024-11-28 15:25:40.073629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.982 [2024-11-28 15:25:40.073725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.982 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.073839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.073910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.073935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.074020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.074222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.074406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.074606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.074797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.074896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.074999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.075242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.075453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.075704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.075811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.075904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.076165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.076375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.076590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.076768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.076898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.077014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.077232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.077435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.077622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.077810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.077912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.078004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.078203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.078400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.078582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.078797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.078905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.983 qpair failed and we were unable to recover it. 00:30:39.983 [2024-11-28 15:25:40.078980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.983 [2024-11-28 15:25:40.079066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.079185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.079407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.079588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.079801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.079907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.079990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.080185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.080369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.080560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.080740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.080840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.080944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.081191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.081419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.081610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.081783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.081911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.082005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.082194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.082381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.082565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.082752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.082857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.082938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.083108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.083297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.083496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.083680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.083863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.083991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.984 [2024-11-28 15:25:40.084104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.084177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.984 [2024-11-28 15:25:40.084201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.984 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.084279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.084448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.084674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.084893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.084980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.085124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.085344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.085531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.085749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.085852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.085929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.086136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.086361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.086551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.086778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.086884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.086966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.087163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.087366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.087561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.087772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.087870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.087950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.088172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.088360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.088575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.088778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.088881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.088970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.089195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.089405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.089589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.089779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.089886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.089991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.090090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.090124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.090209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.090291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.985 [2024-11-28 15:25:40.090317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.985 qpair failed and we were unable to recover it. 00:30:39.985 [2024-11-28 15:25:40.090407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.090493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.090519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.090602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.090686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.090712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.090793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.090871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.090898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.090995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.091228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.091447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.091672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.091886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.091992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.092078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.092314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.092484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.092663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.092840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.092937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.093017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.093218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.093395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.093579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.093763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.093892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.093983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.094168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.094350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.094546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.094734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.094881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.094956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.095148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.095339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.095538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.095716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.095907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.095993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.096024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.096147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.096237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.096262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.096346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.096427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.986 [2024-11-28 15:25:40.096452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.986 qpair failed and we were unable to recover it. 00:30:39.986 [2024-11-28 15:25:40.096531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.096613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.096638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.096715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.096792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.096818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.096894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.096968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.096993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.097070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.097276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.097456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.097664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.097855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.097967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.098054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.098246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.098460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.098642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.098821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.098931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.099010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.099205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.099438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.099618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.099833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.099939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.100026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.100225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.100416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.100642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.100859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.100968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.101056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.101285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.101484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.101679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.101902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.101987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.102131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.102318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.102503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.987 qpair failed and we were unable to recover it. 00:30:39.987 [2024-11-28 15:25:40.102705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.987 [2024-11-28 15:25:40.102805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.102882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.102959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.102984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.103072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.103276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.103503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.103693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.103914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.103995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.104111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.104303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.104485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.104674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.104864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.104971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.105057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.105262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.105481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.105676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.105814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.105899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.106127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.106318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.106507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.106681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.106879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.106980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.107061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.107161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.107187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.988 qpair failed and we were unable to recover it. 00:30:39.988 [2024-11-28 15:25:40.107266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.107351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.988 [2024-11-28 15:25:40.107377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.107473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.107549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.107573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.107681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.107757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.107781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.107856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.107934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.107958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.108039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.108231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.108418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.108619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.108843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.108953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.109029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.109233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.109434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.109610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.109797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.109896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.109990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.110183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.110367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.110564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.110756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.110856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.110932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.111139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.111326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.989 qpair failed and we were unable to recover it. 00:30:39.989 [2024-11-28 15:25:40.111530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.989 [2024-11-28 15:25:40.111644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.111668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.111754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.111832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.111856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.111935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.112169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.112365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.112541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.112732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.112869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.112950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.113142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.113344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.113579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.113805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.113914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.114001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.114225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.114476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.114681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.114900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.114997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.115139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.115348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.115576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.115797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.115924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.116011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.116235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.116465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.116675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.116793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.116898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.117149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.117370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.990 [2024-11-28 15:25:40.117589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.990 [2024-11-28 15:25:40.117713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.990 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.117804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.117906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.117939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.118029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.118251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.118434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.118621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.118815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.118922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.119015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.119211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.119400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.119617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.119790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.119892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.119974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.120210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.120423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.120628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.120818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.120923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.121011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.121243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.121420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.121614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.121799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.121937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.122012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.122189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.122360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.122584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.122773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.122873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.122958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.123042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.123067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.123162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.123246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.123270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.991 qpair failed and we were unable to recover it. 00:30:39.991 [2024-11-28 15:25:40.123356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.991 [2024-11-28 15:25:40.123433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.123458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.123538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.123619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.123644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.123727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.123806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.123835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.123916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.123990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.124109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.124311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.124531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.124712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.124912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.124989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.125109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.125316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.125521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.125708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.125825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.125970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.126150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.126338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.126572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.126749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.126881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.126964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.127167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.127348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.127539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.127759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.127866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.127946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.128137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.128322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.128537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.128731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.128909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.128989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.129013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.992 qpair failed and we were unable to recover it. 00:30:39.992 [2024-11-28 15:25:40.129109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.992 [2024-11-28 15:25:40.129191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.129307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.129515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.129707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.129903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.129985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.130106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.130291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.130503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.130697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.130900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.130979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.131082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.131282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.131464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.131687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.131879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.131986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.132069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.132266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.132452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.132632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.132820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.132937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.133038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.133239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.133430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.133616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.993 [2024-11-28 15:25:40.133725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.993 qpair failed and we were unable to recover it. 00:30:39.993 [2024-11-28 15:25:40.133815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.133911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.133947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.134019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.134234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.134424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.134614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.134796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.134895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.134991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.135183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.135355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.135566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.135791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.135893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.135978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.136199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.136390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.136598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.136787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.136886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.136958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.137137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.137349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.137532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.137738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.137841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.137930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.138123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.138327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.138525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.138745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.138844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.138924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.139011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.139036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.139125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.139204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.139229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.994 qpair failed and we were unable to recover it. 00:30:39.994 [2024-11-28 15:25:40.139308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.139404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.994 [2024-11-28 15:25:40.139429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.139505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.139583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.139607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.139695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.139773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.139799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.139889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.139996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.140127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.140314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.140496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.140679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.140869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.140976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.141060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.141263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.141453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.141661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.141846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.141954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.142030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.142229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.142423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.142630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.142809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.142909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.142985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.143211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.143394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.143603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.143814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.143951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.144032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.144231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.144424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.144636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.144811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.144917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.995 qpair failed and we were unable to recover it. 00:30:39.995 [2024-11-28 15:25:40.145005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.995 [2024-11-28 15:25:40.145082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.145201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.145418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.145641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.145812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.145935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.146181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.146391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.146614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.146803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.146911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.146985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.147183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.147360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.147559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.147791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.147910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.148003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.148308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.148513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.148792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.148903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.148985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.149189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.149381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.149574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.149790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.149917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:39.996 [2024-11-28 15:25:40.150031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.150122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:39.996 [2024-11-28 15:25:40.150160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:39.996 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.150241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.150449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.150640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.150873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.150973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.151049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.151271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.151466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.151663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.151861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.151966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.152061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.152158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.152184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.152275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.152355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.152379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.285 [2024-11-28 15:25:40.152459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.152532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.285 [2024-11-28 15:25:40.152557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.285 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.152678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.152749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.152773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.152860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.152932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.152957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.153038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.153234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.153407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.153582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.153764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.153865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.153948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.154161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.154355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.154546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.154731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.154907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.154988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.155112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.155320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.155563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.155753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.155860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.155932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.156011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.156036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.156132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.156209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.156234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.286 qpair failed and we were unable to recover it. 00:30:40.286 [2024-11-28 15:25:40.156308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.156457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.286 [2024-11-28 15:25:40.156482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.156562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.156639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.156664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.156740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.156820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.156846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.156930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.157116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.157306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.157512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.157689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.157885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.157983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.158068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.158322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.158557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.158776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.158904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.158999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.159184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.159408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.159594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.159793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.159899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.159976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.160052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.160075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.160192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.160266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.287 [2024-11-28 15:25:40.160295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.287 qpair failed and we were unable to recover it. 00:30:40.287 [2024-11-28 15:25:40.160406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.160487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.160511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.160587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.160672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.160697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.160780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.160861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.160896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.160973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.161184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.161362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.161553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.161735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.161842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.161960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.162158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.162356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.162574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.162755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.162858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.162958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.163247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.163466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.163709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.163821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.163911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.164000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.164029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.164169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.164260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.164288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.288 qpair failed and we were unable to recover it. 00:30:40.288 [2024-11-28 15:25:40.164375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.164480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.288 [2024-11-28 15:25:40.164506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.164604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.164677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.164702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.164787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.164889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.164914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.164987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.165175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.165377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.165567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.165756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.165859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.165944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.166165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.166350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.166545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.166763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.166868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.166953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.167182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.167376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.167548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.167746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.167885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.167987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.168173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.168392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.168612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.168824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.168940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.169062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.169264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.169500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.169713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.169866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.169960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.170045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.289 [2024-11-28 15:25:40.170070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.289 qpair failed and we were unable to recover it. 00:30:40.289 [2024-11-28 15:25:40.170150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.170360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.170546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.170752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.170854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.170944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.171177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.171371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.171574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.171797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.171903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.171985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.172166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.172409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.172634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.172859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.172957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.173034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.173230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.173428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.173637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.173854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.173958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.174038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.174237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.174456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.174670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.174878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.174975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.175082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.175303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.175486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.175672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.290 [2024-11-28 15:25:40.175811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.290 qpair failed and we were unable to recover it. 00:30:40.290 [2024-11-28 15:25:40.175887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.176129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.176323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.176531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.176739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.176849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.176961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.177177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.177400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.177585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.177758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.177859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.177931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.178172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.178350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.178540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.178708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.178887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.178991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.179109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.179190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.179214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.179298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.179420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.179444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.291 qpair failed and we were unable to recover it. 00:30:40.291 [2024-11-28 15:25:40.179530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.291 [2024-11-28 15:25:40.179614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.179638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.179750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.179826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.179850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.179934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.180134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.180307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.180489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.180707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.180888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.180996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.181085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.181316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.181536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.181713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.181888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.181993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.182079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.182256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.182451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.182622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.182828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.182927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.183015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.183125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.183150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.183230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.183397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.183422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.292 qpair failed and we were unable to recover it. 00:30:40.292 [2024-11-28 15:25:40.183510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.183624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.292 [2024-11-28 15:25:40.183650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.183742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.183820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.183846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.183922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.184182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.184366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.184596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.184792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.184928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.185015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.185228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.185451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.185697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.185913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.185999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.186100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.186297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.186537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.186715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.186853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.186939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.187129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.187310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.187490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.293 [2024-11-28 15:25:40.187666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.293 [2024-11-28 15:25:40.187769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.293 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.187868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.187984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.188105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.188272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.188452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.188653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.188857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.188956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.189034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.189254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.189444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.189661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.189883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.189995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.190073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.190293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.190485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.190662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.190856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.190957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.191049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.191241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.191448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.294 [2024-11-28 15:25:40.191678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.294 [2024-11-28 15:25:40.191789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.294 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.191862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.191948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.191976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.192055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.192275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.192456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.192646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.192825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.192937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.193019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.193215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.193403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.193620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.193803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.193923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.194045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.194238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.194414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.194602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.194809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.194911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.194992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.195253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.195435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.295 qpair failed and we were unable to recover it. 00:30:40.295 [2024-11-28 15:25:40.195618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.295 [2024-11-28 15:25:40.195721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.195812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.195892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.195917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.195993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.196195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.196421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.196618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.196797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.196904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.196985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.197236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.197425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.197652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.197869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.197974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.198064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.198300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.198500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.198703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.198900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.198984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.199081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.199298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.199487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.296 qpair failed and we were unable to recover it. 00:30:40.296 [2024-11-28 15:25:40.199683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.296 [2024-11-28 15:25:40.199768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.199793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.199878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.199957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.199982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.200078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.200301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.200546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.200731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.200825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.200906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.201117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.201316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.201517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.201721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.201905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.201980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.202084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.202313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.202555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.202742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.202852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.297 qpair failed and we were unable to recover it. 00:30:40.297 [2024-11-28 15:25:40.202989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.297 [2024-11-28 15:25:40.203082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.203200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.203387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.203574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.203752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.203855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.203975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.204176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.204388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.204594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.204776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.204924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.205005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.205225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.205442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.205624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.205807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.205909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.205992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.206174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.206356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.206577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.206760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.206863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.298 qpair failed and we were unable to recover it. 00:30:40.298 [2024-11-28 15:25:40.206932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.298 [2024-11-28 15:25:40.207012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.207119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.207308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.207516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.207736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.207840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.207930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.208143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.208327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.208533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.208729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.208838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.208934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.209177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.209399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.209591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.209857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.209956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.210027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.210270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.210473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.210668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.210868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.210987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.299 qpair failed and we were unable to recover it. 00:30:40.299 [2024-11-28 15:25:40.211062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.299 [2024-11-28 15:25:40.211189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.211331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.211508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.211704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.211909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.211992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.212108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.212289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.212462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.212653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.212853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.212956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.213047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.213237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.213425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.213600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.213776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.213888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.213978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.214185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.214406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.214602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.214779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.214887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.300 qpair failed and we were unable to recover it. 00:30:40.300 [2024-11-28 15:25:40.215033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.300 [2024-11-28 15:25:40.215174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.215290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.215469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.215720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.215910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.215978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.216090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.216297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.216525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.216699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.216881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.216987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.217075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.217263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.217464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.217672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.217856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.217958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.218044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.218242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.218463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.218646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.218823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.218922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.301 qpair failed and we were unable to recover it. 00:30:40.301 [2024-11-28 15:25:40.219002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.301 [2024-11-28 15:25:40.219109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.219226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.219420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.219598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.219774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.219931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.220020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.220209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.220461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.220674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.220769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.220841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.221152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.221388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.221593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.221770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.221872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.221979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.222267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.222453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.222646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.222819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.222956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.223058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.223149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.223174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.302 qpair failed and we were unable to recover it. 00:30:40.302 [2024-11-28 15:25:40.223250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.302 [2024-11-28 15:25:40.223339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.223466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.223678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.223869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.223967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.224039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.224299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.224485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.224672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.224857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.224991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.225071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.225264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.225457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.225658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.225880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.225989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.226098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.226306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.226542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.226767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.226873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.227002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.227115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.227141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.227245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.227357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.227383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.303 qpair failed and we were unable to recover it. 00:30:40.303 [2024-11-28 15:25:40.227456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.303 [2024-11-28 15:25:40.227536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.227561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.227685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.227787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.227812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.227889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.227968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.227992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.228109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.228368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.228566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.228782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.228882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.228967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.229161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.229338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.229560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.229777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.229889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.229976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.230172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.230379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.230564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.304 qpair failed and we were unable to recover it. 00:30:40.304 [2024-11-28 15:25:40.230763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.304 [2024-11-28 15:25:40.230875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.230952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.231157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.231404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.231627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.231818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.231930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.232014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.232215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.232406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.232655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.232805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.232906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.233249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.233578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.233890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.233974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.234100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.234342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.234566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.234884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.234994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.235189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.235344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.235372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.235460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.235569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.235597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.305 qpair failed and we were unable to recover it. 00:30:40.305 [2024-11-28 15:25:40.235680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.235776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.305 [2024-11-28 15:25:40.235807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.235930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.236289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.236503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.236737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.236843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.236949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.237164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.237381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.237624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.237832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.237930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.238040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.238241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.238421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.238611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.238826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.238929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.239014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.239230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.239411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.239617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.239812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.239940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.306 qpair failed and we were unable to recover it. 00:30:40.306 [2024-11-28 15:25:40.240016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.306 [2024-11-28 15:25:40.240097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.240206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.240384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.240590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.240894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.240990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.241155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.241332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.241543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.241727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.241891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.242006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.242212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.242410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.242624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.242862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.242962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.243040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.243223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.243409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.243593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.243801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.243903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.243984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.244060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.244085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.307 qpair failed and we were unable to recover it. 00:30:40.307 [2024-11-28 15:25:40.244174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.307 [2024-11-28 15:25:40.244282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.244432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.244623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.244857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.244956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.245038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.245252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.245432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.245647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.245857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.245968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.246049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.246252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.246444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.246622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.246838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.246971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.247058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.247243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.247495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.247729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.247908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.247977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.248002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.248076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.248223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.248248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.308 qpair failed and we were unable to recover it. 00:30:40.308 [2024-11-28 15:25:40.248331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.308 [2024-11-28 15:25:40.248453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.248478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.248563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.248644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.248669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.248747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.248824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.248848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.248933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.249145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.249334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.249571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.249775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.249878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.249963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.250173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.250365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.250581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.250801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.250921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.251008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.251208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.251383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.251624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.251914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.251986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.252011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.252163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.252242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.252267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.252342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.252412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.252437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.309 qpair failed and we were unable to recover it. 00:30:40.309 [2024-11-28 15:25:40.252626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.309 [2024-11-28 15:25:40.252698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.252722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.252834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.252907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.252936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.253124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.253312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.253337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.253526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.253605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.253632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.253731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.253821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.253846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.253924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.254109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.254298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.254485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.254711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.254873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.254955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.255146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.255343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.255547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.255750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.255852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.255934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.256020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.256045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.310 qpair failed and we were unable to recover it. 00:30:40.310 [2024-11-28 15:25:40.256135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.256217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.310 [2024-11-28 15:25:40.256242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.256320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.256404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.256428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.256503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.256622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.256647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.256724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.256795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.256820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.256923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.257120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.257341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.257551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.257730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.257822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.257939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.258154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.258365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.258573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.258780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.258875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.258980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.259227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.259396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.259643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.259813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.259949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.260021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.260116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.260141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.311 qpair failed and we were unable to recover it. 00:30:40.311 [2024-11-28 15:25:40.260253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.260324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.311 [2024-11-28 15:25:40.260348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.260452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.260528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.260553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.260640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.260745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.260769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.260846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.260922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.260947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.261057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.261248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.261471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.261662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.261872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.261970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.262048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.262283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.262459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.262638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.262818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.262911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.262987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.263169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.263423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.263617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.263759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.263951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.264182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.264398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.312 qpair failed and we were unable to recover it. 00:30:40.312 [2024-11-28 15:25:40.264628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.312 [2024-11-28 15:25:40.264701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.264725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.264820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.264939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.264964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.265043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.265232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.265492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.265759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.265870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.265954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.266191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.266420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.266690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.266793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.266906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.267160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.267362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.267580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.267803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.267910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.267995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.268226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.268403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.268612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.268792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.268892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.269031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.269226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.269403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.269622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.269823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.269928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.270014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.270204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.270425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.270640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.313 qpair failed and we were unable to recover it. 00:30:40.313 [2024-11-28 15:25:40.270827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.313 [2024-11-28 15:25:40.270934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.270958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.271036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.271224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.271439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.271624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.271801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.271930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.272039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.272218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.272464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.272637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.272823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.272954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.273030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.273246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.273414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.273632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.273805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.273900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.273979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.274171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.274389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.274600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.274783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.274913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.274984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.275176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.275359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.275562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.275771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.275876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.275960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.276154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.276347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.314 qpair failed and we were unable to recover it. 00:30:40.314 [2024-11-28 15:25:40.276535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.314 [2024-11-28 15:25:40.276616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.276642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.276750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.276870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.276895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.276986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.277181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.277434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.277611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.277827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.277928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.278007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.278224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.278411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.278586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.278819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.278917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.279027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.279219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.279425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.279607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.279791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.279882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.279993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.280181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.280402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.280629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.280829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.280962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.281042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.281299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.281501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.281688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.281801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.281914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.282151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.282336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.315 qpair failed and we were unable to recover it. 00:30:40.315 [2024-11-28 15:25:40.282524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.315 [2024-11-28 15:25:40.282605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.282630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.282733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.282805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.282830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.282910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.282996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.283155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.283359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.283541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.283721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.283855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.283936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.284124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.284300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.284523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.284740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.284917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.284988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.285105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.285318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.285503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.285758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.285907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.285989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.286172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.286430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.286634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.286852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.286962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.287046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.287274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.287493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.316 qpair failed and we were unable to recover it. 00:30:40.316 [2024-11-28 15:25:40.287696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.316 [2024-11-28 15:25:40.287832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.287857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.287930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.288110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.288329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.288533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.288723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.288916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.288995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.289103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.289317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.289510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.289687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.289861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.289967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.290045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.290221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.290404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.290582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.290794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.290891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.290964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.291145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.291337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.291520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.291735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.291838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.291918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.292131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.292321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.292534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.292715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.292821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.292935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.293007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.293031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.293111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.293198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.293223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.317 qpair failed and we were unable to recover it. 00:30:40.317 [2024-11-28 15:25:40.293330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.317 [2024-11-28 15:25:40.293404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.293428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.293511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.293582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.293606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.293747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.293828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.293853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.293936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.294160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.294366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.294601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.294812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.294964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.295045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.295243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.295466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.295692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.295831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.295913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.296140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.296364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.296535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.296790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.296892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.296980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.297206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.297386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.297599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.297824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.297921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.298024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.298208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.298425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.298607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.298814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.298940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.299023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.299123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.299153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.299242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.299319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.299344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.318 qpair failed and we were unable to recover it. 00:30:40.318 [2024-11-28 15:25:40.299462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.318 [2024-11-28 15:25:40.299571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.299597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.299671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.299786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.299810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.299888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.299958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.299983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.300108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.300287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.300471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.300716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.300890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.300992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.301080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.301267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.301436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.301620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.301842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.301956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.302070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.302273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.302444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.302659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.302836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.302962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.303048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.303266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.303451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.303622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.303858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.303967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.304050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.304239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.304446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.304649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.304859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.304990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.305069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.305157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.319 [2024-11-28 15:25:40.305183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.319 qpair failed and we were unable to recover it. 00:30:40.319 [2024-11-28 15:25:40.305279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.305380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.305411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.305493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.305635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.305660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.305773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.305844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.305869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.305957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.306171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.306384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.306561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.306738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.306916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.306987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.307104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.307281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.307462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.307672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.307856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.307949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.308022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.308234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.308452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.308663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.308880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.308976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.309052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.309298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.309512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.309733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.309830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.309954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.310034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.310059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.310158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.310232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.310257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.320 qpair failed and we were unable to recover it. 00:30:40.320 [2024-11-28 15:25:40.310363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.320 [2024-11-28 15:25:40.310475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.310500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.310585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.310663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.310688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.310770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.310841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.310866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.310972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.311157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.311347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.311532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.311740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.311838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.311913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.312144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.312325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.312548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.312736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.312879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.312964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.313165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.313348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.313630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.313805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.313914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.313994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.314178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.314354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.314558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.314751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.314849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.314934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.315121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.315346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.315547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.315718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.315897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.315979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.316004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.321 qpair failed and we were unable to recover it. 00:30:40.321 [2024-11-28 15:25:40.316122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.321 [2024-11-28 15:25:40.316201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.316305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.316515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.316709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.316898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.316999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.317084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.317358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.317533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.317784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.317878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.317958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.318217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.318441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.318618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.318826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.318958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.319064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.319244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.319452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.319623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.319810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.319909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.320049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.320219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.320410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.320619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.320834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.320934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.321034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.321250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.321458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.321692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.321816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.321942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.322018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.322043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.322 qpair failed and we were unable to recover it. 00:30:40.322 [2024-11-28 15:25:40.322135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.322 [2024-11-28 15:25:40.322214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.322319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.322493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.322667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.322845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.322938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.323045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.323234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.323409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.323638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.323849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.323987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.324067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.324249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.324470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.324680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.324889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.324988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.325110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.325294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.325518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.325697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.325836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.325919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.326144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.326324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.326537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.326714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.326829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.326907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.327145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.327332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.327572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.327754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.327858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.323 qpair failed and we were unable to recover it. 00:30:40.323 [2024-11-28 15:25:40.327954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.323 [2024-11-28 15:25:40.328111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.328231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.328428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.328612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.328796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.328898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.329021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.329274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.329468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.329711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.329811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.329923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.330143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.330431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.330598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.330783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.330892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.330970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.331156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.331384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.331570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.331775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.331991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.332065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.332287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.332494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.332675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.332861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.332957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.333033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.333215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.333438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.333685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.333870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.333978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.324 [2024-11-28 15:25:40.334002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.324 qpair failed and we were unable to recover it. 00:30:40.324 [2024-11-28 15:25:40.334097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.334282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.334468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.334644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.334852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.334960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.335041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.335241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.335477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.335683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.335886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.335980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.336083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.336291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.336473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.336701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.336800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.336926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.337149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.337340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.337568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.337767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.337872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.337982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.338178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.338401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.338654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.338874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.338984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.339076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.339161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.339188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.325 qpair failed and we were unable to recover it. 00:30:40.325 [2024-11-28 15:25:40.339305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.339386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.325 [2024-11-28 15:25:40.339411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.339491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.339603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.339628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.339720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.339804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.339829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.339910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.339991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.340102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.340291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.340494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.340689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.340889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.340992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.341116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.341300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.341516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.341818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.341953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.342033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.342300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.342504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.342758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.342885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.343022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.343219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.343402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.343580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.343830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.343926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.343997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.344256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.344437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.344686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.344876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.344973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.345053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.345131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.345157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.345262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.345338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.345364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.326 qpair failed and we were unable to recover it. 00:30:40.326 [2024-11-28 15:25:40.345444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.326 [2024-11-28 15:25:40.345524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.345549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.345632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.345739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.345764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.345841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.345919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.345944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.346026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.346226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.346487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.346699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.346839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.346921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.347153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.347363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.347546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.347737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.347868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.347951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.348146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.348345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.348571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.348784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.348886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.348970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.349173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.349393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.349585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.349800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.349903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.349991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.350212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.350421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.350603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.350785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.350890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.351007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.351085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.351117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.351234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.351307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.327 [2024-11-28 15:25:40.351332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.327 qpair failed and we were unable to recover it. 00:30:40.327 [2024-11-28 15:25:40.351423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.351507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.351533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.351625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.351698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.351724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.351835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.351947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.351974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.352062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.352255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.352471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.352682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.352794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.352909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.353126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.353331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.353564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.353747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.353851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.353984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.354177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.354438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.354636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.354855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.354960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.355041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.355252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.355443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.355667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.355856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.355953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.356041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.356265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.356493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.356706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.356815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.356889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.357017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.357042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.357126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.357197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.357222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.328 qpair failed and we were unable to recover it. 00:30:40.328 [2024-11-28 15:25:40.357325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.328 [2024-11-28 15:25:40.357438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.357465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.357543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.357617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.357643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.357725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.357832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.357857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.357966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.358141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.358337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.358520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.358732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.358849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.358922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.359150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.359410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.359601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.359783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.359912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.359989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.360220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.360434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.360645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.360856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.360956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.361037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.361259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.361436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.361650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.361861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.361995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.362074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.362293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.362487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.362697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.329 [2024-11-28 15:25:40.362797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.329 qpair failed and we were unable to recover it. 00:30:40.329 [2024-11-28 15:25:40.362908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.362985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.363122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.363338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.363545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.363718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.363834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.363913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.364133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.364339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.364606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.364832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.364985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.365066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.365327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.365513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.365730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.365828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.365904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.366164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.366379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.366632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.366864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.366976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.367099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.367316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.367495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.367682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.367887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.367993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.368082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.368317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.368509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.368722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.368903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.368978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.369005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.369120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.369235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.369261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.369342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.369453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.330 [2024-11-28 15:25:40.369478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.330 qpair failed and we were unable to recover it. 00:30:40.330 [2024-11-28 15:25:40.369559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.369640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.369665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.369743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.369869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.369894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.369981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.370176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.370406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.370625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.370865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.370968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.371046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.371225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.371443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.371636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.371817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.371956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.372061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.372264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.372487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.372691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.372874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.372979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.373081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.373304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.373478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.373683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.373788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.373928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.374127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.374348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.374570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.374757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.374860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.374969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.375224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.375408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.375606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.375796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.331 [2024-11-28 15:25:40.375900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.331 qpair failed and we were unable to recover it. 00:30:40.331 [2024-11-28 15:25:40.375980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.376185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.376368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.376557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.376743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.376847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.376959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.377167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.377384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.377589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.377797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.377907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.377983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.378196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.378400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.378589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.378800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.378934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.379028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.379245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.379434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.379616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.379831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.379932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.380012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.380210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.380435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.380652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.380827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.380932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.381049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.381239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.381415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.381595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.381819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.381920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.382019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.382128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.382154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.382234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.382323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.382350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.382459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.382534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.332 [2024-11-28 15:25:40.382559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.332 qpair failed and we were unable to recover it. 00:30:40.332 [2024-11-28 15:25:40.382689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.382771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.382796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.382875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.382981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.383090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.383277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.383501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.383687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.383862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.383999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.384084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.384273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.384455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.384674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.384866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.384979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.385126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.385357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.385534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.385719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.385852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.385959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.386175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.386382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.386566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.386804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.386945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.387053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.387288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.387468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.387684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.387855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.387960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.388038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.388255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.388448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.333 [2024-11-28 15:25:40.388649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.333 [2024-11-28 15:25:40.388750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.333 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.388835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.388920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.388947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.389033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.389228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.389479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.389676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.389887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.389986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.390109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.390306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.390480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.390691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.390791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.390904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.391125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.391324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.391502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.391679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.391888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.391991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.392066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.392259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.392481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.392703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.392811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.392927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.393116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.393320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.393506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.393724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.393856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.393931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.394160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.394376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.394561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.394803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.394903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.395016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.395219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.395452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.334 qpair failed and we were unable to recover it. 00:30:40.334 [2024-11-28 15:25:40.395660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.334 [2024-11-28 15:25:40.395764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.395789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.395904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.395981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.396100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.396337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.396538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.396710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.396904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.396980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.397082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.397323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.397504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.397696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.397827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.397933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.398116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.398302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.398515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.398726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.398844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.398937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.399147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.399378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.399570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.399757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.399925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.400051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.400236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.400473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.400651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.400860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.400994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.401064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.401340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.401537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.401717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.401822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.401911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.402133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.402324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.402504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.335 [2024-11-28 15:25:40.402606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.335 qpair failed and we were unable to recover it. 00:30:40.335 [2024-11-28 15:25:40.402747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.402853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.402878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.402960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.403233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.403435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.403640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.403873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.403982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.404085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.404278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.404491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.404678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.404860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.404965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.405046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.405236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.405419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.405674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.405858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.405962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.406073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.406288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.406518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.406733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.406868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.406944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.407169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.407351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.407576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.407789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.407889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.407973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.408218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.408418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.408631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.408880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.408982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.409064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.409250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.409492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.336 qpair failed and we were unable to recover it. 00:30:40.336 [2024-11-28 15:25:40.409689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.336 [2024-11-28 15:25:40.409796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.409821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.409944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.410139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.410357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.410602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.410813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.410921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.411010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.411250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.411478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.411696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.411910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.411990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.412117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.412315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.412497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.412694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.412874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.412992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.413103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.413284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.413507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.413686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.413899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.413979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.414090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.414291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.414518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.414700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.414896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.414998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.415073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.415271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.415441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.415642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.415887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.415996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.416021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.337 qpair failed and we were unable to recover it. 00:30:40.337 [2024-11-28 15:25:40.416138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.416211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.337 [2024-11-28 15:25:40.416237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.416352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.416438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.416464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.416575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.416655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.416680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.416786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.416858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.416883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.416978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.417173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.417387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.417579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.417760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.417862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.417969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.418046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.418071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.338 [2024-11-28 15:25:40.418191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.418277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.338 [2024-11-28 15:25:40.418302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.338 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.418383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.418492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.418518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.418609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.418689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.418716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.418803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.418908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.418933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.419023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.419234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.419453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.419679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.419863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.419963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.420079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.420303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.420546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.420731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.420863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.420975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.421164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.421342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.421554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.421773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.421867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.421943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.422122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.422329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.422537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.422720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.422818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.422929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.423136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.423353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.423596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.423808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.423942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.424024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.424227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.424426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.424682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.424846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.424955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.425139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.425373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.425575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.339 qpair failed and we were unable to recover it. 00:30:40.339 [2024-11-28 15:25:40.425799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.339 [2024-11-28 15:25:40.425881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.425905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.425998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.426185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.426398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.426628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.426841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.426942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.427016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.427212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.427400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.427588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.427764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.427866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.427938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.428119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.428328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.428500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.428705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.428910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.428986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.429130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.429332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.429529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.429777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.429885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.429968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.430202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.430396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.430573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.430802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.430904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.431016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.431208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.431421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.431662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.431842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.431945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.432021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.432216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.432438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.432640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.432857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.432970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.340 qpair failed and we were unable to recover it. 00:30:40.340 [2024-11-28 15:25:40.433111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.340 [2024-11-28 15:25:40.433195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.433307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.433517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.433716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.433898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.433992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.434066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.434244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.434455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.434696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.434902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.434981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.435086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.435278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.435467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.435648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.435824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.435929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.436014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.436251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.436478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.436722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.436827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.436937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.437114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.437324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.437545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.437761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.437862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.437938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.438157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.438330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.438538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.438779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.438893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.438969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.439199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.439405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.439613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.439791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.439921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.440008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.440081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.440113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.341 [2024-11-28 15:25:40.440192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.440267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.341 [2024-11-28 15:25:40.440291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.341 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.440371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.440519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.440543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.440627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.440754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.440779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.440890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.440963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.440987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.441070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.441323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.441526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.441742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.441840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.441954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.442214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.442390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.442604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.442816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.442914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.442999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.443189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.443398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.443612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.443795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.443892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.443996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.444196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.444448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.444674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.444845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.444982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.445062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.445287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.445504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.445698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.445830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.445933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.446122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.446318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.342 qpair failed and we were unable to recover it. 00:30:40.342 [2024-11-28 15:25:40.446535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.342 [2024-11-28 15:25:40.446622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.446647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.446725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.446802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.446826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.446901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.446973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.446998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.447074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.447248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.447459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.447645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.447827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.447931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.448010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.448208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.448415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.448592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.448762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.448858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.448930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.449152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.449365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.449577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.449760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.449893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.450012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.450205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.450417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.450654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.450858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.450958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.451033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.451265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.451470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.451698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.451864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.451961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.452035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.452245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.452422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.452604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.452812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.452945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.453031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.453308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.453522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.343 qpair failed and we were unable to recover it. 00:30:40.343 [2024-11-28 15:25:40.453732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.343 [2024-11-28 15:25:40.453809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.453834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.453914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.454158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.454368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.454573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.454786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.454884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.454973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.455162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.455345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.455534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.455761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.455888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.455967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.456183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.456368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.456603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.456780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.456942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.457019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.457246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.457434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.457654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.457837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.457941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.458012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.458226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.458439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.458640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.458852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.458950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.459028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.459223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.459392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.459576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.459839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.459941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.460036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.460252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.460492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.460698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.460801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.460911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.461025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.461049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.344 qpair failed and we were unable to recover it. 00:30:40.344 [2024-11-28 15:25:40.461137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.461214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.344 [2024-11-28 15:25:40.461239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.461311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.461383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.461408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.461520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.461635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.461660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.461732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.461843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.461868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.461945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.462197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.462376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.462553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.462735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.462919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.462994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.463105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.463326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.463529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.463729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.463907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.463978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.464106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.464342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.464552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.464732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.464842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.464934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.465113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.465323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.465505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.465732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.465837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.465919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.466125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.466354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.466547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.466716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.466853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.466960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.467154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.467344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.467533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.345 [2024-11-28 15:25:40.467640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.345 qpair failed and we were unable to recover it. 00:30:40.345 [2024-11-28 15:25:40.467712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.467788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.467814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.467887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.467965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.467990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.468085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.468295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.468488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.468677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.468855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.468951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.469023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.469208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.469430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.469594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.469804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.469935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.470046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.470237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.470446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.470672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.470855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.470964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.471038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.471232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.471479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.471673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.471893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.471997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.472069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.472268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.472509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.472748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.472851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.472929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.473120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.473306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.473484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.473670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.473859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.473993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.474134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.474331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.474513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.346 [2024-11-28 15:25:40.474705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.346 [2024-11-28 15:25:40.474806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.346 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.474893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.475143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.475315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.475565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.475757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.475898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.475986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.476176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.476401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.476580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.476791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.476885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.476962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.477173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.477415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.477622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.477793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.477891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.478031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.478222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.478441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.478658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.478832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.478992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.479081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.479271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.479487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.479693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.479905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.479980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.480086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.480315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.480506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.480690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.480872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.480975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.481089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.481279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.481472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.481667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.481842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.481977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.347 [2024-11-28 15:25:40.482114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.482201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.347 [2024-11-28 15:25:40.482226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.347 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.482320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.482543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.482723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.482902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.482979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.483113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.483309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.483520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.483745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.483856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.483931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.484107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.484297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.484480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.484664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.484885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.484997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.485078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.485280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.485517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.485694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.485879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.485984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.486061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.486290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.486482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.486691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.486880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.486983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.487113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.487308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.487516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.487739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.487926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.487999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.488024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.488109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.488217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.488241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.348 qpair failed and we were unable to recover it. 00:30:40.348 [2024-11-28 15:25:40.488331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.348 [2024-11-28 15:25:40.488415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.488439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.488520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.488605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.488629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.488703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.488789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.488815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.488890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.488983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.489086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.489291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.489528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.489708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.489886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.489994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.490080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.490276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.490476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.490684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.490879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.490993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.636 [2024-11-28 15:25:40.491073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.491190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.636 [2024-11-28 15:25:40.491215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.636 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.491292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.491467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.491650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.491837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.491945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.492022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.492259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.492458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.492671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.492850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.492950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.493059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.493234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.493423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.493643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.493827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.493939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.494018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.494220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.494434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.494619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.494836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.494938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.495048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.495243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.495437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.495651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.495860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.495995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.496084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.496310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.496520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.496731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.637 [2024-11-28 15:25:40.496829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.637 qpair failed and we were unable to recover it. 00:30:40.637 [2024-11-28 15:25:40.496946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.497171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.497366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.497584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.497754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.497884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.497968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.498196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.498371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.498586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.498765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.498869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.498944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.499162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.499341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.499523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.499753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.499866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.499953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.500131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.500317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.500501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.500727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.500829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.500946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.501149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.501368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.501585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.501818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.501927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.502027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.502254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.502473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.638 [2024-11-28 15:25:40.502692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.638 [2024-11-28 15:25:40.502836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.638 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.502923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.503139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.503327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.503548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.503728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.503843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.503951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.504147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.504323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.504546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.504761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.504863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.504979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.505213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.505408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.505623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.505829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.505934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.506019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.506250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.506430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.506671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.506887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.506986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.507066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.507289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.507469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.507648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.507856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.507961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.508070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.508167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.508192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.508355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.508436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.508460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.639 [2024-11-28 15:25:40.508535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.508613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.639 [2024-11-28 15:25:40.508639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.639 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.508716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.508790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.508815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.508894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.508972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.508996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.509117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.509421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.509639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.509842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.509939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.510049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.510274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.510491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.510698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.510801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.510913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.511138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.511360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.511557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.511744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.511852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.511940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.512132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.512348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.512563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.512767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.512867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.512946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.513142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.513323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.513536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.513757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.513899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.514011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.514124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.514149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.514240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.514317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.514342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.640 qpair failed and we were unable to recover it. 00:30:40.640 [2024-11-28 15:25:40.514454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.514580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.640 [2024-11-28 15:25:40.514605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.514682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.514752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.514777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.514855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.514968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.514994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.515078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.515296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.515548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.515790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.515887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.515962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.516146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.516328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.516523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.516712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.516896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.516998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.517105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.517330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.517571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.517777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.517938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.518016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.518244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.518485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.518664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.518870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.518981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.519116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.519336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.519556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.641 qpair failed and we were unable to recover it. 00:30:40.641 [2024-11-28 15:25:40.519859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.641 [2024-11-28 15:25:40.519990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.520066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.520302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.520486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.520667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.520862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.520954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.521039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.521273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.521510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.521699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.521876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.521990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.522123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.522345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.522529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.522695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.522915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.522986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.523088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.523288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.523465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.523686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.523899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.523996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.524105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.524290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.524508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.524697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.524873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.524987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.525145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.525326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.525554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.642 qpair failed and we were unable to recover it. 00:30:40.642 [2024-11-28 15:25:40.525737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.642 [2024-11-28 15:25:40.525809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.525833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.525916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.526113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.526290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.526466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.526682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.526795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.526900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.527111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.527317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.527561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.527772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.527879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.527963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.528151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.528332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.528593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.528816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.528951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.529035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.529232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.529424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.529633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.529839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.529971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.530082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.530303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.530492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.530694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.530872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.530985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.531060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.531163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.531188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.531295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.531387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.531412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.531489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.531569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.643 [2024-11-28 15:25:40.531593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.643 qpair failed and we were unable to recover it. 00:30:40.643 [2024-11-28 15:25:40.531671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.531774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.531799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.531912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.531988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.532103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.532291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.532495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.532709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.532890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.532999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.533114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.533314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.533536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.533747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.533843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.533973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.534207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.534385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.534600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.534792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.534898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.534977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.535209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.535426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.535642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.535846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.535947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.536031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.536249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.536480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.536732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.536914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.536986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.537088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.537321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.644 [2024-11-28 15:25:40.537550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.644 [2024-11-28 15:25:40.537648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.644 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.537731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.537815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.537841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.537954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.538165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.538407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.538600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.538818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.538930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.539010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.539235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.539455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.539673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.539857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.539956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.540062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.540253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.540509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.540683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.540901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.540979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.541113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.541301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.541488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.541674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.541883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.541992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.542128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.542313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.542507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.645 [2024-11-28 15:25:40.542728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.645 [2024-11-28 15:25:40.542835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.645 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.542952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.543221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.543426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.543646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.543880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.543983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.544062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.544272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.544448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.544665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.544858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.544957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.545128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.545362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.545544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.545757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.545859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.545934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.546178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.546363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.546557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.546769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.546874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.546982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.547215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.547440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.547623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.547832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.547933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.548053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.548247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.548426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.548631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.646 qpair failed and we were unable to recover it. 00:30:40.646 [2024-11-28 15:25:40.548825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.646 [2024-11-28 15:25:40.548898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.548926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.549003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.549232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.549448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.549700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.549909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.549994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.550122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.550333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.550548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.550718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.550891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.550990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.551117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.551293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.551466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.551719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.551819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.551929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.552121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.552343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.552528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.552708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.552849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.552933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.553173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.553372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.553624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.553839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.553943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.554019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.554248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.554449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.554633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.647 qpair failed and we were unable to recover it. 00:30:40.647 [2024-11-28 15:25:40.554806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.647 [2024-11-28 15:25:40.554916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.554942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.555070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.555310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.555525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.555733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.555871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.555982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.556165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.556374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.556553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.556757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.556889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.556969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.557264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.557502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.557671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.557850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.557963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.558055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.558269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.558456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.558640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.558854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.558957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.559066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.559293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.559508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.559717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.559902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.559989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.560112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.560331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.560517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.648 [2024-11-28 15:25:40.560710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.648 [2024-11-28 15:25:40.560861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.648 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.560964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.561239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.561461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.561709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.561887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.561992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.562065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.562258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.562441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.562658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.562894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.562992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.563106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.563284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.563497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.563716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.563867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.563948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.564169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.564386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.564600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.564777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.564884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.564993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.565209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.565440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.565636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.565847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.565987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.566068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.566292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.566461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.566670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.566849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.649 [2024-11-28 15:25:40.566951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.649 qpair failed and we were unable to recover it. 00:30:40.649 [2024-11-28 15:25:40.567026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.567257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.567440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.567652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.567837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.567937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.568015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.568193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.568393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.568577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.568772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.568869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.568979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.569180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.569358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.569572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.569757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.569892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.569991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.570205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.570389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.570573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.570756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.570889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.570969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.571164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.571372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.571625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.571804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.571903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.650 qpair failed and we were unable to recover it. 00:30:40.650 [2024-11-28 15:25:40.572017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.650 [2024-11-28 15:25:40.572099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.572213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.572461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.572645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.572831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.572977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.573060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.573239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.573426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.573633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.573834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.573984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.574117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.574341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.574521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.574776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.574872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.574958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.575138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.575381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.575598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.575808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.575906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.575983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.576196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.576414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.576594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.576771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.576872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.576943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.577141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.577332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.577543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.577795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.577893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.651 qpair failed and we were unable to recover it. 00:30:40.651 [2024-11-28 15:25:40.578006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.651 [2024-11-28 15:25:40.578078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.578188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.578411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.578592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.578831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.578929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.579006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.579263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.579438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.579646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.579816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.579946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.580029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.580216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.580467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.580691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.580906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.580987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.581117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.581336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.581520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.581699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.581886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.581986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.582065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.582305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.582524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.582740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.582872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.582948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.583168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.583370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.583553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.583766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.583865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.652 qpair failed and we were unable to recover it. 00:30:40.652 [2024-11-28 15:25:40.583946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.652 [2024-11-28 15:25:40.584018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.584120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.584307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.584517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.584715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.584823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.584938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.585176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.585386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.585577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.585772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.585869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.585943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.586125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.586321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.586508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.586756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.586865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.586975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.587162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.587352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.587541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.587785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.587901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.587981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.588172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.588359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.588539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.588718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.588846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.588920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.589118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.589333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.589555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.653 qpair failed and we were unable to recover it. 00:30:40.653 [2024-11-28 15:25:40.589739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.653 [2024-11-28 15:25:40.589820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.589844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.589922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.590160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.590423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.590635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.590846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.590945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.591024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.591212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.591434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.591640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.591816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.591915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.591998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.592247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.592452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.592654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.592879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.592983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.593082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.593265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.593471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.593682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.593891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.593999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.594124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.594341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.594569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.594788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.594904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.654 [2024-11-28 15:25:40.594987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.595060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.654 [2024-11-28 15:25:40.595085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.654 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.595173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.595411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.595632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.595855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.595985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.596066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.596244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.596435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.596654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.596903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.596978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.597077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.597288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.597535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.597729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.597900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.597984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.598125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.598300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.598519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.598702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.598886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.598986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.599072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.599282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.599464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.599641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.599787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.599875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.600109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.600294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.600528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.600740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.600868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.655 qpair failed and we were unable to recover it. 00:30:40.655 [2024-11-28 15:25:40.600951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.601088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.655 [2024-11-28 15:25:40.601118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.601205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.601397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.601652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.601895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.601993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.602120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.602308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.602507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.602693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.602870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.602971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.603061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.603272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.603497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.603688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.603897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.603991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.604079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.604309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.604496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.604684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.604819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.604936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.605122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.605309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.605501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.605727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.605903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.605984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.606152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.606363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.606548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.606807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.606902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.656 qpair failed and we were unable to recover it. 00:30:40.656 [2024-11-28 15:25:40.606998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.607083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.656 [2024-11-28 15:25:40.607139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.607227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.607407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.607620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.607811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.607918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.608001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.608214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.608397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.608582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.608762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.608864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.608970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.609199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.609369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.609592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.609786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.609889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.609975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.610182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.610431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.610674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.610870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.610974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.611062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.611283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.611517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.611707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.611853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.611960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.612147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.612341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.612534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.612719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.612827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.657 qpair failed and we were unable to recover it. 00:30:40.657 [2024-11-28 15:25:40.612916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.657 [2024-11-28 15:25:40.613020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.613132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.613323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.613580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.613788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.613909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.614000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.614227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.614415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.614610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.614839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.614974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.615062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.615300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.615557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.615732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.615837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.615930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.616129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.616370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.616558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.616752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.616896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.617003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.617212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.617442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.617639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.617853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.617967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.618046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.618269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.618487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.618722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.618833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.618920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.619008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.658 [2024-11-28 15:25:40.619034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.658 qpair failed and we were unable to recover it. 00:30:40.658 [2024-11-28 15:25:40.619161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.619386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.619626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.619827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.619966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.620053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.620256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.620442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.620686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.620831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.620922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.621130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.621373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.621549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.621733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.621838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.621944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.622132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.622334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.622573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.622792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.622929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.623001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.623207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.623481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.623652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.623834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.623941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.624015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.624103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.624128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.659 qpair failed and we were unable to recover it. 00:30:40.659 [2024-11-28 15:25:40.624210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.624349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.659 [2024-11-28 15:25:40.624374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.624471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.624586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.624610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.624688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.624762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.624787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.624877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.624975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.625078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.625305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.625534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.625766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.625878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.625959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.626181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.626399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.626622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.626847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.626996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.627074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.627284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.627503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.627707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.627815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.627936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.628199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.628404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.628619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.628870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.628999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.629097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.629304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.629493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.629704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.629812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.629927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.630124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.630315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.630507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.630687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.630916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.630992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.631107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.631295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.631537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.631715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.631901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.631976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.632151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.632373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.632613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.632795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.632929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.633011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.633108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.633133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.633207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.633283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.633312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.660 [2024-11-28 15:25:40.633424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.633497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.660 [2024-11-28 15:25:40.633522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.660 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.633597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.633703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.633729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.633807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.633921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.633954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.634031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.634248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.634446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.634698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.634883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.634982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.635061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.635270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.635497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.635694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.635877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.635973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.636053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.636278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.636485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.636666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.636872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.636991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.637100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.637335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.637588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.637771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.637870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.637954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.638145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.638321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.638522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.638776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.638876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.638952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.639176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.639367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.639575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.639764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.639932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.640039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.640243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.640436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.640654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.640759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.640887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.641123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.641338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.641566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.641798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.641903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.642010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.642194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.642407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.642682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.642911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.642992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.643113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.643427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.643827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.643963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.644044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.644287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.644507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.644743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.644960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.645051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.645132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.645158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.645274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.645465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.645492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.661 [2024-11-28 15:25:40.645587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.645714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.661 [2024-11-28 15:25:40.645740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.661 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.645929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.646170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.646390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.646632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.646823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.646931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.647025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.647252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.647448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.647699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.647808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.647889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.648156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.648343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.648531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.648715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.648817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.648933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.649131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.649345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.649531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.649754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.649856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.649933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.650157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.650335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.650533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.650707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.650893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.650988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.651111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.651360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.651557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.651764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.651898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.652007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.652231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.652423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.652638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.652887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.652975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.653082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.653302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.653501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.653717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.653813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.653926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.654153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.654399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.654580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.654774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.654916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.655003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.655217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.655462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.655665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.655853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.655997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.656071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.656185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.656212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.662 [2024-11-28 15:25:40.656299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.656376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.662 [2024-11-28 15:25:40.656402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.662 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.656477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.656557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.656584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.656778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.656871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.656897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.657014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.657200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.657448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.657656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.657863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.657971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.658058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.658256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.658467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.658662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.658841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.658937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.659042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.659242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.659443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.659682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.659903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.659982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.660103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.660290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.660475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.660690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.660823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.660904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.661167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.661346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.661587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.661832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.661964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.662049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.662256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.662436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.662693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.662919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.662993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.663108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.663374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.663573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.663796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.663955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.664068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.664291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.664488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.664680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.664899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.664996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.665072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.665294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.665511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.665767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.665909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.666028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.666261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.666458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.666653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.666861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.666962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.667040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.667234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.667453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.667653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.667901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.667977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.668002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.663 [2024-11-28 15:25:40.668088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.668174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.663 [2024-11-28 15:25:40.668205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.663 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.668283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.668363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.668388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.668486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.668561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.668586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.668692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.668768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.668792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.668904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.669160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.669379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.669590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.669809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.669914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.669992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.670194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.670377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.670616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.670810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.670912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.671022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.671212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.671434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.671850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.671952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.672038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.672290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.672474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.672718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.672826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.672915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.673166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.673378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.673567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.673783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.673927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.674018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.674219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.674444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.674649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.674853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.674963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.675072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.675336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.675528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.675745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.675881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.675959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.676163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.676413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.676607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.676863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.676960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.677041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.677236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.677428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.677617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.677807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.677911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.677996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.678187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.678467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.678684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.678783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.664 qpair failed and we were unable to recover it. 00:30:40.664 [2024-11-28 15:25:40.678911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.664 [2024-11-28 15:25:40.679013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.679158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.679349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.679571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.679815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.679914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.679997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.680222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.680419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.680646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.680864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.680968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.681083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.681291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.681532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.681749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.681871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.681988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.682169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.682399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.682655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.682771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.682910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.683159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.683423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.683651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.683878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.683981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.684066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.684266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.684481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.684776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.684886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.685018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.685242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.685491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.685674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.685775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.685905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.686121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.686369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.686631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.686870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.686970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.687081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.687275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.687526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.687749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.687851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.687959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.688223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.688469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.688694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.688792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.688935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.689181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.689373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.689592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.689810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.689942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.690052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.690287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.690514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.690732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.690840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.690948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.691022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.691047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.691160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.691267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.691292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.665 qpair failed and we were unable to recover it. 00:30:40.665 [2024-11-28 15:25:40.691364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.665 [2024-11-28 15:25:40.691441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.691467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.691556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.691636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.691673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.691763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.691872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.691897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.691972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.692172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.692408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.692652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.692827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.692938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.693081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.693295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.693496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.693742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.693912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.693991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.694136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.694318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.694530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.694759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.694906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.694990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.695216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.695420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.695672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.695860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.695966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.696047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.696280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.696494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.696709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.696845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.696925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.697117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.697307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.697585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.697780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.697885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.698002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.698229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.698460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.698659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.698863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.698975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.699122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.699324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.699604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.699850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.699957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.700042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.700276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.700483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.700672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.700899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.700997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.701115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.701337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.701527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.701747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.701845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.701921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.702155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.702361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.702531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.702784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.702885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.702973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.703119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.703146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.666 qpair failed and we were unable to recover it. 00:30:40.666 [2024-11-28 15:25:40.703255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.666 [2024-11-28 15:25:40.703339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.703365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.703459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.703537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.703567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.703650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.703761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.703787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.703868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.703983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.704118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.704335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.704554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.704779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.704875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.704991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.705213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.705436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.705642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.705835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.705975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.706108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.706328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.706528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.706742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.706854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.706964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.707179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.707433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.707650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.707830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.707946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.708112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.708324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.708507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.708712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.708893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.708976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.709075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.709326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.709584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.709773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.709875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.709992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.710191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.710405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.710598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.710788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.710892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.711006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.711238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.711419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.711645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.711834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.711929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.712074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.712258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.712480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.712655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.712903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.712983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.713109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.713322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.713518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.713693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.667 qpair failed and we were unable to recover it. 00:30:40.667 [2024-11-28 15:25:40.713886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.667 [2024-11-28 15:25:40.713963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.713989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.714104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.714326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.714570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.714758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.714856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.714942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.715140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.715384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.715613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.715821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.715926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.715999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.716222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.716418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.716654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.716847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.716948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.717030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.717230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.717453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.717637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.717829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.717968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.718055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.718246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.718444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.718650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.718875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.718979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.719059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.719282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.719469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.719699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.719912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.719984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.720106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.720311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.720538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.720741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.720840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.720947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.721179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.721358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.721548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.721763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.721930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.722002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.722196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.722425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.722610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.722797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.722896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.722974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.723187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.723380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.723591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.723798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.723903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.723985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.724212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.724450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.724632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.724856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.724985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.725057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.725174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.725200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.668 qpair failed and we were unable to recover it. 00:30:40.668 [2024-11-28 15:25:40.725306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.725413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.668 [2024-11-28 15:25:40.725438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.725522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.725632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.725657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.725730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.725835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.725860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.725969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.726193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.726386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.726619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.726804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.726919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.727024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.727212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.727418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.727623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.727805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.727937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.728015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.728216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.728408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.728624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.728874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.728998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.729077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.729275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.729501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.729674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.729891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.729999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.730148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.730355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.730560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.730777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.730882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.730999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.731234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.731467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.731683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.731817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.731931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.732120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.732307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.732522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.732744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.732852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.732941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.733172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.733389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.733586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.733856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.733958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.734038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.734228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.734422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.734629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.734873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.734971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.735054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.735297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.735531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.735809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.735975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.669 qpair failed and we were unable to recover it. 00:30:40.669 [2024-11-28 15:25:40.736052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.669 [2024-11-28 15:25:40.736153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.736288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.736479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.736653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.736875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.736976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.737086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.737283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.737516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.737768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.737872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.737983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.738221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.738420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.738655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.738866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.738966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.739079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.739300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.739498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.739774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.739913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.739991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.740199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.740416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.740656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.740830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.740967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.741082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.741300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.741495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.741682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.741820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.741934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.742181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.742410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.742637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.742816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.742951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.743033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.743222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.743452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.743637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.743855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.743956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.744031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.744279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.744513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.744764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.744862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.744972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.745181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.745389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.745568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.745750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.745857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.745937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.746163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.746351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.746570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.746747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.746851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.746939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.747128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.747385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.747591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.670 qpair failed and we were unable to recover it. 00:30:40.670 [2024-11-28 15:25:40.747799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.670 [2024-11-28 15:25:40.747879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.747905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.747979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.748223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.748450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.748696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.748798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.748937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.749131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.749356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.749581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.749791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.749898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.749977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.750184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.750365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.750559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.750769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.750871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.750981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.751170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.751387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.751594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.751809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.751910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.751983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.752239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.752449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.752675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.752787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.752907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.753129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.753320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.753539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.753793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.753901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.753984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.754178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.754362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.754561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.754745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.754851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.754965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.755179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.755364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.755554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.755766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.755866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.756014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.756242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.756504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.756693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.756911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.756996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.757144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.757333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.757571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.757753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.757883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.757973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.758049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.758074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.758167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.758240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.758265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.671 qpair failed and we were unable to recover it. 00:30:40.671 [2024-11-28 15:25:40.758342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.671 [2024-11-28 15:25:40.758423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.758449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.758559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.758641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.758666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.758772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.758856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.758882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.758998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.759199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.759376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.759647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.759835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.759937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.760064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.760277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.760486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.760729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.760865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.760948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.761182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.761414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.761632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.761892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.761996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.762116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.762310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.762497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.762715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.762851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.762931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.763161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.763349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.763589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.672 qpair failed and we were unable to recover it. 00:30:40.672 [2024-11-28 15:25:40.763763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.672 [2024-11-28 15:25:40.763833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.763859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.763939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.764184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.764360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.764611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.764801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.764915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.764992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.765210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.765427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.765623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.765805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.765939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.766013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.766225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.766445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.766622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.766846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.766949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.767029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.767282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.767499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.767720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.767859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.767940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.768158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.768442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.768639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.768859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.768999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.769083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.769317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.769522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.673 qpair failed and we were unable to recover it. 00:30:40.673 [2024-11-28 15:25:40.769744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.673 [2024-11-28 15:25:40.769819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.769849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.769957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.770186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.770407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.770578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.770799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.770911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.770990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.771250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.771446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.771686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.771881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.771983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.772061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.772289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.772475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.772656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.772907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.772993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.773127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.773321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.773562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.773779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.773908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.773984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.774265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.774491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.774700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.774811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.774922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.775147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.775395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.775568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.674 qpair failed and we were unable to recover it. 00:30:40.674 [2024-11-28 15:25:40.775812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.674 [2024-11-28 15:25:40.775920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.775993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.776239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.776458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.776675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.776878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.776987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.777125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.777352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.777541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.777798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.777903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.777982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.778184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.778392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.778610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.778798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.778969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.779049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.779229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.779465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.779683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.779815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.779892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.780137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.780351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.780562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.780815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.780914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.780988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.781245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.781422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.781604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.781821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.781956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.675 qpair failed and we were unable to recover it. 00:30:40.675 [2024-11-28 15:25:40.782049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.675 [2024-11-28 15:25:40.782162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.782273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.782465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.782679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.782888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.782992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.783129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.783326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.783503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.783775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.783872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.783953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.784165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.784352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.784598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.784809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.784906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.784989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.785214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.785435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.785656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.785827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.785976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.786088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.786303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.786584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.786769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.786986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.787062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.787198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.787225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.676 qpair failed and we were unable to recover it. 00:30:40.676 [2024-11-28 15:25:40.787345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.676 [2024-11-28 15:25:40.787428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.787453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.787565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.787645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.787671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.787780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.787854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.787880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.787990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.788191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.788405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.788584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.788803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.788902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.788982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.789211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.789472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.789698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.789889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.789999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.790084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.790307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.790522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.790751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.790892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.790996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.791249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.791433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.791636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.791851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.791950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.792046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.792263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.792447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.792667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.792891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.792994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.793075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.793190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.793218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.793306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.793408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.677 [2024-11-28 15:25:40.793435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.677 qpair failed and we were unable to recover it. 00:30:40.677 [2024-11-28 15:25:40.793513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.793591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.793618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.793709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.793825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.793851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.793953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.794173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.794372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.794637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.794848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.794954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.795035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.795258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.795476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.795730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.795837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.795911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.796119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.796311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.796554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.796744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.796872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.796949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.797166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.797386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.797576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.797771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.797912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.797991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.798194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.798393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.798586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.798778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.798916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.798991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.799115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.799142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.799253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.799336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.799363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.678 [2024-11-28 15:25:40.799474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.799615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.678 [2024-11-28 15:25:40.799642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.678 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.799753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.799839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.799866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.799955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.800236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.800438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.800688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.800827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.800904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.801120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.801328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.801550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.801788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.801892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.801979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.802237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.802421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.802612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.802806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.802915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.802995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.803214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.803423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.803624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.803855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.803965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.804045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.804278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.804491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.804721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.804849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.804965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.805203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.805391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.805582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.679 qpair failed and we were unable to recover it. 00:30:40.679 [2024-11-28 15:25:40.805801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.679 [2024-11-28 15:25:40.805879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.805905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.805985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.806182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.806368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.806588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.806807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.806915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.806993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.807187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.807417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.807604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.807781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.807882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.807991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.808223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.808438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.808665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.808886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.808984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.809088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.809305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.809488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.809706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 15:25:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:40.680 [2024-11-28 15:25:40.809809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.809837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.809924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 15:25:40 -- common/autotest_common.sh@862 -- # return 0 00:30:40.680 [2024-11-28 15:25:40.810144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.810320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 15:25:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:40.680 [2024-11-28 15:25:40.810579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 15:25:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.680 [2024-11-28 15:25:40.810765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.810878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.810950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.680 [2024-11-28 15:25:40.811053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.811081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.811174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.811260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.811286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.811415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.811518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.680 [2024-11-28 15:25:40.811545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.680 qpair failed and we were unable to recover it. 00:30:40.680 [2024-11-28 15:25:40.811632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.811719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.811744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.811827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.811907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.811934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.812047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.812299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.812522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.812731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.812945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.813034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.813263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.813488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.813678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.813817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.813914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.814205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.814424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.814623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.814839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.814978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.815085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.815270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.815454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.815711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.815818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.815951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.816186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.816421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.816616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.816906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.816991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.817017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.817102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.817175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.817201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.681 qpair failed and we were unable to recover it. 00:30:40.681 [2024-11-28 15:25:40.817284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.681 [2024-11-28 15:25:40.817357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.817392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.817471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.817602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.817628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.817740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.817817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.817843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.817927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.818179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.818408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.818583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.818827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.818953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.819027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.819221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.819404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.819654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.819871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.819970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.820044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.820236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.820435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.820655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.820864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.820986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.821124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.821313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.821494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.821700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.821915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.821994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.822162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.822439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.822686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.822901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.822974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.823000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.823082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.823169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.823195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.823271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.823374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.682 [2024-11-28 15:25:40.823400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.682 qpair failed and we were unable to recover it. 00:30:40.682 [2024-11-28 15:25:40.823485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.823601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.823627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.823738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.823811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.823836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.823943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.824173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.824396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.824585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.824802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.824903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.825014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.825219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.825438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.825630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.825873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.825981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.826073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.826270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.826492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.826682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.826874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.826984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.827091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.827314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.827532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.827759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.827871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.827980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.828203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.828419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.828639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.828815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.828921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.829010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.829090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.829145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.829224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.829335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.683 [2024-11-28 15:25:40.829361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.683 qpair failed and we were unable to recover it. 00:30:40.683 [2024-11-28 15:25:40.829457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.829529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.829559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.829666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.829737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.829763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.829872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.829980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.830091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.830287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.830494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.830712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.830856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.830950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.831145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.831395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.831611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.831882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.831987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.832109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.832292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.832501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.832703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.832817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.832927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 15:25:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:40.684 [2024-11-28 15:25:40.833012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.833172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 15:25:40 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:40.684 [2024-11-28 15:25:40.833356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.684 15:25:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.833593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.684 [2024-11-28 15:25:40.833745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.833863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.833999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.834071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.834274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.834511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.834735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.834864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.834980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.835064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.835089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.835176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.835264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.835290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.684 qpair failed and we were unable to recover it. 00:30:40.684 [2024-11-28 15:25:40.835373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.835478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.684 [2024-11-28 15:25:40.835503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.835609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.835716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.835741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.835827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.835901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.835927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.836000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.836297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.836494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.836711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1114390 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.836897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.836977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.837098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.837323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.837513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.837705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.837839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.837926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.838158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.838367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.838568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.838811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.838935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.839051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.839281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.839495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.839748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.839859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.839949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.840157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.840334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.840607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.685 [2024-11-28 15:25:40.840828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.685 [2024-11-28 15:25:40.840935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.685 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-28 15:25:40.841040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 15:25:40.841127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 15:25:40.841153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.686 [2024-11-28 15:25:40.841267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 15:25:40.841377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.686 [2024-11-28 15:25:40.841403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.686 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.841514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.841625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.841651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.841735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.841818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.841843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.841934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.842138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.842391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.842583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.842785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.842893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.843003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.843235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.843476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.843676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.952 [2024-11-28 15:25:40.843828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.952 qpair failed and we were unable to recover it. 00:30:40.952 [2024-11-28 15:25:40.843906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.843988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.844128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.844353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.844560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.844782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.844883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.844962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.845210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.845416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.845613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.845810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.845919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.846025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.846214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.846478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.846672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.846891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.846985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.847103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.847303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.847495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.847679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.847832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.847943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.848208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.848402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.848693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.848886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.848974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.849081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.849367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.849564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.849802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.849912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.953 qpair failed and we were unable to recover it. 00:30:40.953 [2024-11-28 15:25:40.850033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.953 [2024-11-28 15:25:40.850121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.850247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.850536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.850757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.850871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.850962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.851195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.851387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.851588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.851886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.851996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.852148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.852249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.852275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.852466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.852549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.852580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.852696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.852885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.852912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.853018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.853278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.853472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.853801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.853991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.854141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.854377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.854794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.854909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.854996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.855187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.855214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.855405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.855595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.855627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.855736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.855819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.855845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.856035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.856246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.856492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.856747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.856916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.857023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.857131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.857158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.857235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.857315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.857341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.857444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.857549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 [2024-11-28 15:25:40.857575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.954 qpair failed and we were unable to recover it. 00:30:40.954 [2024-11-28 15:25:40.857681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.954 Malloc0 00:30:40.955 [2024-11-28 15:25:40.857772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.857799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.857886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.857999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 15:25:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.955 [2024-11-28 15:25:40.858153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 15:25:40 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:40.955 [2024-11-28 15:25:40.858245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.858355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 15:25:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.955 [2024-11-28 15:25:40.858447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.858578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.858801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.858944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.859037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.859266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.859482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.859758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.859862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.859961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.860238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.860496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.860716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.860831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.861003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.861218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.861414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861423] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:40.955 [2024-11-28 15:25:40.861529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.861635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.861739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.861933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.862177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.862365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.862598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.862819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.862929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.863015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.863219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.863422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.863662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.955 [2024-11-28 15:25:40.863851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.955 [2024-11-28 15:25:40.863994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.955 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.864073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.864344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.864579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.864779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.864925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.865041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.865164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.865192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.865340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.865425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.865452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.865600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.865748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.865775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.865897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.866156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.866377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.866613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.866826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.866972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.867054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.867289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.867530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.867764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.867879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.867958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.868181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.868360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2cac000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.868571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.868804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.868912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.868992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.869250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.869491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 15:25:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.956 [2024-11-28 15:25:40.869719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 15:25:40 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:40.956 [2024-11-28 15:25:40.869840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.869869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 15:25:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.956 [2024-11-28 15:25:40.869982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.956 [2024-11-28 15:25:40.870103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.870131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.870227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.870306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.870333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.956 qpair failed and we were unable to recover it. 00:30:40.956 [2024-11-28 15:25:40.870422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.870535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.956 [2024-11-28 15:25:40.870563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.870636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.870753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.870782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.870872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.870949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.870977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.871058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.871325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.871518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.871752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.871863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.871976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.872178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.872365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.872544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.872650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.872847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.873265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.873570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.873789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.873898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.873991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.874210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.874402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.874702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.874920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.875029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.875237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.875538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.875791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.875895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.876008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.876082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.876115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.876194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.876276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.957 [2024-11-28 15:25:40.876304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.957 qpair failed and we were unable to recover it. 00:30:40.957 [2024-11-28 15:25:40.876388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.876473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.876506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.876583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.876694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.876722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.876801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.876917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.876945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.877023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.877242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.877457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 15:25:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.958 [2024-11-28 15:25:40.877654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 15:25:40 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:40.958 [2024-11-28 15:25:40.877845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 15:25:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.958 [2024-11-28 15:25:40.877934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.877962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.958 [2024-11-28 15:25:40.878072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.878280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.878496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.878712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.878907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.878998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.879106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.879334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.879517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.879746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.879849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.879970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.880189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.880382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.880585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.880792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.880895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.881012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.881207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.881411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.881701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.881817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.881900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.882010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.882038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.882121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.882210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.958 [2024-11-28 15:25:40.882237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.958 qpair failed and we were unable to recover it. 00:30:40.958 [2024-11-28 15:25:40.882326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.882410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.882439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.882637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.882733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.882761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.882852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.882928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.882956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.883047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.883278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.883482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.883731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.883840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.883957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.884151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.884386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.884635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.884850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.884960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.885062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.885349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.885547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 15:25:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.885770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.885851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 15:25:40 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:40.959 [2024-11-28 15:25:40.885878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 15:25:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.959 [2024-11-28 15:25:40.886010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.959 [2024-11-28 15:25:40.886130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.886208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.886404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.886696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.886914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.886995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.887104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.887309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.887502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.887700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.887837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.887951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.888026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.888053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.888136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.888215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.888242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.959 [2024-11-28 15:25:40.888322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.888402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.959 [2024-11-28 15:25:40.888428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.959 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.888511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.888587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.888614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.888702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.888789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.888817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.888901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.888981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.889008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca4000b90 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.889127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.889206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.889239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.889327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.889413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.889441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f2ca0000b90 with addr=10.0.0.2, port=4420 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.889523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:40.960 [2024-11-28 15:25:40.889716] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:40.960 [2024-11-28 15:25:40.892728] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:30:40.960 [2024-11-28 15:25:40.892808] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f2ca0000b90 (107): Transport endpoint is not connected 00:30:40.960 [2024-11-28 15:25:40.892887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 15:25:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.960 15:25:40 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:40.960 15:25:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.960 15:25:40 -- common/autotest_common.sh@10 -- # set +x 00:30:40.960 15:25:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.960 15:25:40 -- host/target_disconnect.sh@58 -- # wait 841747 00:30:40.960 [2024-11-28 15:25:40.902137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.902275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.902305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.902323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.902336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.902368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.912061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.912158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.912184] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.912199] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.912211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.912242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.921978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.922074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.922107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.922128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.922142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.922173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.931963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.932052] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.932077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.932099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.932115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.932145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.941984] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.942074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.942107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.942124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.942137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.942166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.952014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.952109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.952135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.952150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.952162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.952192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.962142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.962241] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.962266] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.962280] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.962292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.962323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.972127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.972219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.972245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.972259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.972272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.972302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.982129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.982215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.982240] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.982254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.982267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.960 [2024-11-28 15:25:40.982297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.960 qpair failed and we were unable to recover it. 00:30:40.960 [2024-11-28 15:25:40.992147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.960 [2024-11-28 15:25:40.992238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.960 [2024-11-28 15:25:40.992263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.960 [2024-11-28 15:25:40.992277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.960 [2024-11-28 15:25:40.992290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:40.992320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.002165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.002255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.002280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.002295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.002308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.002352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.012265] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.012352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.012378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.012398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.012413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.012443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.022216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.022303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.022329] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.022343] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.022355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.022386] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.032233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.032321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.032345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.032359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.032372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.032402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.042259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.042351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.042377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.042391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.042403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.042433] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.052279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.052375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.052399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.052413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.052427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.052471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.062337] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.062450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.062475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.062490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.062503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.062533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.072356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.072444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.072470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.072484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.072497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.072528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.082404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.082494] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.082519] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.082533] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.082546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.082576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.092467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.092563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.092590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.092606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.092620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.092654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.102415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.102504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.102536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.961 [2024-11-28 15:25:41.102551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.961 [2024-11-28 15:25:41.102564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.961 [2024-11-28 15:25:41.102595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.961 qpair failed and we were unable to recover it. 00:30:40.961 [2024-11-28 15:25:41.112454] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.961 [2024-11-28 15:25:41.112588] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.961 [2024-11-28 15:25:41.112621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.112645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.112666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.112711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-28 15:25:41.122499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.962 [2024-11-28 15:25:41.122586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.962 [2024-11-28 15:25:41.122612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.122627] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.122639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.122670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-28 15:25:41.132503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.962 [2024-11-28 15:25:41.132601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.962 [2024-11-28 15:25:41.132627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.132642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.132655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.132685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-28 15:25:41.142629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.962 [2024-11-28 15:25:41.142723] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.962 [2024-11-28 15:25:41.142747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.142761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.142774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.142811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-28 15:25:41.152591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.962 [2024-11-28 15:25:41.152684] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.962 [2024-11-28 15:25:41.152709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.152722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.152735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.152766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-28 15:25:41.162616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.962 [2024-11-28 15:25:41.162706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.962 [2024-11-28 15:25:41.162731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.162746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.162758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.162789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:40.962 [2024-11-28 15:25:41.172643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.962 [2024-11-28 15:25:41.172730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.962 [2024-11-28 15:25:41.172755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.962 [2024-11-28 15:25:41.172770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.962 [2024-11-28 15:25:41.172782] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:40.962 [2024-11-28 15:25:41.172811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.962 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-28 15:25:41.182635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.224 [2024-11-28 15:25:41.182727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.224 [2024-11-28 15:25:41.182752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.224 [2024-11-28 15:25:41.182766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.224 [2024-11-28 15:25:41.182779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.224 [2024-11-28 15:25:41.182809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-28 15:25:41.192672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.224 [2024-11-28 15:25:41.192754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.224 [2024-11-28 15:25:41.192784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.224 [2024-11-28 15:25:41.192800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.224 [2024-11-28 15:25:41.192812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.224 [2024-11-28 15:25:41.192842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-28 15:25:41.202761] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.224 [2024-11-28 15:25:41.202864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.224 [2024-11-28 15:25:41.202889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.224 [2024-11-28 15:25:41.202903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.224 [2024-11-28 15:25:41.202916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.224 [2024-11-28 15:25:41.202946] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-28 15:25:41.212735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.224 [2024-11-28 15:25:41.212824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.224 [2024-11-28 15:25:41.212851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.224 [2024-11-28 15:25:41.212866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.224 [2024-11-28 15:25:41.212880] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.224 [2024-11-28 15:25:41.212912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.224 qpair failed and we were unable to recover it. 00:30:41.224 [2024-11-28 15:25:41.222787] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.224 [2024-11-28 15:25:41.222867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.224 [2024-11-28 15:25:41.222893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.224 [2024-11-28 15:25:41.222908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.222923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.222953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.232801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.232887] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.232914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.232929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.232943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.232981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.242861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.242949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.242977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.242992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.243005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.243036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.252853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.252945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.252972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.252987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.253000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.253031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.262901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.262986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.263011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.263025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.263038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.263068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.272998] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.273087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.273119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.273133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.273146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.273176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.282974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.283070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.283109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.283138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.283151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.283182] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.292994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.293086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.293120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.293135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.293148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.293180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.303028] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.303137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.303167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.303182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.303195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.303227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.313133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.313224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.313251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.313267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.313280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.313312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.323111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.323220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.323247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.323261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.323284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.323316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.333099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.333190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.333215] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.333229] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.333242] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.333273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.343213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.343309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.343334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.343349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.343363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.343394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.225 qpair failed and we were unable to recover it. 00:30:41.225 [2024-11-28 15:25:41.353147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.225 [2024-11-28 15:25:41.353236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.225 [2024-11-28 15:25:41.353263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.225 [2024-11-28 15:25:41.353277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.225 [2024-11-28 15:25:41.353290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.225 [2024-11-28 15:25:41.353321] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.363284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.363376] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.363401] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.363415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.363427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.363457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.373239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.373339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.373364] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.373378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.373390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.373420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.383240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.383320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.383345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.383359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.383371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.383401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.393280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.393361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.393386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.393400] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.393413] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.393442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.403343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.403452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.403477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.403492] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.403505] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.403537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.413415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.413505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.413530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.413544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.413562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.413593] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.423354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.423444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.423468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.423482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.423495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.423524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.433396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.433478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.433502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.433517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.433529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.433558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.443499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.443590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.443614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.443629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.443641] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.443671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.226 [2024-11-28 15:25:41.453479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.226 [2024-11-28 15:25:41.453596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.226 [2024-11-28 15:25:41.453622] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.226 [2024-11-28 15:25:41.453637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.226 [2024-11-28 15:25:41.453650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.226 [2024-11-28 15:25:41.453697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.226 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.463470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.463556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.463582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.463596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.463608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.463639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.473544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.473636] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.473661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.473675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.473688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.473719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.483565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.483678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.483703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.483717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.483731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.483761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.493595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.493687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.493715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.493732] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.493745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.493776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.503621] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.503710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.503736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.503757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.503770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.503801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.513694] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.513780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.513805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.513819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.513832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.513877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.523658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.523749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.523774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.523788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.523800] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.523831] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.533669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.533755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.533780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.533793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.533806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.533836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.543791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.543876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.543901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.543915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.543928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.543957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.553744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.553829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.553854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.553869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.553882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.553911] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.563793] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.563882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.563907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.563921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.563933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.563977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.573767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.573872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.487 [2024-11-28 15:25:41.573897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.487 [2024-11-28 15:25:41.573911] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.487 [2024-11-28 15:25:41.573923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.487 [2024-11-28 15:25:41.573954] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.487 qpair failed and we were unable to recover it. 00:30:41.487 [2024-11-28 15:25:41.583899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.487 [2024-11-28 15:25:41.583999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.584024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.584038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.584050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.584080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.593958] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.594043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.594068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.594088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.594113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.594144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.603916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.604012] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.604037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.604052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.604064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.604116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.613941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.614029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.614054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.614068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.614081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.614117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.623937] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.624069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.624102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.624120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.624134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.624164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.633981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.634065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.634090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.634116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.634129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.634159] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.644008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.644102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.644128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.644142] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.644154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.644184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.654052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.654173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.654198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.654212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.654225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.654256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.664086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.664173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.664198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.664213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.664225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.664255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.674144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.674249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.674275] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.674289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.674302] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.674347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.684139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.684230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.684261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.684276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.684289] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.684320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.694165] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.694259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.694284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.694299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.694312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.694342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.704269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.704367] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.704392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.704405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.704418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.488 [2024-11-28 15:25:41.704449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.488 qpair failed and we were unable to recover it. 00:30:41.488 [2024-11-28 15:25:41.714206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.488 [2024-11-28 15:25:41.714290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.488 [2024-11-28 15:25:41.714316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.488 [2024-11-28 15:25:41.714331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.488 [2024-11-28 15:25:41.714344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.489 [2024-11-28 15:25:41.714375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.489 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-28 15:25:41.724252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.748 [2024-11-28 15:25:41.724344] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.748 [2024-11-28 15:25:41.724371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.748 [2024-11-28 15:25:41.724386] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.748 [2024-11-28 15:25:41.724400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.748 [2024-11-28 15:25:41.724438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-28 15:25:41.734290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.748 [2024-11-28 15:25:41.734387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.748 [2024-11-28 15:25:41.734414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.748 [2024-11-28 15:25:41.734429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.748 [2024-11-28 15:25:41.734441] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.748 [2024-11-28 15:25:41.734485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-28 15:25:41.744285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.748 [2024-11-28 15:25:41.744377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.748 [2024-11-28 15:25:41.744404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.748 [2024-11-28 15:25:41.744418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.748 [2024-11-28 15:25:41.744431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.748 [2024-11-28 15:25:41.744461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-28 15:25:41.754334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.748 [2024-11-28 15:25:41.754466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.748 [2024-11-28 15:25:41.754492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.748 [2024-11-28 15:25:41.754507] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.748 [2024-11-28 15:25:41.754520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.748 [2024-11-28 15:25:41.754553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-28 15:25:41.764362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.748 [2024-11-28 15:25:41.764454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.748 [2024-11-28 15:25:41.764480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.748 [2024-11-28 15:25:41.764494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.748 [2024-11-28 15:25:41.764507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.748 [2024-11-28 15:25:41.764539] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.748 qpair failed and we were unable to recover it. 00:30:41.748 [2024-11-28 15:25:41.774379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.774471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.774504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.774529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.774542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.774572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.784395] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.784496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.784523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.784538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.784551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.784582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.794426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.794512] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.794538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.794553] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.794565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.794595] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.804476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.804564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.804590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.804604] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.804616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.804648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.814495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.814585] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.814612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.814626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.814646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.814676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.824517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.824650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.824677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.824692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.824704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.824736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.834546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.834633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.834659] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.834674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.834687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.834731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.844574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.844666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.844692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.844706] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.844718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.844750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.854612] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.854699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.854725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.854740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.854752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.854784] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.864681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.864775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.864800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.864814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.864826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.864855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.874704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.874794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.874821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.874836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.874848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.874880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.884763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.884872] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.884898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.884912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.884925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.884957] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.894732] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.894856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.894882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.749 [2024-11-28 15:25:41.894897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.749 [2024-11-28 15:25:41.894909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.749 [2024-11-28 15:25:41.894955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.749 qpair failed and we were unable to recover it. 00:30:41.749 [2024-11-28 15:25:41.904812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.749 [2024-11-28 15:25:41.904918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.749 [2024-11-28 15:25:41.904946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.904960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.904979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.905023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.914775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.914907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.914933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.914948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.914961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.914992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.924864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.924974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.925000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.925015] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.925027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.925072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.934865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.934984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.935011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.935025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.935038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.935070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.944900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.945027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.945054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.945068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.945081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.945122] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.954901] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.954982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.955008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.955022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.955035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.955066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.964983] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.965098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.965143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.965161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.965176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.965213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:41.750 [2024-11-28 15:25:41.974963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.750 [2024-11-28 15:25:41.975043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.750 [2024-11-28 15:25:41.975071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.750 [2024-11-28 15:25:41.975086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.750 [2024-11-28 15:25:41.975114] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:41.750 [2024-11-28 15:25:41.975162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.750 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:41.984993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:41.985073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:41.985109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:41.985127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:41.985141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:41.985172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:41.995022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:41.995112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:41.995140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:41.995160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:41.995176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:41.995207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.005064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.005190] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.005218] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.005233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.005246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.005277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.015063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.015162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.015189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.015204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.015217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.015249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.025161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.025240] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.025267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.025282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.025295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.025326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.035108] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.035207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.035234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.035248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.035261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.035292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.045166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.045280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.045307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.045321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.045334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.045365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.055173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.055261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.055287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.055301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.055314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.055346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.065250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.065357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.065384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.065399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.065412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.065443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.010 [2024-11-28 15:25:42.075236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.010 [2024-11-28 15:25:42.075354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.010 [2024-11-28 15:25:42.075380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.010 [2024-11-28 15:25:42.075395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.010 [2024-11-28 15:25:42.075408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.010 [2024-11-28 15:25:42.075440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.010 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.085270] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.085357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.085383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.085404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.085419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.085449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.095371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.095484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.095511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.095526] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.095540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.095571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.105333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.105425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.105451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.105466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.105480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.105513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.115336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.115426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.115452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.115467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.115480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.115511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.125408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.125513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.125543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.125560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.125575] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.125606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.135414] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.135504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.135531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.135547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.135560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.135590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.145420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.145506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.145534] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.145549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.145562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.145594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.155459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.155566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.155593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.155608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.155620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.155652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.165552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.165658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.165684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.165699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.165712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.165742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.175547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.175667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.175699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.175715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.175728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.175759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.185637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.185749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.185780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.185797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.185811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.185843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.195619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.195731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.195758] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.195773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.195786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.195818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.205682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.205815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.205842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.011 [2024-11-28 15:25:42.205857] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.011 [2024-11-28 15:25:42.205870] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.011 [2024-11-28 15:25:42.205901] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.011 qpair failed and we were unable to recover it. 00:30:42.011 [2024-11-28 15:25:42.215661] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.011 [2024-11-28 15:25:42.215779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.011 [2024-11-28 15:25:42.215809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.012 [2024-11-28 15:25:42.215826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.012 [2024-11-28 15:25:42.215841] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.012 [2024-11-28 15:25:42.215879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.012 qpair failed and we were unable to recover it. 00:30:42.012 [2024-11-28 15:25:42.225735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.012 [2024-11-28 15:25:42.225846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.012 [2024-11-28 15:25:42.225875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.012 [2024-11-28 15:25:42.225891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.012 [2024-11-28 15:25:42.225904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.012 [2024-11-28 15:25:42.225935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.012 qpair failed and we were unable to recover it. 00:30:42.012 [2024-11-28 15:25:42.235798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.012 [2024-11-28 15:25:42.235877] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.012 [2024-11-28 15:25:42.235904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.012 [2024-11-28 15:25:42.235918] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.012 [2024-11-28 15:25:42.235931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.012 [2024-11-28 15:25:42.235962] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.012 qpair failed and we were unable to recover it. 00:30:42.271 [2024-11-28 15:25:42.245797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.271 [2024-11-28 15:25:42.245891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.271 [2024-11-28 15:25:42.245918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.271 [2024-11-28 15:25:42.245932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.271 [2024-11-28 15:25:42.245945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.271 [2024-11-28 15:25:42.245976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.271 qpair failed and we were unable to recover it. 00:30:42.271 [2024-11-28 15:25:42.255764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.271 [2024-11-28 15:25:42.255851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.271 [2024-11-28 15:25:42.255877] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.271 [2024-11-28 15:25:42.255892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.271 [2024-11-28 15:25:42.255905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.271 [2024-11-28 15:25:42.255936] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.271 qpair failed and we were unable to recover it. 00:30:42.271 [2024-11-28 15:25:42.265854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.265941] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.265973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.265992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.266007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.266037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.275815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.275913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.275940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.275954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.275967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.275998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.285863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.285953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.285980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.285994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.286007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.286037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.295917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.296006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.296033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.296048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.296061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.296114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.305924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.306025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.306052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.306067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.306081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.306142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.315938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.316063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.316100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.316119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.316132] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.316163] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.325989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.326122] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.326148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.326163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.326176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.326207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.335990] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.336077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.336111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.336127] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.336140] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.336172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.346003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.346124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.346151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.346165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.346178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.346209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.356068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.356170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.356196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.356212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.272 [2024-11-28 15:25:42.356225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.272 [2024-11-28 15:25:42.356257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.272 qpair failed and we were unable to recover it. 00:30:42.272 [2024-11-28 15:25:42.366074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.272 [2024-11-28 15:25:42.366170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.272 [2024-11-28 15:25:42.366197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.272 [2024-11-28 15:25:42.366212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.366224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.366256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.376113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.376220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.376250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.376265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.376279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.376310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.386130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.386220] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.386246] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.386260] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.386274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.386305] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.396198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.396323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.396352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.396367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.396387] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.396434] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.406261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.406362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.406388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.406402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.406416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.406446] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.416247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.416335] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.416362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.416387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.416400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.416431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.426308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.426396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.426425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.426440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.426455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.426487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.436284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.436375] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.436414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.436430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.436444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.436474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.446390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.446497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.446523] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.446538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.446553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.446583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.456350] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.456495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.456521] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.456535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.456549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.456579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.466420] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.466534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.466560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.273 [2024-11-28 15:25:42.466575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.273 [2024-11-28 15:25:42.466589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.273 [2024-11-28 15:25:42.466620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.273 qpair failed and we were unable to recover it. 00:30:42.273 [2024-11-28 15:25:42.476474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.273 [2024-11-28 15:25:42.476612] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.273 [2024-11-28 15:25:42.476638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.274 [2024-11-28 15:25:42.476652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.274 [2024-11-28 15:25:42.476666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.274 [2024-11-28 15:25:42.476711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.274 qpair failed and we were unable to recover it. 00:30:42.274 [2024-11-28 15:25:42.486450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.274 [2024-11-28 15:25:42.486545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.274 [2024-11-28 15:25:42.486572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.274 [2024-11-28 15:25:42.486593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.274 [2024-11-28 15:25:42.486608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.274 [2024-11-28 15:25:42.486638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.274 qpair failed and we were unable to recover it. 00:30:42.274 [2024-11-28 15:25:42.496498] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.274 [2024-11-28 15:25:42.496603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.274 [2024-11-28 15:25:42.496629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.274 [2024-11-28 15:25:42.496644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.274 [2024-11-28 15:25:42.496658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.274 [2024-11-28 15:25:42.496688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.274 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-28 15:25:42.506553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.536 [2024-11-28 15:25:42.506644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.536 [2024-11-28 15:25:42.506671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.536 [2024-11-28 15:25:42.506686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.536 [2024-11-28 15:25:42.506700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.536 [2024-11-28 15:25:42.506731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-28 15:25:42.516590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.536 [2024-11-28 15:25:42.516706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.536 [2024-11-28 15:25:42.516732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.536 [2024-11-28 15:25:42.516747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.536 [2024-11-28 15:25:42.516760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.536 [2024-11-28 15:25:42.516792] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-28 15:25:42.526618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.536 [2024-11-28 15:25:42.526740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.536 [2024-11-28 15:25:42.526766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.536 [2024-11-28 15:25:42.526780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.536 [2024-11-28 15:25:42.526794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.536 [2024-11-28 15:25:42.526825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-28 15:25:42.536720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.536 [2024-11-28 15:25:42.536813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.536 [2024-11-28 15:25:42.536839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.536 [2024-11-28 15:25:42.536854] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.536 [2024-11-28 15:25:42.536868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.536 [2024-11-28 15:25:42.536898] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.536 qpair failed and we were unable to recover it. 00:30:42.536 [2024-11-28 15:25:42.546639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.536 [2024-11-28 15:25:42.546731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.536 [2024-11-28 15:25:42.546757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.536 [2024-11-28 15:25:42.546772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.546786] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.546816] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.556678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.556772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.556798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.556812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.556826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.556855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.566741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.566852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.566879] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.566893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.566906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.566950] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.576752] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.576845] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.576871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.576896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.576910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.576942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.586801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.586896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.586922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.586936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.586950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.586980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.596795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.596889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.596916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.596935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.596951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.596982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.606821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.606935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.606964] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.606982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.606996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.607029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.616838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.616957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.616984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.616998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.617013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.617043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.626875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.627010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.627037] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.627052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.627065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.627105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.636948] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.637044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.637071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.637086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.637106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.637151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.646949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.647061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.647091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.647118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.647133] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.647164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.656969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.657063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.657098] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.657119] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.657134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.657180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.666986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.667106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.667138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.667154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.537 [2024-11-28 15:25:42.667168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.537 [2024-11-28 15:25:42.667213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.537 qpair failed and we were unable to recover it. 00:30:42.537 [2024-11-28 15:25:42.677029] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.537 [2024-11-28 15:25:42.677127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.537 [2024-11-28 15:25:42.677154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.537 [2024-11-28 15:25:42.677169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.677182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.677213] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.687036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.687177] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.687203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.687218] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.687232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.687262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.697098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.697193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.697220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.697234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.697247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.697277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.707109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.707215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.707241] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.707255] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.707268] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.707306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.717114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.717207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.717233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.717247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.717259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.717290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.727160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.727273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.727298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.727312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.727326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.727356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.737197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.737279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.737305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.737319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.737331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.737361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.747232] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.747317] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.747344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.747359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.747373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.747416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.757343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.757475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.757508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.757524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.757537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.757567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.538 [2024-11-28 15:25:42.767284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.538 [2024-11-28 15:25:42.767425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.538 [2024-11-28 15:25:42.767452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.538 [2024-11-28 15:25:42.767467] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.538 [2024-11-28 15:25:42.767481] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.538 [2024-11-28 15:25:42.767511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.538 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.777297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.777382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.800 [2024-11-28 15:25:42.777407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.800 [2024-11-28 15:25:42.777421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.800 [2024-11-28 15:25:42.777434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.800 [2024-11-28 15:25:42.777465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.800 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.787320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.787408] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.800 [2024-11-28 15:25:42.787434] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.800 [2024-11-28 15:25:42.787447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.800 [2024-11-28 15:25:42.787460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.800 [2024-11-28 15:25:42.787490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.800 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.797364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.797448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.800 [2024-11-28 15:25:42.797473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.800 [2024-11-28 15:25:42.797487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.800 [2024-11-28 15:25:42.797499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.800 [2024-11-28 15:25:42.797537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.800 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.807406] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.807526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.800 [2024-11-28 15:25:42.807551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.800 [2024-11-28 15:25:42.807566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.800 [2024-11-28 15:25:42.807579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.800 [2024-11-28 15:25:42.807610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.800 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.817505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.817595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.800 [2024-11-28 15:25:42.817620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.800 [2024-11-28 15:25:42.817634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.800 [2024-11-28 15:25:42.817646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.800 [2024-11-28 15:25:42.817676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.800 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.827435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.827519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.800 [2024-11-28 15:25:42.827545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.800 [2024-11-28 15:25:42.827560] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.800 [2024-11-28 15:25:42.827572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.800 [2024-11-28 15:25:42.827603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.800 qpair failed and we were unable to recover it. 00:30:42.800 [2024-11-28 15:25:42.837595] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.800 [2024-11-28 15:25:42.837686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.837711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.837724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.837737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.837767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.847502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.847591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.847623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.847638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.847651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.847682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.857559] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.857646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.857672] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.857687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.857700] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.857730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.867658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.867743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.867768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.867783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.867796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.867827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.877604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.877731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.877757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.877772] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.877785] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.877815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.887642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.887731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.887757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.887771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.887790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.887823] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.897647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.897738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.897764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.897779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.897792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.897832] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.907671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.907758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.907785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.907800] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.907812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.907842] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.917679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.917763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.917789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.917803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.917816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.917846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.927734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.927821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.927848] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.927863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.927876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.927922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.937763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.937858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.937885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.937899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.937912] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.937942] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.947791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.947906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.947932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.947947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.947960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.947990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.957797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.957883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.957908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.957923] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.801 [2024-11-28 15:25:42.957936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.801 [2024-11-28 15:25:42.957967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.801 qpair failed and we were unable to recover it. 00:30:42.801 [2024-11-28 15:25:42.967848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.801 [2024-11-28 15:25:42.967969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.801 [2024-11-28 15:25:42.967996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.801 [2024-11-28 15:25:42.968011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:42.968023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:42.968053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:42.802 [2024-11-28 15:25:42.977908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.802 [2024-11-28 15:25:42.978025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.802 [2024-11-28 15:25:42.978051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.802 [2024-11-28 15:25:42.978065] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:42.978085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:42.978126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:42.802 [2024-11-28 15:25:42.987904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.802 [2024-11-28 15:25:42.987992] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.802 [2024-11-28 15:25:42.988019] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.802 [2024-11-28 15:25:42.988033] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:42.988046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:42.988076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:42.802 [2024-11-28 15:25:42.998009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.802 [2024-11-28 15:25:42.998114] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.802 [2024-11-28 15:25:42.998150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.802 [2024-11-28 15:25:42.998164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:42.998176] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:42.998207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:42.802 [2024-11-28 15:25:43.007991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.802 [2024-11-28 15:25:43.008080] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.802 [2024-11-28 15:25:43.008113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.802 [2024-11-28 15:25:43.008129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:43.008145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:43.008175] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:42.802 [2024-11-28 15:25:43.018081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.802 [2024-11-28 15:25:43.018201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.802 [2024-11-28 15:25:43.018239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.802 [2024-11-28 15:25:43.018254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:43.018267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:43.018297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:42.802 [2024-11-28 15:25:43.028005] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.802 [2024-11-28 15:25:43.028104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.802 [2024-11-28 15:25:43.028129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.802 [2024-11-28 15:25:43.028144] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.802 [2024-11-28 15:25:43.028156] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:42.802 [2024-11-28 15:25:43.028186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.802 qpair failed and we were unable to recover it. 00:30:43.064 [2024-11-28 15:25:43.038044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.064 [2024-11-28 15:25:43.038139] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.064 [2024-11-28 15:25:43.038165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.064 [2024-11-28 15:25:43.038179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.064 [2024-11-28 15:25:43.038192] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.064 [2024-11-28 15:25:43.038223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.064 qpair failed and we were unable to recover it. 00:30:43.064 [2024-11-28 15:25:43.048079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.064 [2024-11-28 15:25:43.048206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.064 [2024-11-28 15:25:43.048231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.064 [2024-11-28 15:25:43.048246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.064 [2024-11-28 15:25:43.048259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.048290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.058109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.058196] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.058220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.058234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.058247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.058277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.068234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.068363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.068389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.068411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.068424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.068456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.078190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.078275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.078300] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.078314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.078326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.078356] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.088222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.088315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.088341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.088354] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.088366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.088397] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.098224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.098354] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.098381] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.098395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.098408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.098439] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.108377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.108462] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.108486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.108501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.108514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.108544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.118271] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.118357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.118384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.118399] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.118412] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.118442] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.128388] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.128482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.128508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.128532] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.128546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.128576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.138361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.138452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.138477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.138491] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.138503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.138534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.148480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.148598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.148624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.148638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.148651] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.148682] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.158445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.158551] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.158582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.158598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.158611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.158641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.168430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.168522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.065 [2024-11-28 15:25:43.168547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.065 [2024-11-28 15:25:43.168561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.065 [2024-11-28 15:25:43.168573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.065 [2024-11-28 15:25:43.168603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.065 qpair failed and we were unable to recover it. 00:30:43.065 [2024-11-28 15:25:43.178466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.065 [2024-11-28 15:25:43.178556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.178580] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.178595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.178607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.178637] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.188487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.188570] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.188595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.188609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.188622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.188652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.198575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.198696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.198721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.198735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.198749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.198780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.208593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.208683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.208708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.208722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.208734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.208765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.218620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.218709] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.218734] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.218748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.218760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.218790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.228677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.228767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.228792] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.228806] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.228819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.228848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.238662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.238753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.238781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.238798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.238812] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.238843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.248689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.248786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.248821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.248838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.248850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.248881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.258738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.258825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.258850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.258865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.258877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.258907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.268729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.268825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.268850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.268863] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.268876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.268906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.278767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.278895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.278931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.278946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.278959] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.279004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.066 [2024-11-28 15:25:43.288795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.066 [2024-11-28 15:25:43.288888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.066 [2024-11-28 15:25:43.288914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.066 [2024-11-28 15:25:43.288928] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.066 [2024-11-28 15:25:43.288940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.066 [2024-11-28 15:25:43.288979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.066 qpair failed and we were unable to recover it. 00:30:43.328 [2024-11-28 15:25:43.298835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.328 [2024-11-28 15:25:43.298928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.328 [2024-11-28 15:25:43.298953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.328 [2024-11-28 15:25:43.298967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.298980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.299011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.308870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.308964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.308992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.309008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.309021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.309053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.318974] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.319068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.319099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.319116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.319129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.319160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.328962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.329067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.329100] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.329117] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.329129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.329161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.338960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.339043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.339074] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.339089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.339111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.339142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.349089] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.349231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.349261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.349277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.349291] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.349322] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.359056] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.359152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.359177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.359191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.359204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.359234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.369081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.369178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.369203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.369217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.369230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.369261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.379105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.379230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.379258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.379274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.379293] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.379325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.389142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.389233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.389258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.389272] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.389285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.389316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.399169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.399264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.399289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.399303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.399316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.399347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.409203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.409289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.409314] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.409328] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.409340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.409384] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.419234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.419319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.419344] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.419358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.419371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.419401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.329 [2024-11-28 15:25:43.429247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.329 [2024-11-28 15:25:43.429366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.329 [2024-11-28 15:25:43.429390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.329 [2024-11-28 15:25:43.429405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.329 [2024-11-28 15:25:43.429418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.329 [2024-11-28 15:25:43.429449] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.329 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.439293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.439419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.439447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.439462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.439476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.439506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.449400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.449498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.449524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.449538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.449550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.449594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.459364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.459456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.459481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.459495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.459508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.459538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.469357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.469446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.469472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.469485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.469503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.469535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.479471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.479556] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.479582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.479596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.479608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.479638] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.489440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.489532] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.489559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.489575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.489588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.489619] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.499433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.499518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.499545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.499559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.499574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.499603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.509479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.509603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.509628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.509643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.509656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.509688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.519521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.519603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.519629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.519644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.519657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.519704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.529546] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.529635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.529660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.529674] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.529686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.529716] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.539602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.539690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.539718] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.539733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.539746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.539776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.549630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.549714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.549741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.549756] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.549769] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.549811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.330 [2024-11-28 15:25:43.559630] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.330 [2024-11-28 15:25:43.559720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.330 [2024-11-28 15:25:43.559746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.330 [2024-11-28 15:25:43.559766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.330 [2024-11-28 15:25:43.559779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.330 [2024-11-28 15:25:43.559809] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.330 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.569697] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.569792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.569822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.569838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.569851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.569882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.579679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.579762] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.579789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.579803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.579816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.579847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.589706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.589792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.589819] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.589833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.589848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.589878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.599735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.599873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.599900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.599914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.599929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.599959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.609873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.609994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.610021] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.610036] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.610050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.610080] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.619830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.619918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.619946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.619961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.619973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.620004] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.629826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.629955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.629983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.629998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.630011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.630042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.640224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.640319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.640346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.640360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.640373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.640404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.649894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.649984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.650009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.650029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.650043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.650088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.659999] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.660085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.660132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.660147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.660159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.591 [2024-11-28 15:25:43.660190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.591 qpair failed and we were unable to recover it. 00:30:43.591 [2024-11-28 15:25:43.669959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.591 [2024-11-28 15:25:43.670075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.591 [2024-11-28 15:25:43.670109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.591 [2024-11-28 15:25:43.670125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.591 [2024-11-28 15:25:43.670139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.670169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.680049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.680154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.680179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.680193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.680206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.680236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.689991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.690089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.690122] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.690137] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.690150] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.690180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.700104] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.700209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.700236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.700251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.700264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.700297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.710064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.710169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.710200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.710216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.710230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.710262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.720136] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.720242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.720269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.720283] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.720297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.720345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.730202] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.730290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.730317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.730331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.730344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.730376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.740235] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.740324] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.740357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.740372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.740384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.740414] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.750248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.750333] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.750359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.750374] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.750386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.750417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.760216] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.760306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.760333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.760347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.760360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.760392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.770233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.770320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.770346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.770361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.770374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.770405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.780246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.780332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.780359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.780373] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.780386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.780424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.790322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.790404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.790431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.790446] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.790459] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.790490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.592 [2024-11-28 15:25:43.800331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.592 [2024-11-28 15:25:43.800417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.592 [2024-11-28 15:25:43.800443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.592 [2024-11-28 15:25:43.800457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.592 [2024-11-28 15:25:43.800470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.592 [2024-11-28 15:25:43.800501] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.592 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-28 15:25:43.810352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.593 [2024-11-28 15:25:43.810441] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.593 [2024-11-28 15:25:43.810468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.593 [2024-11-28 15:25:43.810482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.593 [2024-11-28 15:25:43.810496] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.593 [2024-11-28 15:25:43.810527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.593 [2024-11-28 15:25:43.820445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.593 [2024-11-28 15:25:43.820584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.593 [2024-11-28 15:25:43.820610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.593 [2024-11-28 15:25:43.820624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.593 [2024-11-28 15:25:43.820637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.593 [2024-11-28 15:25:43.820669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.593 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.830421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.830502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.830535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.830550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.830563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.830594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.840410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.840509] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.840536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.840550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.840563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.840594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.850451] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.850541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.850568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.850582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.850595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.850626] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.860493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.860581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.860607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.860622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.860634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.860666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.870517] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.870595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.870620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.870633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.870646] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.870680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.880539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.880620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.880646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.880660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.880675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.880705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.890629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.890716] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.890742] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.890757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.890770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.890801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.900589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.900681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.900707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.900722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.900735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.900765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.910721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.910846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.910872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.910887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.910900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.910931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.920653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.920736] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.920762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.853 [2024-11-28 15:25:43.920777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.853 [2024-11-28 15:25:43.920790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.853 [2024-11-28 15:25:43.920835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.853 qpair failed and we were unable to recover it. 00:30:43.853 [2024-11-28 15:25:43.930705] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.853 [2024-11-28 15:25:43.930820] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.853 [2024-11-28 15:25:43.930846] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.930861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.930874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.930905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:43.940749] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:43.940839] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:43.940866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.940880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.940893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.940924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:43.950733] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:43.950812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:43.950839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.950853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.950866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.950912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:43.960750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:43.960835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:43.960861] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.960875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.960894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.960926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:43.970791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:43.970882] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:43.970908] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.970921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.970934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.970965] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:43.980832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:43.980928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:43.980955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.980969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.980982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.981013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:43.990844] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:43.990929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:43.990955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:43.990969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:43.990982] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:43.991014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.000899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.000986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.001012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.001027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.001040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.001071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.010910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.011028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.011055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.011070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.011084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.011123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.020941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.021054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.021082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.021108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.021125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.021169] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.030966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.031084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.031124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.031140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.031154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.031186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.041007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.041107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.041142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.041159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.041172] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.041203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.051025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.051124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.051151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.051171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.051186] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.051216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.061046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.854 [2024-11-28 15:25:44.061136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.854 [2024-11-28 15:25:44.061162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.854 [2024-11-28 15:25:44.061176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.854 [2024-11-28 15:25:44.061190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.854 [2024-11-28 15:25:44.061221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.854 qpair failed and we were unable to recover it. 00:30:43.854 [2024-11-28 15:25:44.071110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.855 [2024-11-28 15:25:44.071199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.855 [2024-11-28 15:25:44.071224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.855 [2024-11-28 15:25:44.071238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.855 [2024-11-28 15:25:44.071252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.855 [2024-11-28 15:25:44.071283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.855 qpair failed and we were unable to recover it. 00:30:43.855 [2024-11-28 15:25:44.081133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:43.855 [2024-11-28 15:25:44.081219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:43.855 [2024-11-28 15:25:44.081245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:43.855 [2024-11-28 15:25:44.081259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:43.855 [2024-11-28 15:25:44.081271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:43.855 [2024-11-28 15:25:44.081302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:43.855 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.091190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.091282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.091309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.091323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.091335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.091366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.101272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.101390] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.101416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.101430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.101443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.101472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.111226] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.111320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.111346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.111360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.111372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.111404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.121318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.121398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.121424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.121438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.121451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.121480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.131331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.131420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.131447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.131462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.131476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.131505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.141343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.141432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.141458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.141480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.141495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.141526] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.151335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.151414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.151440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.151453] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.151466] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.151495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.161367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.161451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.161477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.161490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.115 [2024-11-28 15:25:44.161503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.115 [2024-11-28 15:25:44.161533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.115 qpair failed and we were unable to recover it. 00:30:44.115 [2024-11-28 15:25:44.171368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.115 [2024-11-28 15:25:44.171468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.115 [2024-11-28 15:25:44.171494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.115 [2024-11-28 15:25:44.171508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.171521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.171550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.181401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.181485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.181511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.181525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.181538] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.181567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.191424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.191526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.191551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.191565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.191577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.191606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.201450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.201539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.201565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.201578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.201591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.201620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.211525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.211616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.211641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.211655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.211667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.211697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.221560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.221647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.221673] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.221687] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.221699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.221729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.231583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.231696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.231727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.231743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.231755] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.231785] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.241629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.241729] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.241755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.241769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.241781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.241824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.251686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.251807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.251834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.251847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.251860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.251889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.261663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.261753] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.261778] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.261793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.261805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.261834] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.271699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.271787] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.271813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.271826] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.271839] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.271875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.281703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.281791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.281817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.281831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.281843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.281873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.116 [2024-11-28 15:25:44.291751] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.116 [2024-11-28 15:25:44.291842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.116 [2024-11-28 15:25:44.291868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.116 [2024-11-28 15:25:44.291882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.116 [2024-11-28 15:25:44.291894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.116 [2024-11-28 15:25:44.291924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.116 qpair failed and we were unable to recover it. 00:30:44.117 [2024-11-28 15:25:44.301791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.117 [2024-11-28 15:25:44.301874] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.117 [2024-11-28 15:25:44.301901] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.117 [2024-11-28 15:25:44.301915] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.117 [2024-11-28 15:25:44.301928] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.117 [2024-11-28 15:25:44.301972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.117 qpair failed and we were unable to recover it. 00:30:44.117 [2024-11-28 15:25:44.311825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.117 [2024-11-28 15:25:44.311913] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.117 [2024-11-28 15:25:44.311940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.117 [2024-11-28 15:25:44.311954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.117 [2024-11-28 15:25:44.311967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.117 [2024-11-28 15:25:44.311996] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.117 qpair failed and we were unable to recover it. 00:30:44.117 [2024-11-28 15:25:44.321821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.117 [2024-11-28 15:25:44.321902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.117 [2024-11-28 15:25:44.321933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.117 [2024-11-28 15:25:44.321948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.117 [2024-11-28 15:25:44.321961] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.117 [2024-11-28 15:25:44.321990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.117 qpair failed and we were unable to recover it. 00:30:44.117 [2024-11-28 15:25:44.331870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.117 [2024-11-28 15:25:44.331960] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.117 [2024-11-28 15:25:44.331986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.117 [2024-11-28 15:25:44.332001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.117 [2024-11-28 15:25:44.332013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.117 [2024-11-28 15:25:44.332043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.117 qpair failed and we were unable to recover it. 00:30:44.117 [2024-11-28 15:25:44.341891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.117 [2024-11-28 15:25:44.341978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.117 [2024-11-28 15:25:44.342004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.117 [2024-11-28 15:25:44.342018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.117 [2024-11-28 15:25:44.342030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.117 [2024-11-28 15:25:44.342075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.117 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.351915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.351994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.352020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.352034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.352046] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.352089] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.361932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.362017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.362042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.362056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.362070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.362113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.371976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.372065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.372090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.372113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.372126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.372155] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.381996] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.382090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.382126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.382140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.382152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.382195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.392050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.392140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.392166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.392179] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.392193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.392224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.402063] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.402162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.402192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.402208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.402221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.402253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.412105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.412213] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.412244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.412259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.412272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.412303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.422138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.422269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.422296] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.422311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.422323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.422353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.432140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.432217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.432243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.432257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.432269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.432301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.442212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.442334] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.442359] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.442372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.442386] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.442415] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.452214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.452301] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.452326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.452340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.452359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.452390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.462258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.462379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.378 [2024-11-28 15:25:44.462404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.378 [2024-11-28 15:25:44.462418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.378 [2024-11-28 15:25:44.462431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.378 [2024-11-28 15:25:44.462462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.378 qpair failed and we were unable to recover it. 00:30:44.378 [2024-11-28 15:25:44.472347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.378 [2024-11-28 15:25:44.472433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.472459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.472473] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.472486] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.472515] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.482313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.482403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.482429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.482442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.482455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.482485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.492341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.492426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.492451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.492465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.492478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.492509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.502365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.502456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.502481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.502495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.502507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.502537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.512504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.512597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.512623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.512636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.512649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.512679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.522398] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.522482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.522507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.522521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.522534] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.522563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.532441] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.532530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.532556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.532570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.532583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.532613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.542459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.542593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.542618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.542631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.542650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.542679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.552534] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.552638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.552663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.552677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.552690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.552719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.562570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.562658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.562684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.562698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.562711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.562754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.572548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.572681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.572706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.572720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.572733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.572763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.582684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.582775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.582801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.582815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.582827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.582858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.592684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.592766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.592791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.592805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.592817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.379 [2024-11-28 15:25:44.592846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.379 qpair failed and we were unable to recover it. 00:30:44.379 [2024-11-28 15:25:44.602676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.379 [2024-11-28 15:25:44.602775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.379 [2024-11-28 15:25:44.602811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.379 [2024-11-28 15:25:44.602829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.379 [2024-11-28 15:25:44.602843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.380 [2024-11-28 15:25:44.602878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.380 qpair failed and we were unable to recover it. 00:30:44.642 [2024-11-28 15:25:44.612682] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.642 [2024-11-28 15:25:44.612801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.642 [2024-11-28 15:25:44.612827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.642 [2024-11-28 15:25:44.612840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.642 [2024-11-28 15:25:44.612853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.642 [2024-11-28 15:25:44.612885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.642 qpair failed and we were unable to recover it. 00:30:44.642 [2024-11-28 15:25:44.622703] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.642 [2024-11-28 15:25:44.622790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.622816] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.622830] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.622843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.622872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.632727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.632813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.632841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.632862] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.632876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.632906] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.642835] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.642919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.642946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.642960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.642973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.643003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.652803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.652892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.652919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.652934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.652947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.652977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.662825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.662914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.662943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.662958] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.662971] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.663001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.672888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.672991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.673017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.673031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.673043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.673073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.682864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.682951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.682980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.682994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.683006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.683037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.692920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.693015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.693044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.693059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.693071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.693111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.703030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.703124] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.703150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.703165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.703177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.703206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.712947] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.713077] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.713109] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.713124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.713137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.713166] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.723122] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.723211] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.723242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.723257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.723270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.723300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.733106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.733206] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.733235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.733250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.733263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.733292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.743035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.743125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.743161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.643 [2024-11-28 15:25:44.743175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.643 [2024-11-28 15:25:44.743188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.643 [2024-11-28 15:25:44.743217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.643 qpair failed and we were unable to recover it. 00:30:44.643 [2024-11-28 15:25:44.753073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.643 [2024-11-28 15:25:44.753175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.643 [2024-11-28 15:25:44.753204] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.753219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.753232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.753262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.763115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.763222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.763251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.763267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.763280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.763310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.773156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.773250] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.773277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.773291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.773303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.773333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.783211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.783351] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.783380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.783396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.783410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.783440] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.793225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.793343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.793373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.793389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.793402] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.793435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.803248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.803337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.803365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.803380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.803392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.803424] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.813390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.813479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.813513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.813528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.813541] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.813570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.823286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.823385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.823414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.823431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.823445] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.823476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.833334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.833423] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.833448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.833462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.833475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.833505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.843338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.843446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.843472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.843486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.843499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.843527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.853389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.853477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.853503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.853516] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.853529] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.853565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.863394] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.863483] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.863509] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.863523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.863535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.863565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.644 [2024-11-28 15:25:44.873450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.644 [2024-11-28 15:25:44.873535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.644 [2024-11-28 15:25:44.873559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.644 [2024-11-28 15:25:44.873572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.644 [2024-11-28 15:25:44.873583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.644 [2024-11-28 15:25:44.873612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.644 qpair failed and we were unable to recover it. 00:30:44.904 [2024-11-28 15:25:44.883434] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.904 [2024-11-28 15:25:44.883541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.904 [2024-11-28 15:25:44.883567] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.904 [2024-11-28 15:25:44.883581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.904 [2024-11-28 15:25:44.883594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.904 [2024-11-28 15:25:44.883623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.904 qpair failed and we were unable to recover it. 00:30:44.904 [2024-11-28 15:25:44.893515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.904 [2024-11-28 15:25:44.893606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.904 [2024-11-28 15:25:44.893631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.904 [2024-11-28 15:25:44.893646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.904 [2024-11-28 15:25:44.893658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.904 [2024-11-28 15:25:44.893689] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.904 qpair failed and we were unable to recover it. 00:30:44.904 [2024-11-28 15:25:44.903531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.904 [2024-11-28 15:25:44.903663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.904 [2024-11-28 15:25:44.903695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.904 [2024-11-28 15:25:44.903710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.904 [2024-11-28 15:25:44.903723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.904 [2024-11-28 15:25:44.903752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.913538] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.913640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.913665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.913679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.913691] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.913721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.923555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.923638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.923663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.923677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.923689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.923731] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.933664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.933780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.933806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.933819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.933832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.933863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.943657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.943786] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.943812] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.943825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.943843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.943874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.953674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.953760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.953786] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.953799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.953811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.953841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.963660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.963745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.963770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.963784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.963796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.963839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.973742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.973841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.973867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.973880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.973893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.973925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.983715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.983801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.983826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.983840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.983853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.983882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:44.993779] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:44.993864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:44.993891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:44.993905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:44.993917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:44.993959] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:45.003765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:45.003894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:45.003920] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:45.003934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:45.003947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.905 [2024-11-28 15:25:45.003976] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.905 qpair failed and we were unable to recover it. 00:30:44.905 [2024-11-28 15:25:45.013907] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.905 [2024-11-28 15:25:45.013999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.905 [2024-11-28 15:25:45.014024] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.905 [2024-11-28 15:25:45.014038] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.905 [2024-11-28 15:25:45.014051] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.014081] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.023878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.023961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.023986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.024000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.024013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.024044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.033877] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.033961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.033986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.034000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.034018] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.034048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.043882] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.043968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.043993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.044007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.044020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.044050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.053967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.054053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.054078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.054102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.054118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.054149] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.063962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.064059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.064084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.064105] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.064117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.064147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.073979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.074063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.074089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.074113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.074127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.074170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.084018] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.084107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.084133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.084146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.084158] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.084188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.094087] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.094195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.094220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.094234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.094246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.094291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.104069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.104156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.104183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.104196] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.104209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.104240] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.114103] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.114229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.114254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.114268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.114281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.906 [2024-11-28 15:25:45.114310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.906 qpair failed and we were unable to recover it. 00:30:44.906 [2024-11-28 15:25:45.124221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.906 [2024-11-28 15:25:45.124306] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.906 [2024-11-28 15:25:45.124332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.906 [2024-11-28 15:25:45.124362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.906 [2024-11-28 15:25:45.124376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.907 [2024-11-28 15:25:45.124407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.907 qpair failed and we were unable to recover it. 00:30:44.907 [2024-11-28 15:25:45.134188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:44.907 [2024-11-28 15:25:45.134278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:44.907 [2024-11-28 15:25:45.134303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:44.907 [2024-11-28 15:25:45.134317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:44.907 [2024-11-28 15:25:45.134329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:44.907 [2024-11-28 15:25:45.134358] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:44.907 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.144206] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.144296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.144322] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.144336] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.144349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.144378] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.154244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.154357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.154383] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.154396] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.154409] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.154438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.164280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.164363] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.164392] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.164406] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.164418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.164450] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.174283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.174384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.174410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.174424] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.174437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.174466] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.184310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.184435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.184460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.184475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.184487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.184516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.194349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.194437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.194462] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.194475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.194488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.194519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.204369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.204449] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.204475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.204489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.204502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.204547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.214404] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.214524] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.214549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.214570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.214583] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.214613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.224426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.224536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.224562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.224576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.224589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.224631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.234448] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.234541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.234568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.234581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.234594] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.234624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.244506] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.244643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.244668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.244683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.244695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.244724] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.254617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.254706] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.254731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.254745] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.254758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.254789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.264567] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.264657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.264683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.264696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.264709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.264739] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.274560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.274652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.274677] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.274691] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.274703] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.274735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.284591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.284673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.284699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.284713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.284726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.284757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.294623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.294708] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.294733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.294746] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.294758] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.294787] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.304653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.304741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.304771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.304786] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.304799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.304828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.314740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.314846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.314871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.314884] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.314897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.314926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.324724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.324803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.324829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.324842] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.324855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.324885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.334801] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.334894] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.334919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.334933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.334945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.334975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.344772] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.344866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.344891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.344904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.344917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.344953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.354807] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.354895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.354922] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.168 [2024-11-28 15:25:45.354935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.168 [2024-11-28 15:25:45.354949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.168 [2024-11-28 15:25:45.354980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.168 qpair failed and we were unable to recover it. 00:30:45.168 [2024-11-28 15:25:45.364858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.168 [2024-11-28 15:25:45.364936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.168 [2024-11-28 15:25:45.364962] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.169 [2024-11-28 15:25:45.364975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.169 [2024-11-28 15:25:45.364988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.169 [2024-11-28 15:25:45.365017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.169 qpair failed and we were unable to recover it. 00:30:45.169 [2024-11-28 15:25:45.374908] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.169 [2024-11-28 15:25:45.374995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.169 [2024-11-28 15:25:45.375020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.169 [2024-11-28 15:25:45.375034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.169 [2024-11-28 15:25:45.375047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.169 [2024-11-28 15:25:45.375077] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.169 qpair failed and we were unable to recover it. 00:30:45.169 [2024-11-28 15:25:45.384905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.169 [2024-11-28 15:25:45.385015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.169 [2024-11-28 15:25:45.385040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.169 [2024-11-28 15:25:45.385054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.169 [2024-11-28 15:25:45.385066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.169 [2024-11-28 15:25:45.385105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.169 qpair failed and we were unable to recover it. 00:30:45.169 [2024-11-28 15:25:45.394924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.169 [2024-11-28 15:25:45.395010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.169 [2024-11-28 15:25:45.395040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.169 [2024-11-28 15:25:45.395057] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.169 [2024-11-28 15:25:45.395070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.169 [2024-11-28 15:25:45.395110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.169 qpair failed and we were unable to recover it. 00:30:45.429 [2024-11-28 15:25:45.404982] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.429 [2024-11-28 15:25:45.405103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.429 [2024-11-28 15:25:45.405129] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.429 [2024-11-28 15:25:45.405143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.429 [2024-11-28 15:25:45.405155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.429 [2024-11-28 15:25:45.405186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.429 qpair failed and we were unable to recover it. 00:30:45.429 [2024-11-28 15:25:45.415000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.429 [2024-11-28 15:25:45.415091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.429 [2024-11-28 15:25:45.415124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.429 [2024-11-28 15:25:45.415138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.429 [2024-11-28 15:25:45.415149] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.429 [2024-11-28 15:25:45.415180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.429 qpair failed and we were unable to recover it. 00:30:45.429 [2024-11-28 15:25:45.425131] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.425222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.425251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.425269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.425282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.425313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.435059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.435158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.435187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.435203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.435215] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.435255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.445170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.445263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.445293] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.445308] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.445321] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.445352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.455121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.455209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.455236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.455250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.455262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.455292] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.465143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.465228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.465255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.465269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.465281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.465312] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.475196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.475283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.475309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.475323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.475335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.475365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.485305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.485405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.485431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.485445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.485458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.485487] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.495295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.495413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.495439] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.495452] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.495465] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.495495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.505260] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.505357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.505387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.505409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.505423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.505454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.515284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.515371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.515396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.515410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.515422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.515453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.525338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.525417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.525443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.525457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.525475] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.525508] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.535375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.535499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.535525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.535539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.535551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.535580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.545368] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.545461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.430 [2024-11-28 15:25:45.545486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.430 [2024-11-28 15:25:45.545500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.430 [2024-11-28 15:25:45.545512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.430 [2024-11-28 15:25:45.545541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.430 qpair failed and we were unable to recover it. 00:30:45.430 [2024-11-28 15:25:45.555442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.430 [2024-11-28 15:25:45.555534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.555559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.555573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.555585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.555616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.565455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.565580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.565606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.565619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.565632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.565664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.575475] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.575565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.575592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.575605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.575618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.575661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.585542] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.585638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.585663] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.585677] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.585689] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.585719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.595530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.595613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.595639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.595653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.595665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.595694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.605594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.605701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.605726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.605740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.605753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.605783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.615598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.615689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.615714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.615738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.615752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.615782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.625600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.625686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.625711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.625725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.625738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.625768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.635680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.635793] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.635821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.635835] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.635848] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.635878] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.645691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.645774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.645800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.645814] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.645826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.645858] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.431 [2024-11-28 15:25:45.655686] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.431 [2024-11-28 15:25:45.655775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.431 [2024-11-28 15:25:45.655800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.431 [2024-11-28 15:25:45.655813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.431 [2024-11-28 15:25:45.655826] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.431 [2024-11-28 15:25:45.655855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.431 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.665753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.665843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.665869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.665883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.665896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.665939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.675735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.675825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.675850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.675865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.675877] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.675907] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.685767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.685853] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.685878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.685892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.685905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.685935] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.695849] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.695957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.695983] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.695998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.696010] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.696054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.705838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.705929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.705955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.705976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.705989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.706019] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.715888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.715971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.715998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.716011] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.716024] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.716054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.725924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.726006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.726031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.726045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.726058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.726088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.735938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.736040] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.736065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.736078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.736091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.736131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.745953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.746044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.746069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.746083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.746101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.746133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.755980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.692 [2024-11-28 15:25:45.756073] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.692 [2024-11-28 15:25:45.756108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.692 [2024-11-28 15:25:45.756125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.692 [2024-11-28 15:25:45.756137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.692 [2024-11-28 15:25:45.756167] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.692 qpair failed and we were unable to recover it. 00:30:45.692 [2024-11-28 15:25:45.766107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.766203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.766229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.766242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.766255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.766284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.776072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.776168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.776193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.776207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.776220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.776250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.786054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.786154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.786180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.786193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.786205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.786235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.796113] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.796197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.796227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.796242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.796255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.796284] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.806144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.806257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.806285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.806299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.806313] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.806342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.816153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.816256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.816282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.816296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.816308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.816338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.826174] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.826260] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.826285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.826299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.826312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.826342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.836198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.836281] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.836306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.836321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.836334] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.836370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.846244] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.846340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.846366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.846380] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.846393] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.846436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.856381] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.856484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.856510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.856523] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.856535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.856565] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.866341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.866432] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.866458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.866471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.866484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.866513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.876313] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.876413] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.876436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.876449] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.876461] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.876490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.886416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.886522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.693 [2024-11-28 15:25:45.886553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.693 [2024-11-28 15:25:45.886568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.693 [2024-11-28 15:25:45.886581] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.693 [2024-11-28 15:25:45.886612] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.693 qpair failed and we were unable to recover it. 00:30:45.693 [2024-11-28 15:25:45.896421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.693 [2024-11-28 15:25:45.896507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.694 [2024-11-28 15:25:45.896533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.694 [2024-11-28 15:25:45.896547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.694 [2024-11-28 15:25:45.896560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.694 [2024-11-28 15:25:45.896589] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.694 qpair failed and we were unable to recover it. 00:30:45.694 [2024-11-28 15:25:45.906442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.694 [2024-11-28 15:25:45.906548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.694 [2024-11-28 15:25:45.906575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.694 [2024-11-28 15:25:45.906588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.694 [2024-11-28 15:25:45.906601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.694 [2024-11-28 15:25:45.906644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.694 qpair failed and we were unable to recover it. 00:30:45.694 [2024-11-28 15:25:45.916432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.694 [2024-11-28 15:25:45.916511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.694 [2024-11-28 15:25:45.916536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.694 [2024-11-28 15:25:45.916549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.694 [2024-11-28 15:25:45.916562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.694 [2024-11-28 15:25:45.916591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.694 qpair failed and we were unable to recover it. 00:30:45.952 [2024-11-28 15:25:45.926474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:45.952 [2024-11-28 15:25:45.926559] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:45.952 [2024-11-28 15:25:45.926585] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:45.952 [2024-11-28 15:25:45.926598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:45.952 [2024-11-28 15:25:45.926611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f2ca0000b90 00:30:45.952 [2024-11-28 15:25:45.926647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:45.952 qpair failed and we were unable to recover it. 00:30:45.952 [2024-11-28 15:25:45.926803] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:45.952 A controller has encountered a failure and is being reset. 00:30:45.952 Controller properly reset. 00:30:45.952 Initializing NVMe Controllers 00:30:45.952 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:45.952 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:45.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:45.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:45.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:45.952 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:45.952 Initialization complete. Launching workers. 00:30:45.952 Starting thread on core 1 00:30:45.952 Starting thread on core 2 00:30:45.952 Starting thread on core 3 00:30:45.952 Starting thread on core 0 00:30:45.952 15:25:46 -- host/target_disconnect.sh@59 -- # sync 00:30:45.952 00:30:45.952 real 0m11.448s 00:30:45.953 user 0m21.699s 00:30:45.953 sys 0m5.480s 00:30:45.953 15:25:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.953 15:25:46 -- common/autotest_common.sh@10 -- # set +x 00:30:45.953 ************************************ 00:30:45.953 END TEST nvmf_target_disconnect_tc2 00:30:45.953 ************************************ 00:30:45.953 15:25:46 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:45.953 15:25:46 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:45.953 15:25:46 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:45.953 15:25:46 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:45.953 15:25:46 -- nvmf/common.sh@116 -- # sync 00:30:45.953 15:25:46 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:45.953 15:25:46 -- nvmf/common.sh@119 -- # set +e 00:30:45.953 15:25:46 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:45.953 15:25:46 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:45.953 rmmod nvme_tcp 00:30:45.953 rmmod nvme_fabrics 00:30:45.953 rmmod nvme_keyring 00:30:45.953 15:25:46 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:45.953 15:25:46 -- nvmf/common.sh@123 -- # set -e 00:30:45.953 15:25:46 -- nvmf/common.sh@124 -- # return 0 00:30:45.953 15:25:46 -- nvmf/common.sh@477 -- # '[' -n 842284 ']' 00:30:45.953 15:25:46 -- nvmf/common.sh@478 -- # killprocess 842284 00:30:45.953 15:25:46 -- common/autotest_common.sh@936 -- # '[' -z 842284 ']' 00:30:45.953 15:25:46 -- common/autotest_common.sh@940 -- # kill -0 842284 00:30:45.953 15:25:46 -- common/autotest_common.sh@941 -- # uname 00:30:45.953 15:25:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:45.953 15:25:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 842284 00:30:45.953 15:25:46 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:45.953 15:25:46 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:45.953 15:25:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 842284' 00:30:45.953 killing process with pid 842284 00:30:45.953 15:25:46 -- common/autotest_common.sh@955 -- # kill 842284 00:30:45.953 15:25:46 -- common/autotest_common.sh@960 -- # wait 842284 00:30:46.212 15:25:46 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:46.212 15:25:46 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:46.212 15:25:46 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:46.212 15:25:46 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:46.212 15:25:46 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:46.212 15:25:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:46.212 15:25:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:46.212 15:25:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:48.751 15:25:48 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:48.752 00:30:48.752 real 0m16.291s 00:30:48.752 user 0m47.692s 00:30:48.752 sys 0m7.501s 00:30:48.752 15:25:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:48.752 15:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:48.752 ************************************ 00:30:48.752 END TEST nvmf_target_disconnect 00:30:48.752 ************************************ 00:30:48.752 15:25:48 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:48.752 15:25:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:48.752 15:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:48.752 15:25:48 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:48.752 00:30:48.752 real 22m50.587s 00:30:48.752 user 66m12.645s 00:30:48.752 sys 5m28.168s 00:30:48.752 15:25:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:48.752 15:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:48.752 ************************************ 00:30:48.752 END TEST nvmf_tcp 00:30:48.752 ************************************ 00:30:48.752 15:25:48 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:48.752 15:25:48 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:48.752 15:25:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:48.752 15:25:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:48.752 15:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:48.752 ************************************ 00:30:48.752 START TEST spdkcli_nvmf_tcp 00:30:48.752 ************************************ 00:30:48.752 15:25:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:48.752 * Looking for test storage... 00:30:48.752 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:48.752 15:25:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:48.752 15:25:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:48.752 15:25:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:48.752 15:25:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:48.752 15:25:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:48.752 15:25:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:48.752 15:25:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:48.752 15:25:48 -- scripts/common.sh@335 -- # IFS=.-: 00:30:48.752 15:25:48 -- scripts/common.sh@335 -- # read -ra ver1 00:30:48.752 15:25:48 -- scripts/common.sh@336 -- # IFS=.-: 00:30:48.752 15:25:48 -- scripts/common.sh@336 -- # read -ra ver2 00:30:48.752 15:25:48 -- scripts/common.sh@337 -- # local 'op=<' 00:30:48.752 15:25:48 -- scripts/common.sh@339 -- # ver1_l=2 00:30:48.752 15:25:48 -- scripts/common.sh@340 -- # ver2_l=1 00:30:48.752 15:25:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:48.752 15:25:48 -- scripts/common.sh@343 -- # case "$op" in 00:30:48.752 15:25:48 -- scripts/common.sh@344 -- # : 1 00:30:48.752 15:25:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:48.752 15:25:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:48.752 15:25:48 -- scripts/common.sh@364 -- # decimal 1 00:30:48.752 15:25:48 -- scripts/common.sh@352 -- # local d=1 00:30:48.752 15:25:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:48.752 15:25:48 -- scripts/common.sh@354 -- # echo 1 00:30:48.752 15:25:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:48.752 15:25:48 -- scripts/common.sh@365 -- # decimal 2 00:30:48.752 15:25:48 -- scripts/common.sh@352 -- # local d=2 00:30:48.752 15:25:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:48.752 15:25:48 -- scripts/common.sh@354 -- # echo 2 00:30:48.752 15:25:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:48.752 15:25:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:48.752 15:25:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:48.752 15:25:48 -- scripts/common.sh@367 -- # return 0 00:30:48.752 15:25:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:48.752 15:25:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:48.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.752 --rc genhtml_branch_coverage=1 00:30:48.752 --rc genhtml_function_coverage=1 00:30:48.752 --rc genhtml_legend=1 00:30:48.752 --rc geninfo_all_blocks=1 00:30:48.752 --rc geninfo_unexecuted_blocks=1 00:30:48.752 00:30:48.752 ' 00:30:48.752 15:25:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:48.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.752 --rc genhtml_branch_coverage=1 00:30:48.752 --rc genhtml_function_coverage=1 00:30:48.752 --rc genhtml_legend=1 00:30:48.752 --rc geninfo_all_blocks=1 00:30:48.752 --rc geninfo_unexecuted_blocks=1 00:30:48.752 00:30:48.752 ' 00:30:48.752 15:25:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:48.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.752 --rc genhtml_branch_coverage=1 00:30:48.752 --rc genhtml_function_coverage=1 00:30:48.752 --rc genhtml_legend=1 00:30:48.752 --rc geninfo_all_blocks=1 00:30:48.752 --rc geninfo_unexecuted_blocks=1 00:30:48.752 00:30:48.752 ' 00:30:48.752 15:25:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:48.752 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:48.752 --rc genhtml_branch_coverage=1 00:30:48.752 --rc genhtml_function_coverage=1 00:30:48.752 --rc genhtml_legend=1 00:30:48.752 --rc geninfo_all_blocks=1 00:30:48.752 --rc geninfo_unexecuted_blocks=1 00:30:48.752 00:30:48.752 ' 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:48.752 15:25:48 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:48.752 15:25:48 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:48.752 15:25:48 -- nvmf/common.sh@7 -- # uname -s 00:30:48.752 15:25:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:48.752 15:25:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:48.752 15:25:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:48.752 15:25:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:48.752 15:25:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:48.752 15:25:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:48.752 15:25:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:48.752 15:25:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:48.752 15:25:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:48.752 15:25:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:48.752 15:25:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:48.752 15:25:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:48.752 15:25:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:48.752 15:25:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:48.752 15:25:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:48.752 15:25:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:48.752 15:25:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:48.752 15:25:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:48.752 15:25:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:48.752 15:25:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.752 15:25:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.752 15:25:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.752 15:25:48 -- paths/export.sh@5 -- # export PATH 00:30:48.752 15:25:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:48.752 15:25:48 -- nvmf/common.sh@46 -- # : 0 00:30:48.752 15:25:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:48.752 15:25:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:48.752 15:25:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:48.752 15:25:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:48.752 15:25:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:48.752 15:25:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:48.752 15:25:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:48.752 15:25:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:48.752 15:25:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:48.752 15:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:48.752 15:25:48 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:48.752 15:25:48 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=843464 00:30:48.752 15:25:48 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:48.752 15:25:48 -- spdkcli/common.sh@34 -- # waitforlisten 843464 00:30:48.752 15:25:48 -- common/autotest_common.sh@829 -- # '[' -z 843464 ']' 00:30:48.752 15:25:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:48.752 15:25:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:48.752 15:25:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:48.752 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:48.752 15:25:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:48.752 15:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:48.752 [2024-11-28 15:25:48.654905] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:30:48.752 [2024-11-28 15:25:48.655000] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid843464 ] 00:30:48.752 EAL: No free 2048 kB hugepages reported on node 1 00:30:48.752 [2024-11-28 15:25:48.728326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:48.752 [2024-11-28 15:25:48.817734] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:48.752 [2024-11-28 15:25:48.817946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:48.752 [2024-11-28 15:25:48.817951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:49.687 15:25:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:49.687 15:25:49 -- common/autotest_common.sh@862 -- # return 0 00:30:49.687 15:25:49 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:49.687 15:25:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:49.687 15:25:49 -- common/autotest_common.sh@10 -- # set +x 00:30:49.687 15:25:49 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:49.687 15:25:49 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:49.687 15:25:49 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:49.687 15:25:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:49.687 15:25:49 -- common/autotest_common.sh@10 -- # set +x 00:30:49.687 15:25:49 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:49.687 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:49.687 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:49.687 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:49.687 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:49.687 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:49.687 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:49.687 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:49.687 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:49.687 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:49.687 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:49.687 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:49.687 ' 00:30:49.947 [2024-11-28 15:25:50.094644] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:52.484 [2024-11-28 15:25:52.301213] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:53.423 [2024-11-28 15:25:53.553813] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:55.958 [2024-11-28 15:25:55.849215] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:57.864 [2024-11-28 15:25:57.815826] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:59.242 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:59.242 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:59.242 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:59.242 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:59.242 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:59.242 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:59.242 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:59.242 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:59.243 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:59.243 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:59.243 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:59.243 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:59.243 15:25:59 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:59.243 15:25:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:59.243 15:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:59.243 15:25:59 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:59.243 15:25:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:59.243 15:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:59.243 15:25:59 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:59.243 15:25:59 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:59.810 15:25:59 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:59.810 15:25:59 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:59.810 15:25:59 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:59.810 15:25:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:59.810 15:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:59.810 15:25:59 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:59.810 15:25:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:59.810 15:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:59.810 15:25:59 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:59.810 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:59.810 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:59.810 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:59.810 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:59.810 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:59.810 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:59.810 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:59.810 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:59.810 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:59.810 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:59.810 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:59.810 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:59.810 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:59.810 ' 00:31:05.082 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:05.082 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:05.082 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:05.082 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:05.082 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:05.082 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:05.082 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:05.082 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:05.082 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:05.082 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:05.082 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:05.082 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:05.082 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:05.082 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:05.082 15:26:05 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:05.082 15:26:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:05.082 15:26:05 -- common/autotest_common.sh@10 -- # set +x 00:31:05.082 15:26:05 -- spdkcli/nvmf.sh@90 -- # killprocess 843464 00:31:05.082 15:26:05 -- common/autotest_common.sh@936 -- # '[' -z 843464 ']' 00:31:05.082 15:26:05 -- common/autotest_common.sh@940 -- # kill -0 843464 00:31:05.082 15:26:05 -- common/autotest_common.sh@941 -- # uname 00:31:05.082 15:26:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:05.082 15:26:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 843464 00:31:05.082 15:26:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:05.082 15:26:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:05.082 15:26:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 843464' 00:31:05.082 killing process with pid 843464 00:31:05.082 15:26:05 -- common/autotest_common.sh@955 -- # kill 843464 00:31:05.082 [2024-11-28 15:26:05.236218] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:05.082 15:26:05 -- common/autotest_common.sh@960 -- # wait 843464 00:31:05.340 15:26:05 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:05.340 15:26:05 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:05.340 15:26:05 -- spdkcli/common.sh@13 -- # '[' -n 843464 ']' 00:31:05.340 15:26:05 -- spdkcli/common.sh@14 -- # killprocess 843464 00:31:05.340 15:26:05 -- common/autotest_common.sh@936 -- # '[' -z 843464 ']' 00:31:05.340 15:26:05 -- common/autotest_common.sh@940 -- # kill -0 843464 00:31:05.340 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (843464) - No such process 00:31:05.340 15:26:05 -- common/autotest_common.sh@963 -- # echo 'Process with pid 843464 is not found' 00:31:05.340 Process with pid 843464 is not found 00:31:05.340 15:26:05 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:05.340 15:26:05 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:05.340 15:26:05 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:05.340 00:31:05.340 real 0m16.983s 00:31:05.340 user 0m36.225s 00:31:05.340 sys 0m0.774s 00:31:05.340 15:26:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:05.340 15:26:05 -- common/autotest_common.sh@10 -- # set +x 00:31:05.340 ************************************ 00:31:05.340 END TEST spdkcli_nvmf_tcp 00:31:05.340 ************************************ 00:31:05.340 15:26:05 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:05.340 15:26:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:05.340 15:26:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:05.340 15:26:05 -- common/autotest_common.sh@10 -- # set +x 00:31:05.340 ************************************ 00:31:05.340 START TEST nvmf_identify_passthru 00:31:05.340 ************************************ 00:31:05.340 15:26:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:05.340 * Looking for test storage... 00:31:05.340 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:05.340 15:26:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:05.340 15:26:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:05.340 15:26:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:05.601 15:26:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:05.601 15:26:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:05.601 15:26:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:05.601 15:26:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:05.601 15:26:05 -- scripts/common.sh@335 -- # IFS=.-: 00:31:05.601 15:26:05 -- scripts/common.sh@335 -- # read -ra ver1 00:31:05.601 15:26:05 -- scripts/common.sh@336 -- # IFS=.-: 00:31:05.601 15:26:05 -- scripts/common.sh@336 -- # read -ra ver2 00:31:05.601 15:26:05 -- scripts/common.sh@337 -- # local 'op=<' 00:31:05.601 15:26:05 -- scripts/common.sh@339 -- # ver1_l=2 00:31:05.601 15:26:05 -- scripts/common.sh@340 -- # ver2_l=1 00:31:05.601 15:26:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:05.601 15:26:05 -- scripts/common.sh@343 -- # case "$op" in 00:31:05.601 15:26:05 -- scripts/common.sh@344 -- # : 1 00:31:05.601 15:26:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:05.601 15:26:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:05.601 15:26:05 -- scripts/common.sh@364 -- # decimal 1 00:31:05.601 15:26:05 -- scripts/common.sh@352 -- # local d=1 00:31:05.601 15:26:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:05.601 15:26:05 -- scripts/common.sh@354 -- # echo 1 00:31:05.601 15:26:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:05.601 15:26:05 -- scripts/common.sh@365 -- # decimal 2 00:31:05.601 15:26:05 -- scripts/common.sh@352 -- # local d=2 00:31:05.601 15:26:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:05.601 15:26:05 -- scripts/common.sh@354 -- # echo 2 00:31:05.601 15:26:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:05.601 15:26:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:05.601 15:26:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:05.601 15:26:05 -- scripts/common.sh@367 -- # return 0 00:31:05.601 15:26:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:05.601 15:26:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:05.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:05.601 --rc genhtml_branch_coverage=1 00:31:05.601 --rc genhtml_function_coverage=1 00:31:05.601 --rc genhtml_legend=1 00:31:05.601 --rc geninfo_all_blocks=1 00:31:05.601 --rc geninfo_unexecuted_blocks=1 00:31:05.601 00:31:05.601 ' 00:31:05.601 15:26:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:05.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:05.601 --rc genhtml_branch_coverage=1 00:31:05.601 --rc genhtml_function_coverage=1 00:31:05.601 --rc genhtml_legend=1 00:31:05.601 --rc geninfo_all_blocks=1 00:31:05.601 --rc geninfo_unexecuted_blocks=1 00:31:05.601 00:31:05.601 ' 00:31:05.601 15:26:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:05.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:05.601 --rc genhtml_branch_coverage=1 00:31:05.601 --rc genhtml_function_coverage=1 00:31:05.601 --rc genhtml_legend=1 00:31:05.601 --rc geninfo_all_blocks=1 00:31:05.601 --rc geninfo_unexecuted_blocks=1 00:31:05.601 00:31:05.601 ' 00:31:05.601 15:26:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:05.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:05.601 --rc genhtml_branch_coverage=1 00:31:05.601 --rc genhtml_function_coverage=1 00:31:05.601 --rc genhtml_legend=1 00:31:05.601 --rc geninfo_all_blocks=1 00:31:05.601 --rc geninfo_unexecuted_blocks=1 00:31:05.601 00:31:05.601 ' 00:31:05.602 15:26:05 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:05.602 15:26:05 -- nvmf/common.sh@7 -- # uname -s 00:31:05.602 15:26:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:05.602 15:26:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:05.602 15:26:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:05.602 15:26:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:05.602 15:26:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:05.602 15:26:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:05.602 15:26:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:05.602 15:26:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:05.602 15:26:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:05.602 15:26:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:05.602 15:26:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:05.602 15:26:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:05.602 15:26:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:05.602 15:26:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:05.602 15:26:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:05.602 15:26:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:05.602 15:26:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:05.602 15:26:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:05.602 15:26:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:05.602 15:26:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- paths/export.sh@5 -- # export PATH 00:31:05.602 15:26:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- nvmf/common.sh@46 -- # : 0 00:31:05.602 15:26:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:05.602 15:26:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:05.602 15:26:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:05.602 15:26:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:05.602 15:26:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:05.602 15:26:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:05.602 15:26:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:05.602 15:26:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:05.602 15:26:05 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:05.602 15:26:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:05.602 15:26:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:05.602 15:26:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:05.602 15:26:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- paths/export.sh@5 -- # export PATH 00:31:05.602 15:26:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:05.602 15:26:05 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:05.602 15:26:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:05.602 15:26:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:05.602 15:26:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:05.602 15:26:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:05.602 15:26:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:05.602 15:26:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:05.602 15:26:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:05.602 15:26:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:05.602 15:26:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:05.602 15:26:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:05.602 15:26:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:05.602 15:26:05 -- common/autotest_common.sh@10 -- # set +x 00:31:07.510 15:26:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:07.510 15:26:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:07.510 15:26:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:07.510 15:26:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:07.510 15:26:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:07.510 15:26:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:07.510 15:26:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:07.510 15:26:07 -- nvmf/common.sh@294 -- # net_devs=() 00:31:07.510 15:26:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:07.510 15:26:07 -- nvmf/common.sh@295 -- # e810=() 00:31:07.510 15:26:07 -- nvmf/common.sh@295 -- # local -ga e810 00:31:07.510 15:26:07 -- nvmf/common.sh@296 -- # x722=() 00:31:07.510 15:26:07 -- nvmf/common.sh@296 -- # local -ga x722 00:31:07.510 15:26:07 -- nvmf/common.sh@297 -- # mlx=() 00:31:07.510 15:26:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:07.510 15:26:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:07.510 15:26:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:07.510 15:26:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:07.510 15:26:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:07.510 15:26:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:07.510 15:26:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:07.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:07.510 15:26:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:07.510 15:26:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:07.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:07.510 15:26:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:07.510 15:26:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:07.510 15:26:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:07.510 15:26:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:07.510 15:26:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:07.510 15:26:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:07.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:07.510 15:26:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:07.510 15:26:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:07.510 15:26:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:07.510 15:26:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:07.510 15:26:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:07.510 15:26:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:07.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:07.510 15:26:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:07.510 15:26:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:07.510 15:26:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:07.510 15:26:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:07.510 15:26:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:07.510 15:26:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:07.510 15:26:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:07.510 15:26:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:07.510 15:26:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:07.510 15:26:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:07.510 15:26:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:07.510 15:26:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:07.510 15:26:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:07.510 15:26:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:07.510 15:26:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:07.510 15:26:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:07.510 15:26:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:07.510 15:26:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:07.510 15:26:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:07.510 15:26:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:07.510 15:26:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:07.510 15:26:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:07.510 15:26:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:07.510 15:26:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:07.510 15:26:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:07.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:07.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:31:07.510 00:31:07.510 --- 10.0.0.2 ping statistics --- 00:31:07.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:07.510 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:31:07.510 15:26:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:07.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:07.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:31:07.510 00:31:07.510 --- 10.0.0.1 ping statistics --- 00:31:07.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:07.510 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:31:07.510 15:26:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:07.511 15:26:07 -- nvmf/common.sh@410 -- # return 0 00:31:07.511 15:26:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:07.511 15:26:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:07.511 15:26:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:07.511 15:26:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:07.511 15:26:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:07.511 15:26:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:07.511 15:26:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:07.511 15:26:07 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:07.511 15:26:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:07.511 15:26:07 -- common/autotest_common.sh@10 -- # set +x 00:31:07.511 15:26:07 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:07.511 15:26:07 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:07.511 15:26:07 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:07.511 15:26:07 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:07.511 15:26:07 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:07.511 15:26:07 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:07.511 15:26:07 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:07.511 15:26:07 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:07.511 15:26:07 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:07.511 15:26:07 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:07.511 15:26:07 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:07.511 15:26:07 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:07.511 15:26:07 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:07.511 15:26:07 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:07.511 15:26:07 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:07.511 15:26:07 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:07.511 15:26:07 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:07.511 15:26:07 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:07.771 EAL: No free 2048 kB hugepages reported on node 1 00:31:11.959 15:26:11 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:11.959 15:26:11 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:11.959 15:26:11 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:11.959 15:26:11 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:11.959 EAL: No free 2048 kB hugepages reported on node 1 00:31:16.151 15:26:16 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:16.151 15:26:16 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:16.151 15:26:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:16.151 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.151 15:26:16 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:16.151 15:26:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:16.151 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.151 15:26:16 -- target/identify_passthru.sh@31 -- # nvmfpid=848261 00:31:16.151 15:26:16 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:16.151 15:26:16 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:16.151 15:26:16 -- target/identify_passthru.sh@35 -- # waitforlisten 848261 00:31:16.151 15:26:16 -- common/autotest_common.sh@829 -- # '[' -z 848261 ']' 00:31:16.151 15:26:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:16.151 15:26:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:16.151 15:26:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:16.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:16.151 15:26:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:16.151 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.151 [2024-11-28 15:26:16.168901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:16.151 [2024-11-28 15:26:16.169007] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:16.151 EAL: No free 2048 kB hugepages reported on node 1 00:31:16.151 [2024-11-28 15:26:16.238031] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:16.151 [2024-11-28 15:26:16.329847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:16.151 [2024-11-28 15:26:16.330013] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:16.151 [2024-11-28 15:26:16.330032] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:16.151 [2024-11-28 15:26:16.330047] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:16.151 [2024-11-28 15:26:16.330158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:16.151 [2024-11-28 15:26:16.330215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:16.151 [2024-11-28 15:26:16.330334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:16.151 [2024-11-28 15:26:16.330336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:16.151 15:26:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:16.151 15:26:16 -- common/autotest_common.sh@862 -- # return 0 00:31:16.151 15:26:16 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:16.151 15:26:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.151 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.151 INFO: Log level set to 20 00:31:16.151 INFO: Requests: 00:31:16.151 { 00:31:16.151 "jsonrpc": "2.0", 00:31:16.151 "method": "nvmf_set_config", 00:31:16.151 "id": 1, 00:31:16.151 "params": { 00:31:16.151 "admin_cmd_passthru": { 00:31:16.151 "identify_ctrlr": true 00:31:16.151 } 00:31:16.151 } 00:31:16.151 } 00:31:16.151 00:31:16.412 INFO: response: 00:31:16.412 { 00:31:16.412 "jsonrpc": "2.0", 00:31:16.412 "id": 1, 00:31:16.412 "result": true 00:31:16.412 } 00:31:16.412 00:31:16.412 15:26:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.412 15:26:16 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:16.412 15:26:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.412 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.412 INFO: Setting log level to 20 00:31:16.412 INFO: Setting log level to 20 00:31:16.412 INFO: Log level set to 20 00:31:16.412 INFO: Log level set to 20 00:31:16.412 INFO: Requests: 00:31:16.412 { 00:31:16.412 "jsonrpc": "2.0", 00:31:16.412 "method": "framework_start_init", 00:31:16.412 "id": 1 00:31:16.412 } 00:31:16.412 00:31:16.412 INFO: Requests: 00:31:16.412 { 00:31:16.412 "jsonrpc": "2.0", 00:31:16.412 "method": "framework_start_init", 00:31:16.412 "id": 1 00:31:16.412 } 00:31:16.412 00:31:16.412 [2024-11-28 15:26:16.494485] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:16.412 INFO: response: 00:31:16.412 { 00:31:16.412 "jsonrpc": "2.0", 00:31:16.412 "id": 1, 00:31:16.412 "result": true 00:31:16.412 } 00:31:16.412 00:31:16.412 INFO: response: 00:31:16.412 { 00:31:16.412 "jsonrpc": "2.0", 00:31:16.412 "id": 1, 00:31:16.412 "result": true 00:31:16.412 } 00:31:16.412 00:31:16.412 15:26:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.412 15:26:16 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:16.412 15:26:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.412 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.412 INFO: Setting log level to 40 00:31:16.412 INFO: Setting log level to 40 00:31:16.412 INFO: Setting log level to 40 00:31:16.412 [2024-11-28 15:26:16.504535] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:16.412 15:26:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:16.412 15:26:16 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:16.412 15:26:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:16.412 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:16.412 15:26:16 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:16.412 15:26:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:16.412 15:26:16 -- common/autotest_common.sh@10 -- # set +x 00:31:19.701 Nvme0n1 00:31:19.701 15:26:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.701 15:26:19 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:19.701 15:26:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.701 15:26:19 -- common/autotest_common.sh@10 -- # set +x 00:31:19.701 15:26:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.701 15:26:19 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:19.701 15:26:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.701 15:26:19 -- common/autotest_common.sh@10 -- # set +x 00:31:19.701 15:26:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.701 15:26:19 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:19.701 15:26:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.701 15:26:19 -- common/autotest_common.sh@10 -- # set +x 00:31:19.701 [2024-11-28 15:26:19.397686] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:19.701 15:26:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.701 15:26:19 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:19.701 15:26:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.701 15:26:19 -- common/autotest_common.sh@10 -- # set +x 00:31:19.701 [2024-11-28 15:26:19.405405] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:19.701 [ 00:31:19.701 { 00:31:19.701 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:19.701 "subtype": "Discovery", 00:31:19.701 "listen_addresses": [], 00:31:19.701 "allow_any_host": true, 00:31:19.701 "hosts": [] 00:31:19.701 }, 00:31:19.701 { 00:31:19.701 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:19.701 "subtype": "NVMe", 00:31:19.701 "listen_addresses": [ 00:31:19.701 { 00:31:19.701 "transport": "TCP", 00:31:19.701 "trtype": "TCP", 00:31:19.701 "adrfam": "IPv4", 00:31:19.701 "traddr": "10.0.0.2", 00:31:19.701 "trsvcid": "4420" 00:31:19.701 } 00:31:19.701 ], 00:31:19.701 "allow_any_host": true, 00:31:19.701 "hosts": [], 00:31:19.701 "serial_number": "SPDK00000000000001", 00:31:19.701 "model_number": "SPDK bdev Controller", 00:31:19.701 "max_namespaces": 1, 00:31:19.701 "min_cntlid": 1, 00:31:19.701 "max_cntlid": 65519, 00:31:19.701 "namespaces": [ 00:31:19.701 { 00:31:19.701 "nsid": 1, 00:31:19.701 "bdev_name": "Nvme0n1", 00:31:19.701 "name": "Nvme0n1", 00:31:19.701 "nguid": "A45B9646D4FD48DF88C9CA6633E36C42", 00:31:19.701 "uuid": "a45b9646-d4fd-48df-88c9-ca6633e36c42" 00:31:19.701 } 00:31:19.701 ] 00:31:19.701 } 00:31:19.701 ] 00:31:19.701 15:26:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.701 15:26:19 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:19.701 15:26:19 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:19.701 15:26:19 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:19.701 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.701 15:26:19 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:19.701 15:26:19 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:19.701 15:26:19 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:19.701 15:26:19 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:19.701 EAL: No free 2048 kB hugepages reported on node 1 00:31:19.701 15:26:19 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:19.701 15:26:19 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:19.701 15:26:19 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:19.701 15:26:19 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:19.701 15:26:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:19.701 15:26:19 -- common/autotest_common.sh@10 -- # set +x 00:31:19.701 15:26:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:19.701 15:26:19 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:19.701 15:26:19 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:19.701 15:26:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:19.701 15:26:19 -- nvmf/common.sh@116 -- # sync 00:31:19.701 15:26:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:19.701 15:26:19 -- nvmf/common.sh@119 -- # set +e 00:31:19.701 15:26:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:19.701 15:26:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:19.701 rmmod nvme_tcp 00:31:19.701 rmmod nvme_fabrics 00:31:19.701 rmmod nvme_keyring 00:31:19.701 15:26:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:19.701 15:26:19 -- nvmf/common.sh@123 -- # set -e 00:31:19.701 15:26:19 -- nvmf/common.sh@124 -- # return 0 00:31:19.701 15:26:19 -- nvmf/common.sh@477 -- # '[' -n 848261 ']' 00:31:19.701 15:26:19 -- nvmf/common.sh@478 -- # killprocess 848261 00:31:19.701 15:26:19 -- common/autotest_common.sh@936 -- # '[' -z 848261 ']' 00:31:19.701 15:26:19 -- common/autotest_common.sh@940 -- # kill -0 848261 00:31:19.701 15:26:19 -- common/autotest_common.sh@941 -- # uname 00:31:19.701 15:26:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:19.701 15:26:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 848261 00:31:19.702 15:26:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:19.702 15:26:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:19.702 15:26:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 848261' 00:31:19.702 killing process with pid 848261 00:31:19.702 15:26:19 -- common/autotest_common.sh@955 -- # kill 848261 00:31:19.702 [2024-11-28 15:26:19.847259] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:19.702 15:26:19 -- common/autotest_common.sh@960 -- # wait 848261 00:31:21.606 15:26:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:21.606 15:26:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:21.606 15:26:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:21.606 15:26:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:21.606 15:26:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:21.606 15:26:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:21.606 15:26:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:21.606 15:26:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:23.513 15:26:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:23.513 00:31:23.513 real 0m17.970s 00:31:23.513 user 0m26.720s 00:31:23.513 sys 0m2.284s 00:31:23.513 15:26:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:23.513 15:26:23 -- common/autotest_common.sh@10 -- # set +x 00:31:23.513 ************************************ 00:31:23.513 END TEST nvmf_identify_passthru 00:31:23.513 ************************************ 00:31:23.513 15:26:23 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:23.513 15:26:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:23.513 15:26:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:23.513 15:26:23 -- common/autotest_common.sh@10 -- # set +x 00:31:23.513 ************************************ 00:31:23.513 START TEST nvmf_dif 00:31:23.513 ************************************ 00:31:23.513 15:26:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:23.513 * Looking for test storage... 00:31:23.513 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:23.513 15:26:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:23.513 15:26:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:23.513 15:26:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:23.513 15:26:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:23.513 15:26:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:23.513 15:26:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:23.513 15:26:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:23.513 15:26:23 -- scripts/common.sh@335 -- # IFS=.-: 00:31:23.513 15:26:23 -- scripts/common.sh@335 -- # read -ra ver1 00:31:23.513 15:26:23 -- scripts/common.sh@336 -- # IFS=.-: 00:31:23.513 15:26:23 -- scripts/common.sh@336 -- # read -ra ver2 00:31:23.513 15:26:23 -- scripts/common.sh@337 -- # local 'op=<' 00:31:23.513 15:26:23 -- scripts/common.sh@339 -- # ver1_l=2 00:31:23.513 15:26:23 -- scripts/common.sh@340 -- # ver2_l=1 00:31:23.513 15:26:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:23.513 15:26:23 -- scripts/common.sh@343 -- # case "$op" in 00:31:23.513 15:26:23 -- scripts/common.sh@344 -- # : 1 00:31:23.513 15:26:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:23.513 15:26:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:23.513 15:26:23 -- scripts/common.sh@364 -- # decimal 1 00:31:23.513 15:26:23 -- scripts/common.sh@352 -- # local d=1 00:31:23.513 15:26:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:23.513 15:26:23 -- scripts/common.sh@354 -- # echo 1 00:31:23.513 15:26:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:23.513 15:26:23 -- scripts/common.sh@365 -- # decimal 2 00:31:23.513 15:26:23 -- scripts/common.sh@352 -- # local d=2 00:31:23.513 15:26:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:23.513 15:26:23 -- scripts/common.sh@354 -- # echo 2 00:31:23.513 15:26:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:23.513 15:26:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:23.513 15:26:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:23.513 15:26:23 -- scripts/common.sh@367 -- # return 0 00:31:23.513 15:26:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:23.513 15:26:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:23.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:23.513 --rc genhtml_branch_coverage=1 00:31:23.513 --rc genhtml_function_coverage=1 00:31:23.513 --rc genhtml_legend=1 00:31:23.513 --rc geninfo_all_blocks=1 00:31:23.513 --rc geninfo_unexecuted_blocks=1 00:31:23.513 00:31:23.513 ' 00:31:23.513 15:26:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:23.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:23.513 --rc genhtml_branch_coverage=1 00:31:23.513 --rc genhtml_function_coverage=1 00:31:23.513 --rc genhtml_legend=1 00:31:23.513 --rc geninfo_all_blocks=1 00:31:23.513 --rc geninfo_unexecuted_blocks=1 00:31:23.513 00:31:23.513 ' 00:31:23.513 15:26:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:23.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:23.513 --rc genhtml_branch_coverage=1 00:31:23.513 --rc genhtml_function_coverage=1 00:31:23.513 --rc genhtml_legend=1 00:31:23.513 --rc geninfo_all_blocks=1 00:31:23.513 --rc geninfo_unexecuted_blocks=1 00:31:23.513 00:31:23.513 ' 00:31:23.513 15:26:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:23.513 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:23.513 --rc genhtml_branch_coverage=1 00:31:23.513 --rc genhtml_function_coverage=1 00:31:23.513 --rc genhtml_legend=1 00:31:23.513 --rc geninfo_all_blocks=1 00:31:23.513 --rc geninfo_unexecuted_blocks=1 00:31:23.513 00:31:23.514 ' 00:31:23.514 15:26:23 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:23.514 15:26:23 -- nvmf/common.sh@7 -- # uname -s 00:31:23.514 15:26:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:23.514 15:26:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:23.514 15:26:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:23.514 15:26:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:23.514 15:26:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:23.514 15:26:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:23.514 15:26:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:23.514 15:26:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:23.514 15:26:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:23.514 15:26:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:23.514 15:26:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:23.514 15:26:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:23.514 15:26:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:23.514 15:26:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:23.514 15:26:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:23.514 15:26:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:23.514 15:26:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:23.514 15:26:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:23.514 15:26:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:23.514 15:26:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:23.514 15:26:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:23.514 15:26:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:23.514 15:26:23 -- paths/export.sh@5 -- # export PATH 00:31:23.514 15:26:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:23.514 15:26:23 -- nvmf/common.sh@46 -- # : 0 00:31:23.514 15:26:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:23.514 15:26:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:23.514 15:26:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:23.514 15:26:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:23.514 15:26:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:23.514 15:26:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:23.514 15:26:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:23.514 15:26:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:23.514 15:26:23 -- target/dif.sh@15 -- # NULL_META=16 00:31:23.514 15:26:23 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:23.514 15:26:23 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:23.514 15:26:23 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:23.514 15:26:23 -- target/dif.sh@135 -- # nvmftestinit 00:31:23.514 15:26:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:23.514 15:26:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:23.514 15:26:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:23.514 15:26:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:23.514 15:26:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:23.514 15:26:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:23.514 15:26:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:23.514 15:26:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:23.514 15:26:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:23.514 15:26:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:23.514 15:26:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:23.514 15:26:23 -- common/autotest_common.sh@10 -- # set +x 00:31:25.475 15:26:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:25.475 15:26:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:25.475 15:26:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:25.475 15:26:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:25.475 15:26:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:25.475 15:26:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:25.475 15:26:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:25.475 15:26:25 -- nvmf/common.sh@294 -- # net_devs=() 00:31:25.475 15:26:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:25.475 15:26:25 -- nvmf/common.sh@295 -- # e810=() 00:31:25.475 15:26:25 -- nvmf/common.sh@295 -- # local -ga e810 00:31:25.475 15:26:25 -- nvmf/common.sh@296 -- # x722=() 00:31:25.475 15:26:25 -- nvmf/common.sh@296 -- # local -ga x722 00:31:25.475 15:26:25 -- nvmf/common.sh@297 -- # mlx=() 00:31:25.475 15:26:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:25.476 15:26:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:25.476 15:26:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:25.476 15:26:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:25.476 15:26:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:25.476 15:26:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:25.476 15:26:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:25.476 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:25.476 15:26:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:25.476 15:26:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:25.476 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:25.476 15:26:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:25.476 15:26:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:25.476 15:26:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:25.476 15:26:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:25.476 15:26:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:25.476 15:26:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:25.476 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:25.476 15:26:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:25.476 15:26:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:25.476 15:26:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:25.476 15:26:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:25.476 15:26:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:25.476 15:26:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:25.476 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:25.476 15:26:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:25.476 15:26:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:25.476 15:26:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:25.476 15:26:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:25.476 15:26:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:25.476 15:26:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:25.476 15:26:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:25.476 15:26:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:25.476 15:26:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:25.476 15:26:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:25.476 15:26:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:25.476 15:26:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:25.476 15:26:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:25.476 15:26:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:25.476 15:26:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:25.476 15:26:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:25.476 15:26:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:25.476 15:26:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:25.476 15:26:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:25.476 15:26:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:25.476 15:26:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:25.476 15:26:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:25.740 15:26:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:25.740 15:26:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:25.740 15:26:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:25.740 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:25.740 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:31:25.740 00:31:25.740 --- 10.0.0.2 ping statistics --- 00:31:25.740 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:25.740 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:31:25.740 15:26:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:25.740 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:25.740 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:31:25.740 00:31:25.740 --- 10.0.0.1 ping statistics --- 00:31:25.740 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:25.740 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:31:25.740 15:26:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:25.740 15:26:25 -- nvmf/common.sh@410 -- # return 0 00:31:25.740 15:26:25 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:25.740 15:26:25 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:26.674 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:26.674 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:26.674 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:26.674 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:26.674 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:26.674 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:26.674 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:26.674 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:26.674 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:26.674 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:26.674 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:26.674 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:26.674 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:26.674 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:26.674 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:26.674 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:26.674 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:26.932 15:26:27 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:26.932 15:26:27 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:26.932 15:26:27 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:26.932 15:26:27 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:26.932 15:26:27 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:26.932 15:26:27 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:26.932 15:26:27 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:26.932 15:26:27 -- target/dif.sh@137 -- # nvmfappstart 00:31:26.932 15:26:27 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:26.932 15:26:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:26.932 15:26:27 -- common/autotest_common.sh@10 -- # set +x 00:31:26.932 15:26:27 -- nvmf/common.sh@469 -- # nvmfpid=851477 00:31:26.932 15:26:27 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:26.932 15:26:27 -- nvmf/common.sh@470 -- # waitforlisten 851477 00:31:26.932 15:26:27 -- common/autotest_common.sh@829 -- # '[' -z 851477 ']' 00:31:26.932 15:26:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:26.932 15:26:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:26.932 15:26:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:26.932 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:26.932 15:26:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:26.932 15:26:27 -- common/autotest_common.sh@10 -- # set +x 00:31:26.933 [2024-11-28 15:26:27.119991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:31:26.933 [2024-11-28 15:26:27.120091] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:26.933 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.192 [2024-11-28 15:26:27.186189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:27.192 [2024-11-28 15:26:27.273183] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:27.192 [2024-11-28 15:26:27.273324] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:27.192 [2024-11-28 15:26:27.273340] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:27.192 [2024-11-28 15:26:27.273353] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:27.192 [2024-11-28 15:26:27.273394] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:28.129 15:26:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:28.129 15:26:28 -- common/autotest_common.sh@862 -- # return 0 00:31:28.129 15:26:28 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:28.129 15:26:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 15:26:28 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:28.129 15:26:28 -- target/dif.sh@139 -- # create_transport 00:31:28.129 15:26:28 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:28.129 15:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 [2024-11-28 15:26:28.107244] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:28.129 15:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.129 15:26:28 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:28.129 15:26:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:28.129 15:26:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 ************************************ 00:31:28.129 START TEST fio_dif_1_default 00:31:28.129 ************************************ 00:31:28.129 15:26:28 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:28.129 15:26:28 -- target/dif.sh@86 -- # create_subsystems 0 00:31:28.129 15:26:28 -- target/dif.sh@28 -- # local sub 00:31:28.129 15:26:28 -- target/dif.sh@30 -- # for sub in "$@" 00:31:28.129 15:26:28 -- target/dif.sh@31 -- # create_subsystem 0 00:31:28.129 15:26:28 -- target/dif.sh@18 -- # local sub_id=0 00:31:28.129 15:26:28 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:28.129 15:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 bdev_null0 00:31:28.129 15:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.129 15:26:28 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:28.129 15:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 15:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.129 15:26:28 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:28.129 15:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 15:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.129 15:26:28 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:28.129 15:26:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:28.129 15:26:28 -- common/autotest_common.sh@10 -- # set +x 00:31:28.129 [2024-11-28 15:26:28.143506] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:28.129 15:26:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:28.129 15:26:28 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:28.129 15:26:28 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:28.129 15:26:28 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:28.129 15:26:28 -- nvmf/common.sh@520 -- # config=() 00:31:28.129 15:26:28 -- nvmf/common.sh@520 -- # local subsystem config 00:31:28.129 15:26:28 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:28.129 15:26:28 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:28.129 { 00:31:28.129 "params": { 00:31:28.129 "name": "Nvme$subsystem", 00:31:28.129 "trtype": "$TEST_TRANSPORT", 00:31:28.129 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:28.129 "adrfam": "ipv4", 00:31:28.129 "trsvcid": "$NVMF_PORT", 00:31:28.129 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:28.129 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:28.129 "hdgst": ${hdgst:-false}, 00:31:28.129 "ddgst": ${ddgst:-false} 00:31:28.129 }, 00:31:28.129 "method": "bdev_nvme_attach_controller" 00:31:28.129 } 00:31:28.129 EOF 00:31:28.129 )") 00:31:28.129 15:26:28 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:28.129 15:26:28 -- target/dif.sh@82 -- # gen_fio_conf 00:31:28.129 15:26:28 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:28.129 15:26:28 -- target/dif.sh@54 -- # local file 00:31:28.129 15:26:28 -- target/dif.sh@56 -- # cat 00:31:28.129 15:26:28 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:28.129 15:26:28 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:28.129 15:26:28 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:28.129 15:26:28 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:28.129 15:26:28 -- common/autotest_common.sh@1330 -- # shift 00:31:28.129 15:26:28 -- nvmf/common.sh@542 -- # cat 00:31:28.129 15:26:28 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:28.129 15:26:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:28.129 15:26:28 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:28.129 15:26:28 -- target/dif.sh@72 -- # (( file <= files )) 00:31:28.129 15:26:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:28.129 15:26:28 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:28.129 15:26:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:28.129 15:26:28 -- nvmf/common.sh@544 -- # jq . 00:31:28.129 15:26:28 -- nvmf/common.sh@545 -- # IFS=, 00:31:28.129 15:26:28 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:28.129 "params": { 00:31:28.129 "name": "Nvme0", 00:31:28.129 "trtype": "tcp", 00:31:28.129 "traddr": "10.0.0.2", 00:31:28.129 "adrfam": "ipv4", 00:31:28.129 "trsvcid": "4420", 00:31:28.129 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:28.129 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:28.129 "hdgst": false, 00:31:28.129 "ddgst": false 00:31:28.129 }, 00:31:28.129 "method": "bdev_nvme_attach_controller" 00:31:28.129 }' 00:31:28.129 15:26:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:28.129 15:26:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:28.129 15:26:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:28.130 15:26:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:28.130 15:26:28 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:28.130 15:26:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:28.130 15:26:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:28.130 15:26:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:28.130 15:26:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:28.130 15:26:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:28.387 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:28.387 fio-3.35 00:31:28.387 Starting 1 thread 00:31:28.387 EAL: No free 2048 kB hugepages reported on node 1 00:31:28.955 [2024-11-28 15:26:28.926544] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:28.955 [2024-11-28 15:26:28.926615] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:38.916 00:31:38.916 filename0: (groupid=0, jobs=1): err= 0: pid=851831: Thu Nov 28 15:26:39 2024 00:31:38.916 read: IOPS=145, BW=581KiB/s (595kB/s)(5824KiB/10018msec) 00:31:38.916 slat (nsec): min=3979, max=71784, avg=8441.75, stdev=3031.21 00:31:38.916 clat (usec): min=530, max=47446, avg=27494.31, stdev=19239.44 00:31:38.916 lat (usec): min=537, max=47472, avg=27502.75, stdev=19239.30 00:31:38.916 clat percentiles (usec): 00:31:38.916 | 1.00th=[ 537], 5.00th=[ 553], 10.00th=[ 562], 20.00th=[ 586], 00:31:38.916 | 30.00th=[ 603], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:38.916 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:38.916 | 99.00th=[42206], 99.50th=[42206], 99.90th=[47449], 99.95th=[47449], 00:31:38.916 | 99.99th=[47449] 00:31:38.916 bw ( KiB/s): min= 384, max= 832, per=99.77%, avg=580.80, stdev=186.09, samples=20 00:31:38.916 iops : min= 96, max= 208, avg=145.20, stdev=46.52, samples=20 00:31:38.916 lat (usec) : 750=33.79% 00:31:38.916 lat (msec) : 50=66.21% 00:31:38.916 cpu : usr=91.64%, sys=8.07%, ctx=20, majf=0, minf=291 00:31:38.916 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:38.916 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.916 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:38.916 issued rwts: total=1456,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:38.916 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:38.916 00:31:38.916 Run status group 0 (all jobs): 00:31:38.916 READ: bw=581KiB/s (595kB/s), 581KiB/s-581KiB/s (595kB/s-595kB/s), io=5824KiB (5964kB), run=10018-10018msec 00:31:39.176 15:26:39 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:39.176 15:26:39 -- target/dif.sh@43 -- # local sub 00:31:39.176 15:26:39 -- target/dif.sh@45 -- # for sub in "$@" 00:31:39.176 15:26:39 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:39.176 15:26:39 -- target/dif.sh@36 -- # local sub_id=0 00:31:39.176 15:26:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:39.176 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.176 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.176 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.176 15:26:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:39.176 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.176 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.176 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.176 00:31:39.176 real 0m11.234s 00:31:39.176 user 0m10.358s 00:31:39.176 sys 0m1.060s 00:31:39.176 15:26:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:39.176 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.176 ************************************ 00:31:39.176 END TEST fio_dif_1_default 00:31:39.176 ************************************ 00:31:39.176 15:26:39 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:39.176 15:26:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:39.176 15:26:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:39.176 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.176 ************************************ 00:31:39.176 START TEST fio_dif_1_multi_subsystems 00:31:39.176 ************************************ 00:31:39.176 15:26:39 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:39.176 15:26:39 -- target/dif.sh@92 -- # local files=1 00:31:39.176 15:26:39 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:39.176 15:26:39 -- target/dif.sh@28 -- # local sub 00:31:39.176 15:26:39 -- target/dif.sh@30 -- # for sub in "$@" 00:31:39.176 15:26:39 -- target/dif.sh@31 -- # create_subsystem 0 00:31:39.176 15:26:39 -- target/dif.sh@18 -- # local sub_id=0 00:31:39.176 15:26:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:39.176 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.176 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.176 bdev_null0 00:31:39.176 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.176 15:26:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:39.176 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.176 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.176 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.176 15:26:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:39.176 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.177 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.177 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.177 15:26:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:39.177 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.177 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.177 [2024-11-28 15:26:39.408803] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:39.436 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.436 15:26:39 -- target/dif.sh@30 -- # for sub in "$@" 00:31:39.436 15:26:39 -- target/dif.sh@31 -- # create_subsystem 1 00:31:39.436 15:26:39 -- target/dif.sh@18 -- # local sub_id=1 00:31:39.436 15:26:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:39.436 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.436 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.436 bdev_null1 00:31:39.436 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.436 15:26:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:39.436 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.436 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.436 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.436 15:26:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:39.436 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.436 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.436 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.436 15:26:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:39.436 15:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:39.436 15:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:39.436 15:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:39.436 15:26:39 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:39.436 15:26:39 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:39.436 15:26:39 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:39.436 15:26:39 -- nvmf/common.sh@520 -- # config=() 00:31:39.436 15:26:39 -- nvmf/common.sh@520 -- # local subsystem config 00:31:39.436 15:26:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:39.436 15:26:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:39.436 { 00:31:39.436 "params": { 00:31:39.436 "name": "Nvme$subsystem", 00:31:39.436 "trtype": "$TEST_TRANSPORT", 00:31:39.436 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:39.436 "adrfam": "ipv4", 00:31:39.436 "trsvcid": "$NVMF_PORT", 00:31:39.436 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:39.436 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:39.436 "hdgst": ${hdgst:-false}, 00:31:39.436 "ddgst": ${ddgst:-false} 00:31:39.436 }, 00:31:39.436 "method": "bdev_nvme_attach_controller" 00:31:39.436 } 00:31:39.436 EOF 00:31:39.436 )") 00:31:39.436 15:26:39 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.436 15:26:39 -- target/dif.sh@82 -- # gen_fio_conf 00:31:39.436 15:26:39 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.436 15:26:39 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:39.436 15:26:39 -- target/dif.sh@54 -- # local file 00:31:39.436 15:26:39 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:39.436 15:26:39 -- target/dif.sh@56 -- # cat 00:31:39.436 15:26:39 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:39.436 15:26:39 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:39.436 15:26:39 -- common/autotest_common.sh@1330 -- # shift 00:31:39.436 15:26:39 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:39.436 15:26:39 -- nvmf/common.sh@542 -- # cat 00:31:39.436 15:26:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:39.436 15:26:39 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:39.436 15:26:39 -- target/dif.sh@72 -- # (( file <= files )) 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:39.436 15:26:39 -- target/dif.sh@73 -- # cat 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:39.436 15:26:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:39.436 15:26:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:39.436 { 00:31:39.436 "params": { 00:31:39.436 "name": "Nvme$subsystem", 00:31:39.436 "trtype": "$TEST_TRANSPORT", 00:31:39.436 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:39.436 "adrfam": "ipv4", 00:31:39.436 "trsvcid": "$NVMF_PORT", 00:31:39.436 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:39.436 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:39.436 "hdgst": ${hdgst:-false}, 00:31:39.436 "ddgst": ${ddgst:-false} 00:31:39.436 }, 00:31:39.436 "method": "bdev_nvme_attach_controller" 00:31:39.436 } 00:31:39.436 EOF 00:31:39.436 )") 00:31:39.436 15:26:39 -- nvmf/common.sh@542 -- # cat 00:31:39.436 15:26:39 -- target/dif.sh@72 -- # (( file++ )) 00:31:39.436 15:26:39 -- target/dif.sh@72 -- # (( file <= files )) 00:31:39.436 15:26:39 -- nvmf/common.sh@544 -- # jq . 00:31:39.436 15:26:39 -- nvmf/common.sh@545 -- # IFS=, 00:31:39.436 15:26:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:39.436 "params": { 00:31:39.436 "name": "Nvme0", 00:31:39.436 "trtype": "tcp", 00:31:39.436 "traddr": "10.0.0.2", 00:31:39.436 "adrfam": "ipv4", 00:31:39.436 "trsvcid": "4420", 00:31:39.436 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:39.436 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:39.436 "hdgst": false, 00:31:39.436 "ddgst": false 00:31:39.436 }, 00:31:39.436 "method": "bdev_nvme_attach_controller" 00:31:39.436 },{ 00:31:39.436 "params": { 00:31:39.436 "name": "Nvme1", 00:31:39.436 "trtype": "tcp", 00:31:39.436 "traddr": "10.0.0.2", 00:31:39.436 "adrfam": "ipv4", 00:31:39.436 "trsvcid": "4420", 00:31:39.436 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:39.436 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:39.436 "hdgst": false, 00:31:39.436 "ddgst": false 00:31:39.436 }, 00:31:39.436 "method": "bdev_nvme_attach_controller" 00:31:39.436 }' 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:39.436 15:26:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:39.436 15:26:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:39.436 15:26:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:39.436 15:26:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:39.436 15:26:39 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:39.436 15:26:39 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:39.696 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:39.696 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:39.696 fio-3.35 00:31:39.696 Starting 2 threads 00:31:39.696 EAL: No free 2048 kB hugepages reported on node 1 00:31:40.262 [2024-11-28 15:26:40.368895] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:40.262 [2024-11-28 15:26:40.368954] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:52.458 00:31:52.458 filename0: (groupid=0, jobs=1): err= 0: pid=853271: Thu Nov 28 15:26:50 2024 00:31:52.458 read: IOPS=146, BW=585KiB/s (599kB/s)(5872KiB/10038msec) 00:31:52.458 slat (nsec): min=6996, max=37553, avg=9129.50, stdev=3233.57 00:31:52.458 clat (usec): min=552, max=43414, avg=27321.16, stdev=19308.08 00:31:52.458 lat (usec): min=559, max=43434, avg=27330.29, stdev=19308.19 00:31:52.458 clat percentiles (usec): 00:31:52.458 | 1.00th=[ 570], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 619], 00:31:52.458 | 30.00th=[ 742], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:52.458 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:52.458 | 99.00th=[42206], 99.50th=[42730], 99.90th=[43254], 99.95th=[43254], 00:31:52.458 | 99.99th=[43254] 00:31:52.458 bw ( KiB/s): min= 384, max= 832, per=42.78%, avg=585.60, stdev=193.43, samples=20 00:31:52.458 iops : min= 96, max= 208, avg=146.40, stdev=48.36, samples=20 00:31:52.458 lat (usec) : 750=31.61%, 1000=2.72% 00:31:52.458 lat (msec) : 50=65.67% 00:31:52.458 cpu : usr=94.78%, sys=4.90%, ctx=14, majf=0, minf=207 00:31:52.458 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.458 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.458 issued rwts: total=1468,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.458 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:52.458 filename1: (groupid=0, jobs=1): err= 0: pid=853272: Thu Nov 28 15:26:50 2024 00:31:52.458 read: IOPS=196, BW=784KiB/s (803kB/s)(7856KiB/10020msec) 00:31:52.458 slat (nsec): min=6961, max=46439, avg=9231.79, stdev=3552.41 00:31:52.458 clat (usec): min=552, max=42745, avg=20377.49, stdev=20329.85 00:31:52.458 lat (usec): min=559, max=42757, avg=20386.72, stdev=20329.83 00:31:52.458 clat percentiles (usec): 00:31:52.458 | 1.00th=[ 570], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 611], 00:31:52.458 | 30.00th=[ 635], 40.00th=[ 734], 50.00th=[ 857], 60.00th=[41157], 00:31:52.458 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:52.458 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:31:52.458 | 99.99th=[42730] 00:31:52.458 bw ( KiB/s): min= 704, max= 896, per=57.33%, avg=784.00, stdev=40.87, samples=20 00:31:52.458 iops : min= 176, max= 224, avg=196.00, stdev=10.22, samples=20 00:31:52.458 lat (usec) : 750=44.96%, 1000=6.16% 00:31:52.458 lat (msec) : 2=0.41%, 50=48.47% 00:31:52.458 cpu : usr=94.96%, sys=4.72%, ctx=15, majf=0, minf=99 00:31:52.458 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.458 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.458 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.458 issued rwts: total=1964,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.458 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:52.458 00:31:52.458 Run status group 0 (all jobs): 00:31:52.458 READ: bw=1368KiB/s (1400kB/s), 585KiB/s-784KiB/s (599kB/s-803kB/s), io=13.4MiB (14.1MB), run=10020-10038msec 00:31:52.458 15:26:50 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:52.458 15:26:50 -- target/dif.sh@43 -- # local sub 00:31:52.458 15:26:50 -- target/dif.sh@45 -- # for sub in "$@" 00:31:52.459 15:26:50 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:52.459 15:26:50 -- target/dif.sh@36 -- # local sub_id=0 00:31:52.459 15:26:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@45 -- # for sub in "$@" 00:31:52.459 15:26:50 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:52.459 15:26:50 -- target/dif.sh@36 -- # local sub_id=1 00:31:52.459 15:26:50 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 00:31:52.459 real 0m11.455s 00:31:52.459 user 0m20.302s 00:31:52.459 sys 0m1.258s 00:31:52.459 15:26:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 ************************************ 00:31:52.459 END TEST fio_dif_1_multi_subsystems 00:31:52.459 ************************************ 00:31:52.459 15:26:50 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:52.459 15:26:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:52.459 15:26:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 ************************************ 00:31:52.459 START TEST fio_dif_rand_params 00:31:52.459 ************************************ 00:31:52.459 15:26:50 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:52.459 15:26:50 -- target/dif.sh@100 -- # local NULL_DIF 00:31:52.459 15:26:50 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:52.459 15:26:50 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:52.459 15:26:50 -- target/dif.sh@103 -- # bs=128k 00:31:52.459 15:26:50 -- target/dif.sh@103 -- # numjobs=3 00:31:52.459 15:26:50 -- target/dif.sh@103 -- # iodepth=3 00:31:52.459 15:26:50 -- target/dif.sh@103 -- # runtime=5 00:31:52.459 15:26:50 -- target/dif.sh@105 -- # create_subsystems 0 00:31:52.459 15:26:50 -- target/dif.sh@28 -- # local sub 00:31:52.459 15:26:50 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.459 15:26:50 -- target/dif.sh@31 -- # create_subsystem 0 00:31:52.459 15:26:50 -- target/dif.sh@18 -- # local sub_id=0 00:31:52.459 15:26:50 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 bdev_null0 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:52.459 15:26:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.459 15:26:50 -- common/autotest_common.sh@10 -- # set +x 00:31:52.459 [2024-11-28 15:26:50.894487] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:52.459 15:26:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.459 15:26:50 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:52.459 15:26:50 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.459 15:26:50 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:52.459 15:26:50 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.459 15:26:50 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:52.459 15:26:50 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:52.459 15:26:50 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:52.459 15:26:50 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:52.459 15:26:50 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.459 15:26:50 -- target/dif.sh@82 -- # gen_fio_conf 00:31:52.459 15:26:50 -- nvmf/common.sh@520 -- # config=() 00:31:52.459 15:26:50 -- common/autotest_common.sh@1330 -- # shift 00:31:52.459 15:26:50 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:52.459 15:26:50 -- nvmf/common.sh@520 -- # local subsystem config 00:31:52.459 15:26:50 -- target/dif.sh@54 -- # local file 00:31:52.459 15:26:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.459 15:26:50 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.459 15:26:50 -- target/dif.sh@56 -- # cat 00:31:52.459 15:26:50 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.459 { 00:31:52.459 "params": { 00:31:52.459 "name": "Nvme$subsystem", 00:31:52.459 "trtype": "$TEST_TRANSPORT", 00:31:52.459 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.459 "adrfam": "ipv4", 00:31:52.459 "trsvcid": "$NVMF_PORT", 00:31:52.459 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.459 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.459 "hdgst": ${hdgst:-false}, 00:31:52.459 "ddgst": ${ddgst:-false} 00:31:52.459 }, 00:31:52.459 "method": "bdev_nvme_attach_controller" 00:31:52.459 } 00:31:52.459 EOF 00:31:52.459 )") 00:31:52.459 15:26:50 -- nvmf/common.sh@542 -- # cat 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.459 15:26:50 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:52.459 15:26:50 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.459 15:26:50 -- nvmf/common.sh@544 -- # jq . 00:31:52.459 15:26:50 -- nvmf/common.sh@545 -- # IFS=, 00:31:52.459 15:26:50 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:52.459 "params": { 00:31:52.459 "name": "Nvme0", 00:31:52.459 "trtype": "tcp", 00:31:52.459 "traddr": "10.0.0.2", 00:31:52.459 "adrfam": "ipv4", 00:31:52.459 "trsvcid": "4420", 00:31:52.459 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:52.459 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:52.459 "hdgst": false, 00:31:52.459 "ddgst": false 00:31:52.459 }, 00:31:52.459 "method": "bdev_nvme_attach_controller" 00:31:52.459 }' 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.459 15:26:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.459 15:26:50 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.459 15:26:50 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:52.459 15:26:50 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:52.459 15:26:50 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:52.459 15:26:50 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.459 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:52.459 ... 00:31:52.459 fio-3.35 00:31:52.459 Starting 3 threads 00:31:52.459 EAL: No free 2048 kB hugepages reported on node 1 00:31:52.459 [2024-11-28 15:26:51.704278] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:52.459 [2024-11-28 15:26:51.704367] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:56.646 00:31:56.646 filename0: (groupid=0, jobs=1): err= 0: pid=854706: Thu Nov 28 15:26:56 2024 00:31:56.646 read: IOPS=222, BW=27.8MiB/s (29.1MB/s)(140MiB/5047msec) 00:31:56.646 slat (nsec): min=4656, max=44094, avg=16344.72, stdev=4026.76 00:31:56.646 clat (usec): min=7053, max=55264, avg=13435.90, stdev=3389.81 00:31:56.646 lat (usec): min=7072, max=55280, avg=13452.25, stdev=3389.66 00:31:56.646 clat percentiles (usec): 00:31:56.646 | 1.00th=[ 7832], 5.00th=[ 9110], 10.00th=[10159], 20.00th=[11469], 00:31:56.646 | 30.00th=[12387], 40.00th=[13173], 50.00th=[13698], 60.00th=[14091], 00:31:56.646 | 70.00th=[14484], 80.00th=[15008], 90.00th=[15664], 95.00th=[16188], 00:31:56.646 | 99.00th=[17433], 99.50th=[22414], 99.90th=[54264], 99.95th=[55313], 00:31:56.646 | 99.99th=[55313] 00:31:56.646 bw ( KiB/s): min=26624, max=33024, per=31.61%, avg=28646.40, stdev=1867.42, samples=10 00:31:56.646 iops : min= 208, max= 258, avg=223.80, stdev=14.59, samples=10 00:31:56.646 lat (msec) : 10=9.54%, 20=89.75%, 50=0.36%, 100=0.36% 00:31:56.646 cpu : usr=94.07%, sys=5.35%, ctx=8, majf=0, minf=141 00:31:56.646 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.646 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.646 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.646 issued rwts: total=1122,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.646 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:56.646 filename0: (groupid=0, jobs=1): err= 0: pid=854707: Thu Nov 28 15:26:56 2024 00:31:56.646 read: IOPS=237, BW=29.7MiB/s (31.1MB/s)(149MiB/5005msec) 00:31:56.646 slat (nsec): min=4066, max=77577, avg=17734.83, stdev=5961.48 00:31:56.646 clat (usec): min=6088, max=53914, avg=12604.69, stdev=3121.09 00:31:56.646 lat (usec): min=6108, max=53935, avg=12622.42, stdev=3121.46 00:31:56.646 clat percentiles (usec): 00:31:56.646 | 1.00th=[ 6783], 5.00th=[ 7767], 10.00th=[ 8848], 20.00th=[11076], 00:31:56.646 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12649], 60.00th=[13304], 00:31:56.646 | 70.00th=[13960], 80.00th=[14484], 90.00th=[15270], 95.00th=[15664], 00:31:56.646 | 99.00th=[16581], 99.50th=[22152], 99.90th=[53740], 99.95th=[53740], 00:31:56.646 | 99.99th=[53740] 00:31:56.647 bw ( KiB/s): min=27648, max=34885, per=33.51%, avg=30368.50, stdev=2100.39, samples=10 00:31:56.647 iops : min= 216, max= 272, avg=237.20, stdev=16.28, samples=10 00:31:56.647 lat (msec) : 10=13.29%, 20=86.21%, 50=0.25%, 100=0.25% 00:31:56.647 cpu : usr=87.05%, sys=8.73%, ctx=273, majf=0, minf=97 00:31:56.647 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.647 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.647 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.647 issued rwts: total=1189,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.647 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:56.647 filename0: (groupid=0, jobs=1): err= 0: pid=854708: Thu Nov 28 15:26:56 2024 00:31:56.647 read: IOPS=250, BW=31.3MiB/s (32.8MB/s)(158MiB/5045msec) 00:31:56.647 slat (nsec): min=4643, max=51765, avg=16641.57, stdev=5194.86 00:31:56.647 clat (usec): min=4849, max=53368, avg=11938.30, stdev=6488.54 00:31:56.647 lat (usec): min=4857, max=53383, avg=11954.95, stdev=6488.26 00:31:56.647 clat percentiles (usec): 00:31:56.647 | 1.00th=[ 5211], 5.00th=[ 9241], 10.00th=[ 9634], 20.00th=[10028], 00:31:56.647 | 30.00th=[10421], 40.00th=[10683], 50.00th=[10945], 60.00th=[11207], 00:31:56.647 | 70.00th=[11469], 80.00th=[11863], 90.00th=[12649], 95.00th=[13435], 00:31:56.647 | 99.00th=[52167], 99.50th=[52167], 99.90th=[53216], 99.95th=[53216], 00:31:56.647 | 99.99th=[53216] 00:31:56.647 bw ( KiB/s): min=23296, max=35840, per=35.57%, avg=32230.40, stdev=3907.58, samples=10 00:31:56.647 iops : min= 182, max= 280, avg=251.80, stdev=30.53, samples=10 00:31:56.647 lat (msec) : 10=18.38%, 20=79.08%, 50=0.40%, 100=2.14% 00:31:56.647 cpu : usr=94.43%, sys=4.98%, ctx=31, majf=0, minf=74 00:31:56.647 IO depths : 1=1.0%, 2=99.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.647 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.647 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.647 issued rwts: total=1262,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.647 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:56.647 00:31:56.647 Run status group 0 (all jobs): 00:31:56.647 READ: bw=88.5MiB/s (92.8MB/s), 27.8MiB/s-31.3MiB/s (29.1MB/s-32.8MB/s), io=447MiB (468MB), run=5005-5047msec 00:31:56.906 15:26:57 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:56.906 15:26:57 -- target/dif.sh@43 -- # local sub 00:31:56.906 15:26:57 -- target/dif.sh@45 -- # for sub in "$@" 00:31:56.906 15:26:57 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:56.906 15:26:57 -- target/dif.sh@36 -- # local sub_id=0 00:31:56.906 15:26:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:56.906 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.907 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:56.907 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.907 15:26:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:56.907 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.907 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:56.907 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.907 15:26:57 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:56.907 15:26:57 -- target/dif.sh@109 -- # bs=4k 00:31:56.907 15:26:57 -- target/dif.sh@109 -- # numjobs=8 00:31:56.907 15:26:57 -- target/dif.sh@109 -- # iodepth=16 00:31:56.907 15:26:57 -- target/dif.sh@109 -- # runtime= 00:31:56.907 15:26:57 -- target/dif.sh@109 -- # files=2 00:31:56.907 15:26:57 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:56.907 15:26:57 -- target/dif.sh@28 -- # local sub 00:31:56.907 15:26:57 -- target/dif.sh@30 -- # for sub in "$@" 00:31:56.907 15:26:57 -- target/dif.sh@31 -- # create_subsystem 0 00:31:56.907 15:26:57 -- target/dif.sh@18 -- # local sub_id=0 00:31:56.907 15:26:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:56.907 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.907 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.166 bdev_null0 00:31:57.166 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.166 15:26:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:57.166 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.166 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.166 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.166 15:26:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:57.166 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.166 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.166 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.166 15:26:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:57.166 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.166 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.166 [2024-11-28 15:26:57.165528] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:57.166 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.166 15:26:57 -- target/dif.sh@30 -- # for sub in "$@" 00:31:57.167 15:26:57 -- target/dif.sh@31 -- # create_subsystem 1 00:31:57.167 15:26:57 -- target/dif.sh@18 -- # local sub_id=1 00:31:57.167 15:26:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 bdev_null1 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@30 -- # for sub in "$@" 00:31:57.167 15:26:57 -- target/dif.sh@31 -- # create_subsystem 2 00:31:57.167 15:26:57 -- target/dif.sh@18 -- # local sub_id=2 00:31:57.167 15:26:57 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 bdev_null2 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:57.167 15:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:57.167 15:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:57.167 15:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:57.167 15:26:57 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:57.167 15:26:57 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:57.167 15:26:57 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:57.167 15:26:57 -- nvmf/common.sh@520 -- # config=() 00:31:57.167 15:26:57 -- nvmf/common.sh@520 -- # local subsystem config 00:31:57.167 15:26:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:57.167 15:26:57 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:57.167 15:26:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:57.167 { 00:31:57.167 "params": { 00:31:57.167 "name": "Nvme$subsystem", 00:31:57.167 "trtype": "$TEST_TRANSPORT", 00:31:57.167 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:57.167 "adrfam": "ipv4", 00:31:57.167 "trsvcid": "$NVMF_PORT", 00:31:57.167 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:57.167 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:57.167 "hdgst": ${hdgst:-false}, 00:31:57.167 "ddgst": ${ddgst:-false} 00:31:57.167 }, 00:31:57.167 "method": "bdev_nvme_attach_controller" 00:31:57.167 } 00:31:57.167 EOF 00:31:57.167 )") 00:31:57.167 15:26:57 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:57.167 15:26:57 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:57.167 15:26:57 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:57.167 15:26:57 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:57.167 15:26:57 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:57.167 15:26:57 -- target/dif.sh@82 -- # gen_fio_conf 00:31:57.167 15:26:57 -- common/autotest_common.sh@1330 -- # shift 00:31:57.167 15:26:57 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:57.167 15:26:57 -- target/dif.sh@54 -- # local file 00:31:57.167 15:26:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:57.167 15:26:57 -- target/dif.sh@56 -- # cat 00:31:57.167 15:26:57 -- nvmf/common.sh@542 -- # cat 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:57.167 15:26:57 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:57.167 15:26:57 -- target/dif.sh@72 -- # (( file <= files )) 00:31:57.167 15:26:57 -- target/dif.sh@73 -- # cat 00:31:57.167 15:26:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:57.167 15:26:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:57.167 { 00:31:57.167 "params": { 00:31:57.167 "name": "Nvme$subsystem", 00:31:57.167 "trtype": "$TEST_TRANSPORT", 00:31:57.167 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:57.167 "adrfam": "ipv4", 00:31:57.167 "trsvcid": "$NVMF_PORT", 00:31:57.167 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:57.167 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:57.167 "hdgst": ${hdgst:-false}, 00:31:57.167 "ddgst": ${ddgst:-false} 00:31:57.167 }, 00:31:57.167 "method": "bdev_nvme_attach_controller" 00:31:57.167 } 00:31:57.167 EOF 00:31:57.167 )") 00:31:57.167 15:26:57 -- nvmf/common.sh@542 -- # cat 00:31:57.167 15:26:57 -- target/dif.sh@72 -- # (( file++ )) 00:31:57.167 15:26:57 -- target/dif.sh@72 -- # (( file <= files )) 00:31:57.167 15:26:57 -- target/dif.sh@73 -- # cat 00:31:57.167 15:26:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:57.167 15:26:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:57.167 { 00:31:57.167 "params": { 00:31:57.167 "name": "Nvme$subsystem", 00:31:57.167 "trtype": "$TEST_TRANSPORT", 00:31:57.167 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:57.167 "adrfam": "ipv4", 00:31:57.167 "trsvcid": "$NVMF_PORT", 00:31:57.167 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:57.167 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:57.167 "hdgst": ${hdgst:-false}, 00:31:57.167 "ddgst": ${ddgst:-false} 00:31:57.167 }, 00:31:57.167 "method": "bdev_nvme_attach_controller" 00:31:57.167 } 00:31:57.167 EOF 00:31:57.167 )") 00:31:57.167 15:26:57 -- target/dif.sh@72 -- # (( file++ )) 00:31:57.167 15:26:57 -- target/dif.sh@72 -- # (( file <= files )) 00:31:57.167 15:26:57 -- nvmf/common.sh@542 -- # cat 00:31:57.167 15:26:57 -- nvmf/common.sh@544 -- # jq . 00:31:57.167 15:26:57 -- nvmf/common.sh@545 -- # IFS=, 00:31:57.167 15:26:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:57.167 "params": { 00:31:57.167 "name": "Nvme0", 00:31:57.167 "trtype": "tcp", 00:31:57.167 "traddr": "10.0.0.2", 00:31:57.167 "adrfam": "ipv4", 00:31:57.167 "trsvcid": "4420", 00:31:57.167 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:57.167 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:57.167 "hdgst": false, 00:31:57.167 "ddgst": false 00:31:57.167 }, 00:31:57.167 "method": "bdev_nvme_attach_controller" 00:31:57.167 },{ 00:31:57.167 "params": { 00:31:57.167 "name": "Nvme1", 00:31:57.167 "trtype": "tcp", 00:31:57.167 "traddr": "10.0.0.2", 00:31:57.167 "adrfam": "ipv4", 00:31:57.167 "trsvcid": "4420", 00:31:57.167 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:57.167 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:57.167 "hdgst": false, 00:31:57.167 "ddgst": false 00:31:57.167 }, 00:31:57.167 "method": "bdev_nvme_attach_controller" 00:31:57.167 },{ 00:31:57.167 "params": { 00:31:57.167 "name": "Nvme2", 00:31:57.167 "trtype": "tcp", 00:31:57.167 "traddr": "10.0.0.2", 00:31:57.167 "adrfam": "ipv4", 00:31:57.167 "trsvcid": "4420", 00:31:57.167 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:57.167 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:57.167 "hdgst": false, 00:31:57.167 "ddgst": false 00:31:57.167 }, 00:31:57.167 "method": "bdev_nvme_attach_controller" 00:31:57.167 }' 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:57.167 15:26:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:57.167 15:26:57 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:57.167 15:26:57 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:57.167 15:26:57 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:57.167 15:26:57 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:57.167 15:26:57 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:57.427 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:57.427 ... 00:31:57.427 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:57.427 ... 00:31:57.427 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:57.427 ... 00:31:57.427 fio-3.35 00:31:57.427 Starting 24 threads 00:31:57.427 EAL: No free 2048 kB hugepages reported on node 1 00:31:57.993 [2024-11-28 15:26:58.190145] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:57.993 [2024-11-28 15:26:58.190214] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:10.200 00:32:10.200 filename0: (groupid=0, jobs=1): err= 0: pid=855599: Thu Nov 28 15:27:08 2024 00:32:10.200 read: IOPS=49, BW=196KiB/s (201kB/s)(1984KiB/10105msec) 00:32:10.200 slat (usec): min=8, max=144, avg=36.78, stdev=26.86 00:32:10.200 clat (msec): min=133, max=500, avg=325.64, stdev=76.57 00:32:10.200 lat (msec): min=133, max=500, avg=325.68, stdev=76.58 00:32:10.200 clat percentiles (msec): 00:32:10.200 | 1.00th=[ 134], 5.00th=[ 167], 10.00th=[ 218], 20.00th=[ 264], 00:32:10.200 | 30.00th=[ 313], 40.00th=[ 338], 50.00th=[ 347], 60.00th=[ 355], 00:32:10.200 | 70.00th=[ 359], 80.00th=[ 380], 90.00th=[ 405], 95.00th=[ 409], 00:32:10.200 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:10.200 | 99.99th=[ 502] 00:32:10.200 bw ( KiB/s): min= 128, max= 256, per=3.77%, avg=192.00, stdev=65.66, samples=20 00:32:10.200 iops : min= 32, max= 64, avg=48.00, stdev=16.42, samples=20 00:32:10.200 lat (msec) : 250=19.35%, 500=79.44%, 750=1.21% 00:32:10.200 cpu : usr=98.70%, sys=0.85%, ctx=18, majf=0, minf=51 00:32:10.200 IO depths : 1=5.4%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.1%, 32=0.0%, >=64=0.0% 00:32:10.200 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.200 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.200 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.200 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.200 filename0: (groupid=0, jobs=1): err= 0: pid=855600: Thu Nov 28 15:27:08 2024 00:32:10.200 read: IOPS=71, BW=285KiB/s (291kB/s)(2880KiB/10120msec) 00:32:10.200 slat (nsec): min=5357, max=41575, avg=10393.67, stdev=4155.11 00:32:10.200 clat (msec): min=24, max=466, avg=223.65, stdev=70.62 00:32:10.200 lat (msec): min=24, max=466, avg=223.66, stdev=70.62 00:32:10.200 clat percentiles (msec): 00:32:10.200 | 1.00th=[ 25], 5.00th=[ 87], 10.00th=[ 144], 20.00th=[ 176], 00:32:10.200 | 30.00th=[ 199], 40.00th=[ 207], 50.00th=[ 222], 60.00th=[ 241], 00:32:10.200 | 70.00th=[ 257], 80.00th=[ 271], 90.00th=[ 309], 95.00th=[ 330], 00:32:10.200 | 99.00th=[ 418], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], 00:32:10.200 | 99.99th=[ 468] 00:32:10.200 bw ( KiB/s): min= 176, max= 512, per=5.52%, avg=281.60, stdev=79.81, samples=20 00:32:10.200 iops : min= 44, max= 128, avg=70.40, stdev=19.95, samples=20 00:32:10.200 lat (msec) : 50=2.22%, 100=3.89%, 250=60.28%, 500=33.61% 00:32:10.200 cpu : usr=98.66%, sys=0.85%, ctx=33, majf=0, minf=83 00:32:10.200 IO depths : 1=0.4%, 2=1.8%, 4=10.0%, 8=75.4%, 16=12.4%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=89.8%, 8=5.1%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=720,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename0: (groupid=0, jobs=1): err= 0: pid=855601: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=62, BW=251KiB/s (257kB/s)(2536KiB/10105msec) 00:32:10.201 slat (usec): min=8, max=111, avg=23.48, stdev=24.89 00:32:10.201 clat (msec): min=157, max=403, avg=253.57, stdev=50.19 00:32:10.201 lat (msec): min=157, max=403, avg=253.60, stdev=50.19 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 163], 5.00th=[ 167], 10.00th=[ 197], 20.00th=[ 213], 00:32:10.201 | 30.00th=[ 224], 40.00th=[ 228], 50.00th=[ 253], 60.00th=[ 266], 00:32:10.201 | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 313], 95.00th=[ 334], 00:32:10.201 | 99.00th=[ 397], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], 00:32:10.201 | 99.99th=[ 405] 00:32:10.201 bw ( KiB/s): min= 128, max= 368, per=4.85%, avg=247.20, stdev=58.84, samples=20 00:32:10.201 iops : min= 32, max= 92, avg=61.80, stdev=14.71, samples=20 00:32:10.201 lat (msec) : 250=49.53%, 500=50.47% 00:32:10.201 cpu : usr=98.95%, sys=0.58%, ctx=15, majf=0, minf=45 00:32:10.201 IO depths : 1=1.4%, 2=3.6%, 4=12.5%, 8=71.1%, 16=11.4%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=90.4%, 8=4.4%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=634,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename0: (groupid=0, jobs=1): err= 0: pid=855602: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=49, BW=197KiB/s (202kB/s)(1984KiB/10057msec) 00:32:10.201 slat (usec): min=5, max=141, avg=74.08, stdev=36.44 00:32:10.201 clat (msec): min=130, max=605, avg=323.77, stdev=66.97 00:32:10.201 lat (msec): min=130, max=605, avg=323.84, stdev=66.98 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 169], 5.00th=[ 215], 10.00th=[ 222], 20.00th=[ 257], 00:32:10.201 | 30.00th=[ 305], 40.00th=[ 330], 50.00th=[ 347], 60.00th=[ 355], 00:32:10.201 | 70.00th=[ 355], 80.00th=[ 380], 90.00th=[ 388], 95.00th=[ 393], 00:32:10.201 | 99.00th=[ 523], 99.50th=[ 535], 99.90th=[ 609], 99.95th=[ 609], 00:32:10.201 | 99.99th=[ 609] 00:32:10.201 bw ( KiB/s): min= 128, max= 272, per=3.77%, avg=192.00, stdev=62.94, samples=20 00:32:10.201 iops : min= 32, max= 68, avg=48.00, stdev=15.73, samples=20 00:32:10.201 lat (msec) : 250=17.74%, 500=81.05%, 750=1.21% 00:32:10.201 cpu : usr=98.35%, sys=1.09%, ctx=50, majf=0, minf=39 00:32:10.201 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename0: (groupid=0, jobs=1): err= 0: pid=855603: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=52, BW=209KiB/s (214kB/s)(2112KiB/10123msec) 00:32:10.201 slat (usec): min=4, max=149, avg=70.76, stdev=34.24 00:32:10.201 clat (msec): min=10, max=506, avg=306.22, stdev=102.04 00:32:10.201 lat (msec): min=10, max=506, avg=306.29, stdev=102.05 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 190], 20.00th=[ 220], 00:32:10.201 | 30.00th=[ 300], 40.00th=[ 321], 50.00th=[ 347], 60.00th=[ 355], 00:32:10.201 | 70.00th=[ 363], 80.00th=[ 376], 90.00th=[ 393], 95.00th=[ 401], 00:32:10.201 | 99.00th=[ 481], 99.50th=[ 493], 99.90th=[ 506], 99.95th=[ 506], 00:32:10.201 | 99.99th=[ 506] 00:32:10.201 bw ( KiB/s): min= 128, max= 512, per=4.00%, avg=204.80, stdev=95.52, samples=20 00:32:10.201 iops : min= 32, max= 128, avg=51.20, stdev=23.88, samples=20 00:32:10.201 lat (msec) : 20=6.06%, 250=19.70%, 500=73.86%, 750=0.38% 00:32:10.201 cpu : usr=98.45%, sys=0.94%, ctx=50, majf=0, minf=40 00:32:10.201 IO depths : 1=3.6%, 2=9.5%, 4=23.5%, 8=54.5%, 16=8.9%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=93.9%, 8=0.3%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename0: (groupid=0, jobs=1): err= 0: pid=855604: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=47, BW=189KiB/s (194kB/s)(1912KiB/10092msec) 00:32:10.201 slat (nsec): min=5389, max=95708, avg=31379.56, stdev=18601.48 00:32:10.201 clat (msec): min=132, max=570, avg=337.25, stdev=71.54 00:32:10.201 lat (msec): min=132, max=570, avg=337.28, stdev=71.53 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 133], 5.00th=[ 211], 10.00th=[ 226], 20.00th=[ 300], 00:32:10.201 | 30.00th=[ 330], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 355], 00:32:10.201 | 70.00th=[ 363], 80.00th=[ 384], 90.00th=[ 405], 95.00th=[ 435], 00:32:10.201 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 575], 99.95th=[ 575], 00:32:10.201 | 99.99th=[ 575] 00:32:10.201 bw ( KiB/s): min= 112, max= 256, per=3.61%, avg=184.80, stdev=64.73, samples=20 00:32:10.201 iops : min= 28, max= 64, avg=46.20, stdev=16.18, samples=20 00:32:10.201 lat (msec) : 250=12.55%, 500=84.10%, 750=3.35% 00:32:10.201 cpu : usr=98.95%, sys=0.61%, ctx=17, majf=0, minf=45 00:32:10.201 IO depths : 1=3.3%, 2=9.6%, 4=25.1%, 8=52.9%, 16=9.0%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename0: (groupid=0, jobs=1): err= 0: pid=855605: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=49, BW=196KiB/s (201kB/s)(1984KiB/10105msec) 00:32:10.201 slat (nsec): min=7429, max=81426, avg=28825.48, stdev=12336.66 00:32:10.201 clat (msec): min=167, max=454, avg=324.42, stdev=61.29 00:32:10.201 lat (msec): min=167, max=454, avg=324.45, stdev=61.28 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 167], 5.00th=[ 211], 10.00th=[ 222], 20.00th=[ 279], 00:32:10.201 | 30.00th=[ 313], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 351], 00:32:10.201 | 70.00th=[ 355], 80.00th=[ 363], 90.00th=[ 388], 95.00th=[ 405], 00:32:10.201 | 99.00th=[ 409], 99.50th=[ 418], 99.90th=[ 456], 99.95th=[ 456], 00:32:10.201 | 99.99th=[ 456] 00:32:10.201 bw ( KiB/s): min= 128, max= 256, per=3.77%, avg=192.00, stdev=65.66, samples=20 00:32:10.201 iops : min= 32, max= 64, avg=48.00, stdev=16.42, samples=20 00:32:10.201 lat (msec) : 250=16.13%, 500=83.87% 00:32:10.201 cpu : usr=98.70%, sys=0.84%, ctx=18, majf=0, minf=48 00:32:10.201 IO depths : 1=5.6%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.9%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename0: (groupid=0, jobs=1): err= 0: pid=855606: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=47, BW=190KiB/s (195kB/s)(1920KiB/10091msec) 00:32:10.201 slat (usec): min=3, max=117, avg=42.56, stdev=28.28 00:32:10.201 clat (msec): min=211, max=409, avg=334.66, stdev=51.17 00:32:10.201 lat (msec): min=211, max=409, avg=334.70, stdev=51.16 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 211], 5.00th=[ 218], 10.00th=[ 226], 20.00th=[ 300], 00:32:10.201 | 30.00th=[ 321], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 355], 00:32:10.201 | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 388], 95.00th=[ 405], 00:32:10.201 | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], 00:32:10.201 | 99.99th=[ 409] 00:32:10.201 bw ( KiB/s): min= 128, max= 256, per=3.63%, avg=185.60, stdev=65.33, samples=20 00:32:10.201 iops : min= 32, max= 64, avg=46.40, stdev=16.33, samples=20 00:32:10.201 lat (msec) : 250=10.00%, 500=90.00% 00:32:10.201 cpu : usr=98.75%, sys=0.78%, ctx=30, majf=0, minf=42 00:32:10.201 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename1: (groupid=0, jobs=1): err= 0: pid=855607: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=61, BW=247KiB/s (253kB/s)(2504KiB/10120msec) 00:32:10.201 slat (usec): min=6, max=108, avg=23.16, stdev=20.21 00:32:10.201 clat (msec): min=24, max=433, avg=257.70, stdev=67.35 00:32:10.201 lat (msec): min=24, max=433, avg=257.73, stdev=67.35 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 25], 5.00th=[ 159], 10.00th=[ 192], 20.00th=[ 213], 00:32:10.201 | 30.00th=[ 222], 40.00th=[ 232], 50.00th=[ 257], 60.00th=[ 268], 00:32:10.201 | 70.00th=[ 296], 80.00th=[ 309], 90.00th=[ 347], 95.00th=[ 363], 00:32:10.201 | 99.00th=[ 372], 99.50th=[ 388], 99.90th=[ 435], 99.95th=[ 435], 00:32:10.201 | 99.99th=[ 435] 00:32:10.201 bw ( KiB/s): min= 128, max= 384, per=4.79%, avg=244.00, stdev=69.62, samples=20 00:32:10.201 iops : min= 32, max= 96, avg=61.00, stdev=17.41, samples=20 00:32:10.201 lat (msec) : 50=2.56%, 250=43.13%, 500=54.31% 00:32:10.201 cpu : usr=98.53%, sys=1.03%, ctx=32, majf=0, minf=49 00:32:10.201 IO depths : 1=1.6%, 2=4.6%, 4=15.2%, 8=67.6%, 16=11.0%, 32=0.0%, >=64=0.0% 00:32:10.201 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 complete : 0=0.0%, 4=91.2%, 8=3.3%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.201 issued rwts: total=626,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.201 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.201 filename1: (groupid=0, jobs=1): err= 0: pid=855608: Thu Nov 28 15:27:08 2024 00:32:10.201 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10043msec) 00:32:10.201 slat (usec): min=8, max=143, avg=43.34, stdev=36.89 00:32:10.201 clat (msec): min=105, max=605, avg=345.93, stdev=86.93 00:32:10.201 lat (msec): min=105, max=605, avg=345.98, stdev=86.92 00:32:10.201 clat percentiles (msec): 00:32:10.201 | 1.00th=[ 131], 5.00th=[ 176], 10.00th=[ 224], 20.00th=[ 305], 00:32:10.201 | 30.00th=[ 338], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 359], 00:32:10.201 | 70.00th=[ 384], 80.00th=[ 393], 90.00th=[ 418], 95.00th=[ 485], 00:32:10.202 | 99.00th=[ 575], 99.50th=[ 592], 99.90th=[ 609], 99.95th=[ 609], 00:32:10.202 | 99.99th=[ 609] 00:32:10.202 bw ( KiB/s): min= 112, max= 272, per=3.51%, avg=179.20, stdev=60.45, samples=20 00:32:10.202 iops : min= 28, max= 68, avg=44.80, stdev=15.11, samples=20 00:32:10.202 lat (msec) : 250=16.38%, 500=79.31%, 750=4.31% 00:32:10.202 cpu : usr=98.85%, sys=0.68%, ctx=21, majf=0, minf=44 00:32:10.202 IO depths : 1=3.4%, 2=9.5%, 4=24.4%, 8=53.7%, 16=9.1%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=94.1%, 8=0.2%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename1: (groupid=0, jobs=1): err= 0: pid=855609: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=63, BW=254KiB/s (260kB/s)(2568KiB/10105msec) 00:32:10.202 slat (nsec): min=8090, max=96478, avg=18954.67, stdev=16347.11 00:32:10.202 clat (msec): min=156, max=384, avg=251.25, stdev=47.40 00:32:10.202 lat (msec): min=156, max=384, avg=251.27, stdev=47.40 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 161], 5.00th=[ 169], 10.00th=[ 199], 20.00th=[ 213], 00:32:10.202 | 30.00th=[ 224], 40.00th=[ 230], 50.00th=[ 253], 60.00th=[ 264], 00:32:10.202 | 70.00th=[ 268], 80.00th=[ 300], 90.00th=[ 313], 95.00th=[ 330], 00:32:10.202 | 99.00th=[ 376], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:32:10.202 | 99.99th=[ 384] 00:32:10.202 bw ( KiB/s): min= 128, max= 368, per=4.91%, avg=250.40, stdev=58.33, samples=20 00:32:10.202 iops : min= 32, max= 92, avg=62.60, stdev=14.58, samples=20 00:32:10.202 lat (msec) : 250=49.53%, 500=50.47% 00:32:10.202 cpu : usr=98.72%, sys=0.82%, ctx=31, majf=0, minf=38 00:32:10.202 IO depths : 1=1.6%, 2=4.2%, 4=14.0%, 8=69.2%, 16=11.1%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=90.9%, 8=3.6%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=642,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename1: (groupid=0, jobs=1): err= 0: pid=855610: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=47, BW=190KiB/s (195kB/s)(1920KiB/10090msec) 00:32:10.202 slat (usec): min=8, max=140, avg=79.04, stdev=34.96 00:32:10.202 clat (msec): min=134, max=501, avg=335.64, stdev=70.19 00:32:10.202 lat (msec): min=134, max=501, avg=335.72, stdev=70.20 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 136], 5.00th=[ 211], 10.00th=[ 220], 20.00th=[ 300], 00:32:10.202 | 30.00th=[ 330], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 355], 00:32:10.202 | 70.00th=[ 363], 80.00th=[ 380], 90.00th=[ 405], 95.00th=[ 409], 00:32:10.202 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:10.202 | 99.99th=[ 502] 00:32:10.202 bw ( KiB/s): min= 127, max= 256, per=3.63%, avg=185.55, stdev=65.38, samples=20 00:32:10.202 iops : min= 31, max= 64, avg=46.35, stdev=16.38, samples=20 00:32:10.202 lat (msec) : 250=13.33%, 500=83.33%, 750=3.33% 00:32:10.202 cpu : usr=98.05%, sys=1.20%, ctx=134, majf=0, minf=44 00:32:10.202 IO depths : 1=5.0%, 2=11.2%, 4=25.0%, 8=51.2%, 16=7.5%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename1: (groupid=0, jobs=1): err= 0: pid=855611: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=49, BW=196KiB/s (201kB/s)(1984KiB/10107msec) 00:32:10.202 slat (usec): min=13, max=147, avg=92.00, stdev=20.80 00:32:10.202 clat (msec): min=132, max=502, avg=325.37, stdev=75.36 00:32:10.202 lat (msec): min=132, max=502, avg=325.46, stdev=75.38 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 133], 5.00th=[ 167], 10.00th=[ 218], 20.00th=[ 264], 00:32:10.202 | 30.00th=[ 313], 40.00th=[ 338], 50.00th=[ 347], 60.00th=[ 355], 00:32:10.202 | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 393], 95.00th=[ 409], 00:32:10.202 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:10.202 | 99.99th=[ 502] 00:32:10.202 bw ( KiB/s): min= 128, max= 256, per=3.77%, avg=192.00, stdev=62.72, samples=20 00:32:10.202 iops : min= 32, max= 64, avg=48.00, stdev=15.68, samples=20 00:32:10.202 lat (msec) : 250=19.35%, 500=77.82%, 750=2.82% 00:32:10.202 cpu : usr=97.94%, sys=1.18%, ctx=151, majf=0, minf=29 00:32:10.202 IO depths : 1=0.6%, 2=6.9%, 4=25.0%, 8=55.6%, 16=11.9%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename1: (groupid=0, jobs=1): err= 0: pid=855612: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=47, BW=189KiB/s (194kB/s)(1912KiB/10090msec) 00:32:10.202 slat (usec): min=8, max=121, avg=37.33, stdev=30.90 00:32:10.202 clat (msec): min=105, max=615, avg=337.23, stdev=86.85 00:32:10.202 lat (msec): min=105, max=615, avg=337.27, stdev=86.84 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 131], 5.00th=[ 163], 10.00th=[ 222], 20.00th=[ 257], 00:32:10.202 | 30.00th=[ 330], 40.00th=[ 342], 50.00th=[ 355], 60.00th=[ 355], 00:32:10.202 | 70.00th=[ 372], 80.00th=[ 388], 90.00th=[ 405], 95.00th=[ 451], 00:32:10.202 | 99.00th=[ 575], 99.50th=[ 609], 99.90th=[ 617], 99.95th=[ 617], 00:32:10.202 | 99.99th=[ 617] 00:32:10.202 bw ( KiB/s): min= 112, max= 256, per=3.61%, avg=184.80, stdev=60.20, samples=20 00:32:10.202 iops : min= 28, max= 64, avg=46.20, stdev=15.05, samples=20 00:32:10.202 lat (msec) : 250=17.15%, 500=78.66%, 750=4.18% 00:32:10.202 cpu : usr=98.63%, sys=0.85%, ctx=21, majf=0, minf=38 00:32:10.202 IO depths : 1=3.3%, 2=9.6%, 4=25.1%, 8=52.9%, 16=9.0%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=478,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename1: (groupid=0, jobs=1): err= 0: pid=855613: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=46, BW=185KiB/s (189kB/s)(1856KiB/10044msec) 00:32:10.202 slat (nsec): min=8178, max=85150, avg=24025.70, stdev=19574.85 00:32:10.202 clat (msec): min=119, max=605, avg=346.11, stdev=82.03 00:32:10.202 lat (msec): min=119, max=605, avg=346.13, stdev=82.03 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 155], 5.00th=[ 192], 10.00th=[ 224], 20.00th=[ 305], 00:32:10.202 | 30.00th=[ 330], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 359], 00:32:10.202 | 70.00th=[ 380], 80.00th=[ 393], 90.00th=[ 418], 95.00th=[ 489], 00:32:10.202 | 99.00th=[ 575], 99.50th=[ 592], 99.90th=[ 609], 99.95th=[ 609], 00:32:10.202 | 99.99th=[ 609] 00:32:10.202 bw ( KiB/s): min= 112, max= 256, per=3.51%, avg=179.20, stdev=60.23, samples=20 00:32:10.202 iops : min= 28, max= 64, avg=44.80, stdev=15.06, samples=20 00:32:10.202 lat (msec) : 250=15.09%, 500=80.60%, 750=4.31% 00:32:10.202 cpu : usr=98.76%, sys=0.84%, ctx=8, majf=0, minf=51 00:32:10.202 IO depths : 1=3.4%, 2=9.7%, 4=25.0%, 8=52.8%, 16=9.1%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename1: (groupid=0, jobs=1): err= 0: pid=855614: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=47, BW=191KiB/s (196kB/s)(1920KiB/10044msec) 00:32:10.202 slat (usec): min=8, max=135, avg=29.51, stdev=12.27 00:32:10.202 clat (msec): min=188, max=426, avg=334.55, stdev=53.11 00:32:10.202 lat (msec): min=188, max=426, avg=334.58, stdev=53.11 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 211], 5.00th=[ 218], 10.00th=[ 255], 20.00th=[ 300], 00:32:10.202 | 30.00th=[ 313], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 355], 00:32:10.202 | 70.00th=[ 363], 80.00th=[ 376], 90.00th=[ 393], 95.00th=[ 405], 00:32:10.202 | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 426], 99.95th=[ 426], 00:32:10.202 | 99.99th=[ 426] 00:32:10.202 bw ( KiB/s): min= 128, max= 256, per=3.63%, avg=185.60, stdev=63.87, samples=20 00:32:10.202 iops : min= 32, max= 64, avg=46.40, stdev=15.97, samples=20 00:32:10.202 lat (msec) : 250=9.58%, 500=90.42% 00:32:10.202 cpu : usr=98.83%, sys=0.76%, ctx=23, majf=0, minf=53 00:32:10.202 IO depths : 1=4.6%, 2=10.8%, 4=25.0%, 8=51.7%, 16=7.9%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename2: (groupid=0, jobs=1): err= 0: pid=855615: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=49, BW=199KiB/s (203kB/s)(2008KiB/10105msec) 00:32:10.202 slat (nsec): min=11225, max=73919, avg=27616.27, stdev=10049.05 00:32:10.202 clat (msec): min=166, max=464, avg=320.52, stdev=65.28 00:32:10.202 lat (msec): min=166, max=464, avg=320.55, stdev=65.29 00:32:10.202 clat percentiles (msec): 00:32:10.202 | 1.00th=[ 167], 5.00th=[ 199], 10.00th=[ 218], 20.00th=[ 266], 00:32:10.202 | 30.00th=[ 300], 40.00th=[ 326], 50.00th=[ 338], 60.00th=[ 351], 00:32:10.202 | 70.00th=[ 355], 80.00th=[ 372], 90.00th=[ 388], 95.00th=[ 409], 00:32:10.202 | 99.00th=[ 435], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], 00:32:10.202 | 99.99th=[ 464] 00:32:10.202 bw ( KiB/s): min= 128, max= 256, per=3.81%, avg=194.40, stdev=62.57, samples=20 00:32:10.202 iops : min= 32, max= 64, avg=48.60, stdev=15.64, samples=20 00:32:10.202 lat (msec) : 250=18.33%, 500=81.67% 00:32:10.202 cpu : usr=97.66%, sys=1.45%, ctx=73, majf=0, minf=32 00:32:10.202 IO depths : 1=4.2%, 2=10.0%, 4=23.5%, 8=54.0%, 16=8.4%, 32=0.0%, >=64=0.0% 00:32:10.202 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 complete : 0=0.0%, 4=93.6%, 8=0.7%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.202 issued rwts: total=502,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.202 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.202 filename2: (groupid=0, jobs=1): err= 0: pid=855616: Thu Nov 28 15:27:08 2024 00:32:10.202 read: IOPS=47, BW=190KiB/s (195kB/s)(1920KiB/10092msec) 00:32:10.202 slat (usec): min=8, max=115, avg=39.65, stdev=27.37 00:32:10.202 clat (msec): min=133, max=501, avg=336.06, stdev=69.97 00:32:10.203 lat (msec): min=133, max=501, avg=336.10, stdev=69.97 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 134], 5.00th=[ 211], 10.00th=[ 220], 20.00th=[ 300], 00:32:10.203 | 30.00th=[ 330], 40.00th=[ 347], 50.00th=[ 351], 60.00th=[ 355], 00:32:10.203 | 70.00th=[ 363], 80.00th=[ 384], 90.00th=[ 405], 95.00th=[ 409], 00:32:10.203 | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], 00:32:10.203 | 99.99th=[ 502] 00:32:10.203 bw ( KiB/s): min= 127, max= 256, per=3.63%, avg=185.55, stdev=65.38, samples=20 00:32:10.203 iops : min= 31, max= 64, avg=46.35, stdev=16.38, samples=20 00:32:10.203 lat (msec) : 250=12.92%, 500=83.75%, 750=3.33% 00:32:10.203 cpu : usr=98.42%, sys=1.08%, ctx=39, majf=0, minf=38 00:32:10.203 IO depths : 1=5.2%, 2=11.5%, 4=25.0%, 8=51.0%, 16=7.3%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 filename2: (groupid=0, jobs=1): err= 0: pid=855617: Thu Nov 28 15:27:08 2024 00:32:10.203 read: IOPS=63, BW=254KiB/s (260kB/s)(2560KiB/10073msec) 00:32:10.203 slat (usec): min=8, max=119, avg=31.75, stdev=33.51 00:32:10.203 clat (msec): min=23, max=395, avg=251.56, stdev=71.05 00:32:10.203 lat (msec): min=23, max=395, avg=251.59, stdev=71.07 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 24], 5.00th=[ 161], 10.00th=[ 169], 20.00th=[ 176], 00:32:10.203 | 30.00th=[ 220], 40.00th=[ 241], 50.00th=[ 262], 60.00th=[ 288], 00:32:10.203 | 70.00th=[ 296], 80.00th=[ 305], 90.00th=[ 342], 95.00th=[ 355], 00:32:10.203 | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], 00:32:10.203 | 99.99th=[ 397] 00:32:10.203 bw ( KiB/s): min= 128, max= 384, per=4.89%, avg=249.60, stdev=62.60, samples=20 00:32:10.203 iops : min= 32, max= 96, avg=62.40, stdev=15.65, samples=20 00:32:10.203 lat (msec) : 50=2.50%, 250=46.25%, 500=51.25% 00:32:10.203 cpu : usr=98.67%, sys=0.87%, ctx=13, majf=0, minf=32 00:32:10.203 IO depths : 1=1.6%, 2=7.8%, 4=25.0%, 8=54.7%, 16=10.9%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=640,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 filename2: (groupid=0, jobs=1): err= 0: pid=855618: Thu Nov 28 15:27:08 2024 00:32:10.203 read: IOPS=68, BW=273KiB/s (279kB/s)(2760KiB/10119msec) 00:32:10.203 slat (nsec): min=8156, max=79423, avg=14555.72, stdev=11704.34 00:32:10.203 clat (msec): min=23, max=388, avg=233.91, stdev=62.43 00:32:10.203 lat (msec): min=23, max=388, avg=233.93, stdev=62.43 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 24], 5.00th=[ 130], 10.00th=[ 157], 20.00th=[ 188], 00:32:10.203 | 30.00th=[ 213], 40.00th=[ 226], 50.00th=[ 241], 60.00th=[ 255], 00:32:10.203 | 70.00th=[ 262], 80.00th=[ 292], 90.00th=[ 300], 95.00th=[ 334], 00:32:10.203 | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], 00:32:10.203 | 99.99th=[ 388] 00:32:10.203 bw ( KiB/s): min= 128, max= 384, per=5.28%, avg=269.60, stdev=69.51, samples=20 00:32:10.203 iops : min= 32, max= 96, avg=67.40, stdev=17.38, samples=20 00:32:10.203 lat (msec) : 50=2.32%, 250=54.49%, 500=43.19% 00:32:10.203 cpu : usr=98.68%, sys=0.89%, ctx=15, majf=0, minf=38 00:32:10.203 IO depths : 1=3.2%, 2=7.1%, 4=17.8%, 8=62.5%, 16=9.4%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=91.9%, 8=2.5%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=690,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 filename2: (groupid=0, jobs=1): err= 0: pid=855619: Thu Nov 28 15:27:08 2024 00:32:10.203 read: IOPS=64, BW=258KiB/s (264kB/s)(2608KiB/10124msec) 00:32:10.203 slat (usec): min=4, max=130, avg=32.61, stdev=35.08 00:32:10.203 clat (msec): min=8, max=481, avg=247.50, stdev=81.96 00:32:10.203 lat (msec): min=8, max=481, avg=247.53, stdev=81.97 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 9], 5.00th=[ 136], 10.00th=[ 171], 20.00th=[ 197], 00:32:10.203 | 30.00th=[ 218], 40.00th=[ 230], 50.00th=[ 243], 60.00th=[ 271], 00:32:10.203 | 70.00th=[ 296], 80.00th=[ 309], 90.00th=[ 351], 95.00th=[ 372], 00:32:10.203 | 99.00th=[ 447], 99.50th=[ 472], 99.90th=[ 481], 99.95th=[ 481], 00:32:10.203 | 99.99th=[ 481] 00:32:10.203 bw ( KiB/s): min= 128, max= 512, per=4.99%, avg=254.40, stdev=77.33, samples=20 00:32:10.203 iops : min= 32, max= 128, avg=63.60, stdev=19.33, samples=20 00:32:10.203 lat (msec) : 10=1.07%, 20=3.83%, 250=46.63%, 500=48.47% 00:32:10.203 cpu : usr=98.62%, sys=0.86%, ctx=17, majf=0, minf=40 00:32:10.203 IO depths : 1=1.2%, 2=5.5%, 4=18.9%, 8=63.0%, 16=11.3%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=92.4%, 8=2.1%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=652,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 filename2: (groupid=0, jobs=1): err= 0: pid=855620: Thu Nov 28 15:27:08 2024 00:32:10.203 read: IOPS=49, BW=197KiB/s (202kB/s)(1984KiB/10060msec) 00:32:10.203 slat (usec): min=8, max=100, avg=31.45, stdev=14.83 00:32:10.203 clat (msec): min=166, max=454, avg=324.22, stdev=61.50 00:32:10.203 lat (msec): min=166, max=454, avg=324.25, stdev=61.50 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 167], 5.00th=[ 213], 10.00th=[ 224], 20.00th=[ 279], 00:32:10.203 | 30.00th=[ 313], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 351], 00:32:10.203 | 70.00th=[ 355], 80.00th=[ 363], 90.00th=[ 388], 95.00th=[ 405], 00:32:10.203 | 99.00th=[ 409], 99.50th=[ 435], 99.90th=[ 456], 99.95th=[ 456], 00:32:10.203 | 99.99th=[ 456] 00:32:10.203 bw ( KiB/s): min= 128, max= 256, per=3.77%, avg=192.00, stdev=65.66, samples=20 00:32:10.203 iops : min= 32, max= 64, avg=48.00, stdev=16.42, samples=20 00:32:10.203 lat (msec) : 250=15.73%, 500=84.27% 00:32:10.203 cpu : usr=98.66%, sys=0.85%, ctx=32, majf=0, minf=45 00:32:10.203 IO depths : 1=5.4%, 2=11.7%, 4=25.0%, 8=50.8%, 16=7.1%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 filename2: (groupid=0, jobs=1): err= 0: pid=855621: Thu Nov 28 15:27:08 2024 00:32:10.203 read: IOPS=47, BW=190KiB/s (195kB/s)(1920KiB/10099msec) 00:32:10.203 slat (nsec): min=3680, max=56494, avg=26525.36, stdev=10184.67 00:32:10.203 clat (msec): min=166, max=503, avg=335.08, stdev=56.56 00:32:10.203 lat (msec): min=166, max=503, avg=335.10, stdev=56.56 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 211], 5.00th=[ 218], 10.00th=[ 226], 20.00th=[ 300], 00:32:10.203 | 30.00th=[ 313], 40.00th=[ 338], 50.00th=[ 351], 60.00th=[ 355], 00:32:10.203 | 70.00th=[ 363], 80.00th=[ 384], 90.00th=[ 393], 95.00th=[ 409], 00:32:10.203 | 99.00th=[ 456], 99.50th=[ 460], 99.90th=[ 506], 99.95th=[ 506], 00:32:10.203 | 99.99th=[ 506] 00:32:10.203 bw ( KiB/s): min= 128, max= 256, per=3.63%, avg=185.60, stdev=63.87, samples=20 00:32:10.203 iops : min= 32, max= 64, avg=46.40, stdev=15.97, samples=20 00:32:10.203 lat (msec) : 250=10.42%, 500=89.17%, 750=0.42% 00:32:10.203 cpu : usr=98.96%, sys=0.64%, ctx=19, majf=0, minf=47 00:32:10.203 IO depths : 1=3.3%, 2=9.6%, 4=25.0%, 8=52.9%, 16=9.2%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 filename2: (groupid=0, jobs=1): err= 0: pid=855622: Thu Nov 28 15:27:08 2024 00:32:10.203 read: IOPS=49, BW=196KiB/s (201kB/s)(1984KiB/10100msec) 00:32:10.203 slat (nsec): min=3763, max=44322, avg=16700.48, stdev=8766.89 00:32:10.203 clat (msec): min=84, max=554, avg=324.38, stdev=67.77 00:32:10.203 lat (msec): min=84, max=554, avg=324.39, stdev=67.77 00:32:10.203 clat percentiles (msec): 00:32:10.203 | 1.00th=[ 130], 5.00th=[ 190], 10.00th=[ 222], 20.00th=[ 257], 00:32:10.203 | 30.00th=[ 313], 40.00th=[ 330], 50.00th=[ 347], 60.00th=[ 351], 00:32:10.203 | 70.00th=[ 355], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 405], 00:32:10.203 | 99.00th=[ 535], 99.50th=[ 542], 99.90th=[ 558], 99.95th=[ 558], 00:32:10.203 | 99.99th=[ 558] 00:32:10.203 bw ( KiB/s): min= 128, max= 272, per=3.77%, avg=192.00, stdev=64.42, samples=20 00:32:10.203 iops : min= 32, max= 68, avg=48.00, stdev=16.10, samples=20 00:32:10.203 lat (msec) : 100=0.40%, 250=16.53%, 500=81.85%, 750=1.21% 00:32:10.203 cpu : usr=98.90%, sys=0.71%, ctx=18, majf=0, minf=51 00:32:10.203 IO depths : 1=4.8%, 2=11.1%, 4=25.0%, 8=51.4%, 16=7.7%, 32=0.0%, >=64=0.0% 00:32:10.203 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:10.203 issued rwts: total=496,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:10.203 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:10.203 00:32:10.203 Run status group 0 (all jobs): 00:32:10.203 READ: bw=5094KiB/s (5217kB/s), 185KiB/s-285KiB/s (189kB/s-291kB/s), io=50.4MiB (52.8MB), run=10043-10124msec 00:32:10.203 15:27:08 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:10.203 15:27:08 -- target/dif.sh@43 -- # local sub 00:32:10.203 15:27:08 -- target/dif.sh@45 -- # for sub in "$@" 00:32:10.203 15:27:08 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:10.203 15:27:08 -- target/dif.sh@36 -- # local sub_id=0 00:32:10.203 15:27:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:10.203 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.203 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.203 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.203 15:27:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:10.203 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.203 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.203 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.203 15:27:08 -- target/dif.sh@45 -- # for sub in "$@" 00:32:10.203 15:27:08 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:10.203 15:27:08 -- target/dif.sh@36 -- # local sub_id=1 00:32:10.203 15:27:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:10.203 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@45 -- # for sub in "$@" 00:32:10.204 15:27:08 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:10.204 15:27:08 -- target/dif.sh@36 -- # local sub_id=2 00:32:10.204 15:27:08 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:10.204 15:27:08 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:10.204 15:27:08 -- target/dif.sh@115 -- # numjobs=2 00:32:10.204 15:27:08 -- target/dif.sh@115 -- # iodepth=8 00:32:10.204 15:27:08 -- target/dif.sh@115 -- # runtime=5 00:32:10.204 15:27:08 -- target/dif.sh@115 -- # files=1 00:32:10.204 15:27:08 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:10.204 15:27:08 -- target/dif.sh@28 -- # local sub 00:32:10.204 15:27:08 -- target/dif.sh@30 -- # for sub in "$@" 00:32:10.204 15:27:08 -- target/dif.sh@31 -- # create_subsystem 0 00:32:10.204 15:27:08 -- target/dif.sh@18 -- # local sub_id=0 00:32:10.204 15:27:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 bdev_null0 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 [2024-11-28 15:27:08.753762] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@30 -- # for sub in "$@" 00:32:10.204 15:27:08 -- target/dif.sh@31 -- # create_subsystem 1 00:32:10.204 15:27:08 -- target/dif.sh@18 -- # local sub_id=1 00:32:10.204 15:27:08 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 bdev_null1 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:10.204 15:27:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:10.204 15:27:08 -- common/autotest_common.sh@10 -- # set +x 00:32:10.204 15:27:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:10.204 15:27:08 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:10.204 15:27:08 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:10.204 15:27:08 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:10.204 15:27:08 -- nvmf/common.sh@520 -- # config=() 00:32:10.204 15:27:08 -- nvmf/common.sh@520 -- # local subsystem config 00:32:10.204 15:27:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:10.204 15:27:08 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:10.204 15:27:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:10.204 { 00:32:10.204 "params": { 00:32:10.204 "name": "Nvme$subsystem", 00:32:10.204 "trtype": "$TEST_TRANSPORT", 00:32:10.204 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:10.204 "adrfam": "ipv4", 00:32:10.204 "trsvcid": "$NVMF_PORT", 00:32:10.204 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:10.204 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:10.204 "hdgst": ${hdgst:-false}, 00:32:10.204 "ddgst": ${ddgst:-false} 00:32:10.204 }, 00:32:10.204 "method": "bdev_nvme_attach_controller" 00:32:10.204 } 00:32:10.204 EOF 00:32:10.204 )") 00:32:10.204 15:27:08 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:10.204 15:27:08 -- target/dif.sh@82 -- # gen_fio_conf 00:32:10.204 15:27:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:10.204 15:27:08 -- target/dif.sh@54 -- # local file 00:32:10.204 15:27:08 -- target/dif.sh@56 -- # cat 00:32:10.204 15:27:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:10.204 15:27:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:10.204 15:27:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:10.204 15:27:08 -- common/autotest_common.sh@1330 -- # shift 00:32:10.204 15:27:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:10.204 15:27:08 -- nvmf/common.sh@542 -- # cat 00:32:10.204 15:27:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:10.204 15:27:08 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:10.204 15:27:08 -- target/dif.sh@72 -- # (( file <= files )) 00:32:10.204 15:27:08 -- target/dif.sh@73 -- # cat 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:10.204 15:27:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:10.204 15:27:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:10.204 { 00:32:10.204 "params": { 00:32:10.204 "name": "Nvme$subsystem", 00:32:10.204 "trtype": "$TEST_TRANSPORT", 00:32:10.204 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:10.204 "adrfam": "ipv4", 00:32:10.204 "trsvcid": "$NVMF_PORT", 00:32:10.204 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:10.204 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:10.204 "hdgst": ${hdgst:-false}, 00:32:10.204 "ddgst": ${ddgst:-false} 00:32:10.204 }, 00:32:10.204 "method": "bdev_nvme_attach_controller" 00:32:10.204 } 00:32:10.204 EOF 00:32:10.204 )") 00:32:10.204 15:27:08 -- target/dif.sh@72 -- # (( file++ )) 00:32:10.204 15:27:08 -- target/dif.sh@72 -- # (( file <= files )) 00:32:10.204 15:27:08 -- nvmf/common.sh@542 -- # cat 00:32:10.204 15:27:08 -- nvmf/common.sh@544 -- # jq . 00:32:10.204 15:27:08 -- nvmf/common.sh@545 -- # IFS=, 00:32:10.204 15:27:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:10.204 "params": { 00:32:10.204 "name": "Nvme0", 00:32:10.204 "trtype": "tcp", 00:32:10.204 "traddr": "10.0.0.2", 00:32:10.204 "adrfam": "ipv4", 00:32:10.204 "trsvcid": "4420", 00:32:10.204 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:10.204 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:10.204 "hdgst": false, 00:32:10.204 "ddgst": false 00:32:10.204 }, 00:32:10.204 "method": "bdev_nvme_attach_controller" 00:32:10.204 },{ 00:32:10.204 "params": { 00:32:10.204 "name": "Nvme1", 00:32:10.204 "trtype": "tcp", 00:32:10.204 "traddr": "10.0.0.2", 00:32:10.204 "adrfam": "ipv4", 00:32:10.204 "trsvcid": "4420", 00:32:10.204 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:10.204 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:10.204 "hdgst": false, 00:32:10.204 "ddgst": false 00:32:10.204 }, 00:32:10.204 "method": "bdev_nvme_attach_controller" 00:32:10.204 }' 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:10.204 15:27:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:10.204 15:27:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:10.204 15:27:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:10.204 15:27:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:10.204 15:27:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:10.204 15:27:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:10.204 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:10.204 ... 00:32:10.204 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:10.204 ... 00:32:10.204 fio-3.35 00:32:10.204 Starting 4 threads 00:32:10.204 EAL: No free 2048 kB hugepages reported on node 1 00:32:10.204 [2024-11-28 15:27:09.619333] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:10.204 [2024-11-28 15:27:09.619421] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:15.474 00:32:15.474 filename0: (groupid=0, jobs=1): err= 0: pid=857658: Thu Nov 28 15:27:14 2024 00:32:15.474 read: IOPS=1664, BW=13.0MiB/s (13.6MB/s)(65.0MiB/5001msec) 00:32:15.474 slat (nsec): min=3699, max=78643, avg=17034.66, stdev=9413.11 00:32:15.474 clat (usec): min=507, max=8499, avg=4749.66, stdev=872.87 00:32:15.474 lat (usec): min=523, max=8506, avg=4766.69, stdev=872.56 00:32:15.474 clat percentiles (usec): 00:32:15.474 | 1.00th=[ 2737], 5.00th=[ 3785], 10.00th=[ 4047], 20.00th=[ 4293], 00:32:15.474 | 30.00th=[ 4424], 40.00th=[ 4490], 50.00th=[ 4555], 60.00th=[ 4686], 00:32:15.474 | 70.00th=[ 4817], 80.00th=[ 5080], 90.00th=[ 5866], 95.00th=[ 6718], 00:32:15.474 | 99.00th=[ 7767], 99.50th=[ 7898], 99.90th=[ 8225], 99.95th=[ 8356], 00:32:15.474 | 99.99th=[ 8455] 00:32:15.474 bw ( KiB/s): min=12688, max=13600, per=23.88%, avg=13298.89, stdev=294.08, samples=9 00:32:15.474 iops : min= 1586, max= 1700, avg=1662.33, stdev=36.75, samples=9 00:32:15.474 lat (usec) : 750=0.01% 00:32:15.474 lat (msec) : 2=0.36%, 4=8.34%, 10=91.29% 00:32:15.474 cpu : usr=95.82%, sys=3.68%, ctx=8, majf=0, minf=9 00:32:15.474 IO depths : 1=0.2%, 2=11.0%, 4=59.3%, 8=29.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.474 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 complete : 0=0.0%, 4=93.9%, 8=6.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 issued rwts: total=8324,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.474 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.474 filename0: (groupid=0, jobs=1): err= 0: pid=857659: Thu Nov 28 15:27:14 2024 00:32:15.474 read: IOPS=1822, BW=14.2MiB/s (14.9MB/s)(71.2MiB/5002msec) 00:32:15.474 slat (nsec): min=3568, max=65737, avg=14385.93, stdev=7896.06 00:32:15.474 clat (usec): min=887, max=8549, avg=4339.02, stdev=585.53 00:32:15.474 lat (usec): min=900, max=8564, avg=4353.41, stdev=585.86 00:32:15.474 clat percentiles (usec): 00:32:15.474 | 1.00th=[ 2278], 5.00th=[ 3392], 10.00th=[ 3720], 20.00th=[ 4047], 00:32:15.474 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4424], 60.00th=[ 4490], 00:32:15.474 | 70.00th=[ 4555], 80.00th=[ 4686], 90.00th=[ 4883], 95.00th=[ 5080], 00:32:15.474 | 99.00th=[ 5735], 99.50th=[ 6521], 99.90th=[ 7504], 99.95th=[ 8356], 00:32:15.474 | 99.99th=[ 8586] 00:32:15.474 bw ( KiB/s): min=14336, max=14832, per=26.18%, avg=14584.00, stdev=144.74, samples=10 00:32:15.474 iops : min= 1792, max= 1854, avg=1822.80, stdev=18.26, samples=10 00:32:15.474 lat (usec) : 1000=0.01% 00:32:15.474 lat (msec) : 2=0.64%, 4=17.79%, 10=81.56% 00:32:15.474 cpu : usr=95.76%, sys=3.70%, ctx=7, majf=0, minf=9 00:32:15.474 IO depths : 1=0.6%, 2=12.0%, 4=59.5%, 8=27.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.474 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 complete : 0=0.0%, 4=92.9%, 8=7.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 issued rwts: total=9117,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.474 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.474 filename1: (groupid=0, jobs=1): err= 0: pid=857660: Thu Nov 28 15:27:14 2024 00:32:15.474 read: IOPS=1742, BW=13.6MiB/s (14.3MB/s)(68.1MiB/5003msec) 00:32:15.474 slat (nsec): min=3626, max=78038, avg=16693.98, stdev=9346.40 00:32:15.474 clat (usec): min=1082, max=7934, avg=4530.85, stdev=704.67 00:32:15.474 lat (usec): min=1099, max=7948, avg=4547.54, stdev=704.79 00:32:15.474 clat percentiles (usec): 00:32:15.474 | 1.00th=[ 2606], 5.00th=[ 3589], 10.00th=[ 3884], 20.00th=[ 4146], 00:32:15.474 | 30.00th=[ 4293], 40.00th=[ 4424], 50.00th=[ 4490], 60.00th=[ 4555], 00:32:15.474 | 70.00th=[ 4686], 80.00th=[ 4817], 90.00th=[ 5211], 95.00th=[ 5866], 00:32:15.474 | 99.00th=[ 7111], 99.50th=[ 7504], 99.90th=[ 7832], 99.95th=[ 7898], 00:32:15.474 | 99.99th=[ 7963] 00:32:15.474 bw ( KiB/s): min=13744, max=14176, per=25.03%, avg=13942.00, stdev=155.51, samples=10 00:32:15.474 iops : min= 1718, max= 1772, avg=1742.70, stdev=19.41, samples=10 00:32:15.474 lat (msec) : 2=0.29%, 4=12.58%, 10=87.13% 00:32:15.474 cpu : usr=95.78%, sys=3.66%, ctx=17, majf=0, minf=9 00:32:15.474 IO depths : 1=0.3%, 2=15.6%, 4=56.8%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.474 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 complete : 0=0.0%, 4=92.2%, 8=7.8%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 issued rwts: total=8719,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.474 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.474 filename1: (groupid=0, jobs=1): err= 0: pid=857661: Thu Nov 28 15:27:14 2024 00:32:15.474 read: IOPS=1733, BW=13.5MiB/s (14.2MB/s)(67.7MiB/5002msec) 00:32:15.474 slat (nsec): min=3741, max=83248, avg=18840.93, stdev=9214.73 00:32:15.474 clat (usec): min=1045, max=8439, avg=4545.64, stdev=747.45 00:32:15.474 lat (usec): min=1059, max=8461, avg=4564.48, stdev=747.32 00:32:15.474 clat percentiles (usec): 00:32:15.474 | 1.00th=[ 2409], 5.00th=[ 3556], 10.00th=[ 3851], 20.00th=[ 4178], 00:32:15.474 | 30.00th=[ 4293], 40.00th=[ 4424], 50.00th=[ 4490], 60.00th=[ 4555], 00:32:15.474 | 70.00th=[ 4686], 80.00th=[ 4817], 90.00th=[ 5342], 95.00th=[ 5997], 00:32:15.474 | 99.00th=[ 7111], 99.50th=[ 7439], 99.90th=[ 8094], 99.95th=[ 8160], 00:32:15.474 | 99.99th=[ 8455] 00:32:15.474 bw ( KiB/s): min=13600, max=14096, per=24.90%, avg=13866.67, stdev=161.99, samples=9 00:32:15.474 iops : min= 1700, max= 1762, avg=1733.33, stdev=20.25, samples=9 00:32:15.474 lat (msec) : 2=0.51%, 4=12.28%, 10=87.21% 00:32:15.474 cpu : usr=93.60%, sys=4.38%, ctx=189, majf=0, minf=9 00:32:15.474 IO depths : 1=0.3%, 2=16.4%, 4=56.0%, 8=27.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:15.474 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:15.474 issued rwts: total=8671,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:15.474 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:15.474 00:32:15.474 Run status group 0 (all jobs): 00:32:15.474 READ: bw=54.4MiB/s (57.0MB/s), 13.0MiB/s-14.2MiB/s (13.6MB/s-14.9MB/s), io=272MiB (285MB), run=5001-5003msec 00:32:15.474 15:27:14 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:15.474 15:27:14 -- target/dif.sh@43 -- # local sub 00:32:15.474 15:27:14 -- target/dif.sh@45 -- # for sub in "$@" 00:32:15.474 15:27:14 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:15.474 15:27:14 -- target/dif.sh@36 -- # local sub_id=0 00:32:15.475 15:27:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:15.475 15:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 15:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:15.475 15:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 15:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:14 -- target/dif.sh@45 -- # for sub in "$@" 00:32:15.475 15:27:14 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:15.475 15:27:14 -- target/dif.sh@36 -- # local sub_id=1 00:32:15.475 15:27:14 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:15.475 15:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 15:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:14 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:15.475 15:27:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 15:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 00:32:15.475 real 0m24.112s 00:32:15.475 user 4m36.140s 00:32:15.475 sys 0m4.805s 00:32:15.475 15:27:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:15.475 15:27:14 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 ************************************ 00:32:15.475 END TEST fio_dif_rand_params 00:32:15.475 ************************************ 00:32:15.475 15:27:15 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:15.475 15:27:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:15.475 15:27:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:15.475 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 ************************************ 00:32:15.475 START TEST fio_dif_digest 00:32:15.475 ************************************ 00:32:15.475 15:27:15 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:15.475 15:27:15 -- target/dif.sh@123 -- # local NULL_DIF 00:32:15.475 15:27:15 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:15.475 15:27:15 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:15.475 15:27:15 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:15.475 15:27:15 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:15.475 15:27:15 -- target/dif.sh@127 -- # numjobs=3 00:32:15.475 15:27:15 -- target/dif.sh@127 -- # iodepth=3 00:32:15.475 15:27:15 -- target/dif.sh@127 -- # runtime=10 00:32:15.475 15:27:15 -- target/dif.sh@128 -- # hdgst=true 00:32:15.475 15:27:15 -- target/dif.sh@128 -- # ddgst=true 00:32:15.475 15:27:15 -- target/dif.sh@130 -- # create_subsystems 0 00:32:15.475 15:27:15 -- target/dif.sh@28 -- # local sub 00:32:15.475 15:27:15 -- target/dif.sh@30 -- # for sub in "$@" 00:32:15.475 15:27:15 -- target/dif.sh@31 -- # create_subsystem 0 00:32:15.475 15:27:15 -- target/dif.sh@18 -- # local sub_id=0 00:32:15.475 15:27:15 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:15.475 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 bdev_null0 00:32:15.475 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:15 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:15.475 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:15 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:15.475 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:15 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:15.475 15:27:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.475 15:27:15 -- common/autotest_common.sh@10 -- # set +x 00:32:15.475 [2024-11-28 15:27:15.039977] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:15.475 15:27:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.475 15:27:15 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:15.475 15:27:15 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:15.475 15:27:15 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:15.475 15:27:15 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:15.475 15:27:15 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:15.475 15:27:15 -- target/dif.sh@82 -- # gen_fio_conf 00:32:15.475 15:27:15 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:15.475 15:27:15 -- nvmf/common.sh@520 -- # config=() 00:32:15.475 15:27:15 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:15.475 15:27:15 -- nvmf/common.sh@520 -- # local subsystem config 00:32:15.475 15:27:15 -- target/dif.sh@54 -- # local file 00:32:15.475 15:27:15 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:15.475 15:27:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:15.475 15:27:15 -- target/dif.sh@56 -- # cat 00:32:15.475 15:27:15 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:15.475 15:27:15 -- common/autotest_common.sh@1330 -- # shift 00:32:15.475 15:27:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:15.475 { 00:32:15.475 "params": { 00:32:15.475 "name": "Nvme$subsystem", 00:32:15.475 "trtype": "$TEST_TRANSPORT", 00:32:15.475 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:15.475 "adrfam": "ipv4", 00:32:15.475 "trsvcid": "$NVMF_PORT", 00:32:15.475 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:15.475 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:15.475 "hdgst": ${hdgst:-false}, 00:32:15.475 "ddgst": ${ddgst:-false} 00:32:15.475 }, 00:32:15.475 "method": "bdev_nvme_attach_controller" 00:32:15.475 } 00:32:15.475 EOF 00:32:15.475 )") 00:32:15.475 15:27:15 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:15.475 15:27:15 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:15.475 15:27:15 -- nvmf/common.sh@542 -- # cat 00:32:15.475 15:27:15 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:15.475 15:27:15 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:15.475 15:27:15 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:15.475 15:27:15 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:15.475 15:27:15 -- target/dif.sh@72 -- # (( file <= files )) 00:32:15.475 15:27:15 -- nvmf/common.sh@544 -- # jq . 00:32:15.475 15:27:15 -- nvmf/common.sh@545 -- # IFS=, 00:32:15.475 15:27:15 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:15.475 "params": { 00:32:15.475 "name": "Nvme0", 00:32:15.475 "trtype": "tcp", 00:32:15.475 "traddr": "10.0.0.2", 00:32:15.475 "adrfam": "ipv4", 00:32:15.475 "trsvcid": "4420", 00:32:15.475 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:15.475 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:15.475 "hdgst": true, 00:32:15.475 "ddgst": true 00:32:15.475 }, 00:32:15.475 "method": "bdev_nvme_attach_controller" 00:32:15.475 }' 00:32:15.475 15:27:15 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:15.476 15:27:15 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:15.476 15:27:15 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:15.476 15:27:15 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:15.476 15:27:15 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:15.476 15:27:15 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:15.476 15:27:15 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:15.476 15:27:15 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:15.476 15:27:15 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:15.476 15:27:15 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:15.476 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:15.476 ... 00:32:15.476 fio-3.35 00:32:15.476 Starting 3 threads 00:32:15.476 EAL: No free 2048 kB hugepages reported on node 1 00:32:15.735 [2024-11-28 15:27:15.751172] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:15.735 [2024-11-28 15:27:15.751267] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:25.707 00:32:25.707 filename0: (groupid=0, jobs=1): err= 0: pid=858553: Thu Nov 28 15:27:25 2024 00:32:25.707 read: IOPS=198, BW=24.8MiB/s (26.0MB/s)(249MiB/10047msec) 00:32:25.707 slat (nsec): min=6774, max=47803, avg=14399.60, stdev=3902.81 00:32:25.707 clat (usec): min=11512, max=58233, avg=15090.96, stdev=2242.58 00:32:25.707 lat (usec): min=11525, max=58246, avg=15105.36, stdev=2242.76 00:32:25.707 clat percentiles (usec): 00:32:25.707 | 1.00th=[12649], 5.00th=[13304], 10.00th=[13698], 20.00th=[14091], 00:32:25.707 | 30.00th=[14484], 40.00th=[14746], 50.00th=[15008], 60.00th=[15270], 00:32:25.707 | 70.00th=[15533], 80.00th=[15795], 90.00th=[16319], 95.00th=[16712], 00:32:25.707 | 99.00th=[17695], 99.50th=[17957], 99.90th=[57934], 99.95th=[58459], 00:32:25.707 | 99.99th=[58459] 00:32:25.707 bw ( KiB/s): min=22528, max=26624, per=32.85%, avg=25461.65, stdev=913.00, samples=20 00:32:25.707 iops : min= 176, max= 208, avg=198.90, stdev= 7.15, samples=20 00:32:25.707 lat (msec) : 20=99.60%, 50=0.25%, 100=0.15% 00:32:25.707 cpu : usr=93.94%, sys=5.55%, ctx=23, majf=0, minf=181 00:32:25.707 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.707 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.707 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.707 issued rwts: total=1992,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.707 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:25.707 filename0: (groupid=0, jobs=1): err= 0: pid=858554: Thu Nov 28 15:27:25 2024 00:32:25.707 read: IOPS=196, BW=24.6MiB/s (25.8MB/s)(246MiB/10006msec) 00:32:25.707 slat (nsec): min=6980, max=64077, avg=14824.26, stdev=4134.76 00:32:25.707 clat (usec): min=8467, max=19430, avg=15232.58, stdev=1176.65 00:32:25.707 lat (usec): min=8479, max=19449, avg=15247.40, stdev=1176.97 00:32:25.707 clat percentiles (usec): 00:32:25.707 | 1.00th=[12387], 5.00th=[13435], 10.00th=[13829], 20.00th=[14353], 00:32:25.707 | 30.00th=[14615], 40.00th=[15008], 50.00th=[15270], 60.00th=[15533], 00:32:25.707 | 70.00th=[15795], 80.00th=[16188], 90.00th=[16712], 95.00th=[17171], 00:32:25.707 | 99.00th=[17957], 99.50th=[18220], 99.90th=[19006], 99.95th=[19530], 00:32:25.707 | 99.99th=[19530] 00:32:25.707 bw ( KiB/s): min=23808, max=26880, per=32.47%, avg=25164.80, stdev=940.05, samples=20 00:32:25.707 iops : min= 186, max= 210, avg=196.60, stdev= 7.34, samples=20 00:32:25.707 lat (msec) : 10=0.15%, 20=99.85% 00:32:25.707 cpu : usr=93.28%, sys=6.24%, ctx=22, majf=0, minf=212 00:32:25.707 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.707 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.707 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.707 issued rwts: total=1968,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.707 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:25.707 filename0: (groupid=0, jobs=1): err= 0: pid=858555: Thu Nov 28 15:27:25 2024 00:32:25.707 read: IOPS=211, BW=26.4MiB/s (27.7MB/s)(265MiB/10046msec) 00:32:25.707 slat (nsec): min=4954, max=61636, avg=16066.33, stdev=5876.25 00:32:25.707 clat (usec): min=8709, max=51893, avg=14155.27, stdev=1528.09 00:32:25.707 lat (usec): min=8730, max=51906, avg=14171.34, stdev=1528.20 00:32:25.707 clat percentiles (usec): 00:32:25.707 | 1.00th=[11469], 5.00th=[12387], 10.00th=[12780], 20.00th=[13304], 00:32:25.707 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[14484], 00:32:25.707 | 70.00th=[14615], 80.00th=[15008], 90.00th=[15401], 95.00th=[15664], 00:32:25.707 | 99.00th=[16319], 99.50th=[16712], 99.90th=[17171], 99.95th=[50594], 00:32:25.707 | 99.99th=[51643] 00:32:25.707 bw ( KiB/s): min=26112, max=28672, per=35.03%, avg=27148.80, stdev=677.19, samples=20 00:32:25.707 iops : min= 204, max= 224, avg=212.10, stdev= 5.29, samples=20 00:32:25.707 lat (msec) : 10=0.24%, 20=99.67%, 100=0.09% 00:32:25.707 cpu : usr=91.65%, sys=7.00%, ctx=294, majf=0, minf=84 00:32:25.707 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:25.707 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.708 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:25.708 issued rwts: total=2123,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:25.708 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:25.708 00:32:25.708 Run status group 0 (all jobs): 00:32:25.708 READ: bw=75.7MiB/s (79.4MB/s), 24.6MiB/s-26.4MiB/s (25.8MB/s-27.7MB/s), io=760MiB (797MB), run=10006-10047msec 00:32:26.275 15:27:26 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:26.275 15:27:26 -- target/dif.sh@43 -- # local sub 00:32:26.275 15:27:26 -- target/dif.sh@45 -- # for sub in "$@" 00:32:26.275 15:27:26 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:26.275 15:27:26 -- target/dif.sh@36 -- # local sub_id=0 00:32:26.275 15:27:26 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:26.275 15:27:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:26.275 15:27:26 -- common/autotest_common.sh@10 -- # set +x 00:32:26.275 15:27:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.275 15:27:26 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:26.275 15:27:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:26.275 15:27:26 -- common/autotest_common.sh@10 -- # set +x 00:32:26.275 15:27:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:26.275 00:32:26.275 real 0m11.215s 00:32:26.275 user 0m29.227s 00:32:26.275 sys 0m2.151s 00:32:26.275 15:27:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:26.275 15:27:26 -- common/autotest_common.sh@10 -- # set +x 00:32:26.275 ************************************ 00:32:26.275 END TEST fio_dif_digest 00:32:26.275 ************************************ 00:32:26.275 15:27:26 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:26.275 15:27:26 -- target/dif.sh@147 -- # nvmftestfini 00:32:26.275 15:27:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:26.275 15:27:26 -- nvmf/common.sh@116 -- # sync 00:32:26.275 15:27:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:26.275 15:27:26 -- nvmf/common.sh@119 -- # set +e 00:32:26.275 15:27:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:26.275 15:27:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:26.275 rmmod nvme_tcp 00:32:26.275 rmmod nvme_fabrics 00:32:26.275 rmmod nvme_keyring 00:32:26.275 15:27:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:26.275 15:27:26 -- nvmf/common.sh@123 -- # set -e 00:32:26.275 15:27:26 -- nvmf/common.sh@124 -- # return 0 00:32:26.275 15:27:26 -- nvmf/common.sh@477 -- # '[' -n 851477 ']' 00:32:26.275 15:27:26 -- nvmf/common.sh@478 -- # killprocess 851477 00:32:26.275 15:27:26 -- common/autotest_common.sh@936 -- # '[' -z 851477 ']' 00:32:26.275 15:27:26 -- common/autotest_common.sh@940 -- # kill -0 851477 00:32:26.275 15:27:26 -- common/autotest_common.sh@941 -- # uname 00:32:26.275 15:27:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:26.275 15:27:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 851477 00:32:26.275 15:27:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:26.275 15:27:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:26.275 15:27:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 851477' 00:32:26.275 killing process with pid 851477 00:32:26.275 15:27:26 -- common/autotest_common.sh@955 -- # kill 851477 00:32:26.275 15:27:26 -- common/autotest_common.sh@960 -- # wait 851477 00:32:26.534 15:27:26 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:26.534 15:27:26 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:27.471 Waiting for block devices as requested 00:32:27.730 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:27.730 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:27.730 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:27.989 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:27.989 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:27.989 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:28.256 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:28.256 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:28.256 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:28.256 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:28.582 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:28.582 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:28.582 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:28.582 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:28.582 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:28.859 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:28.859 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:28.859 15:27:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:28.859 15:27:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:28.859 15:27:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:28.859 15:27:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:28.859 15:27:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:28.859 15:27:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:28.859 15:27:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:30.766 15:27:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:30.766 00:32:30.766 real 1m7.519s 00:32:30.766 user 6m33.259s 00:32:30.766 sys 0m16.153s 00:32:30.766 15:27:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:30.766 15:27:30 -- common/autotest_common.sh@10 -- # set +x 00:32:30.766 ************************************ 00:32:30.766 END TEST nvmf_dif 00:32:30.766 ************************************ 00:32:31.023 15:27:31 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:31.023 15:27:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:31.023 15:27:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:31.023 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:32:31.023 ************************************ 00:32:31.023 START TEST nvmf_abort_qd_sizes 00:32:31.023 ************************************ 00:32:31.023 15:27:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:31.023 * Looking for test storage... 00:32:31.023 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:31.023 15:27:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:31.023 15:27:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:31.023 15:27:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:31.023 15:27:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:31.023 15:27:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:31.023 15:27:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:31.023 15:27:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:31.023 15:27:31 -- scripts/common.sh@335 -- # IFS=.-: 00:32:31.023 15:27:31 -- scripts/common.sh@335 -- # read -ra ver1 00:32:31.023 15:27:31 -- scripts/common.sh@336 -- # IFS=.-: 00:32:31.023 15:27:31 -- scripts/common.sh@336 -- # read -ra ver2 00:32:31.023 15:27:31 -- scripts/common.sh@337 -- # local 'op=<' 00:32:31.023 15:27:31 -- scripts/common.sh@339 -- # ver1_l=2 00:32:31.023 15:27:31 -- scripts/common.sh@340 -- # ver2_l=1 00:32:31.023 15:27:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:31.023 15:27:31 -- scripts/common.sh@343 -- # case "$op" in 00:32:31.023 15:27:31 -- scripts/common.sh@344 -- # : 1 00:32:31.023 15:27:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:31.023 15:27:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:31.023 15:27:31 -- scripts/common.sh@364 -- # decimal 1 00:32:31.023 15:27:31 -- scripts/common.sh@352 -- # local d=1 00:32:31.023 15:27:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:31.023 15:27:31 -- scripts/common.sh@354 -- # echo 1 00:32:31.023 15:27:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:31.023 15:27:31 -- scripts/common.sh@365 -- # decimal 2 00:32:31.023 15:27:31 -- scripts/common.sh@352 -- # local d=2 00:32:31.023 15:27:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:31.023 15:27:31 -- scripts/common.sh@354 -- # echo 2 00:32:31.023 15:27:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:31.023 15:27:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:31.023 15:27:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:31.023 15:27:31 -- scripts/common.sh@367 -- # return 0 00:32:31.023 15:27:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:31.023 15:27:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:31.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:31.023 --rc genhtml_branch_coverage=1 00:32:31.023 --rc genhtml_function_coverage=1 00:32:31.023 --rc genhtml_legend=1 00:32:31.023 --rc geninfo_all_blocks=1 00:32:31.023 --rc geninfo_unexecuted_blocks=1 00:32:31.023 00:32:31.023 ' 00:32:31.023 15:27:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:31.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:31.023 --rc genhtml_branch_coverage=1 00:32:31.023 --rc genhtml_function_coverage=1 00:32:31.023 --rc genhtml_legend=1 00:32:31.023 --rc geninfo_all_blocks=1 00:32:31.023 --rc geninfo_unexecuted_blocks=1 00:32:31.023 00:32:31.023 ' 00:32:31.023 15:27:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:31.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:31.023 --rc genhtml_branch_coverage=1 00:32:31.023 --rc genhtml_function_coverage=1 00:32:31.023 --rc genhtml_legend=1 00:32:31.023 --rc geninfo_all_blocks=1 00:32:31.023 --rc geninfo_unexecuted_blocks=1 00:32:31.023 00:32:31.023 ' 00:32:31.023 15:27:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:31.023 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:31.023 --rc genhtml_branch_coverage=1 00:32:31.023 --rc genhtml_function_coverage=1 00:32:31.023 --rc genhtml_legend=1 00:32:31.023 --rc geninfo_all_blocks=1 00:32:31.023 --rc geninfo_unexecuted_blocks=1 00:32:31.023 00:32:31.023 ' 00:32:31.023 15:27:31 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:31.023 15:27:31 -- nvmf/common.sh@7 -- # uname -s 00:32:31.023 15:27:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:31.023 15:27:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:31.023 15:27:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:31.023 15:27:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:31.023 15:27:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:31.023 15:27:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:31.023 15:27:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:31.023 15:27:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:31.023 15:27:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:31.023 15:27:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:31.023 15:27:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:31.023 15:27:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:31.023 15:27:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:31.023 15:27:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:31.023 15:27:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:31.023 15:27:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:31.023 15:27:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:31.023 15:27:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:31.023 15:27:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:31.023 15:27:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.023 15:27:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.023 15:27:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.023 15:27:31 -- paths/export.sh@5 -- # export PATH 00:32:31.023 15:27:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:31.023 15:27:31 -- nvmf/common.sh@46 -- # : 0 00:32:31.023 15:27:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:31.023 15:27:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:31.023 15:27:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:31.023 15:27:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:31.023 15:27:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:31.023 15:27:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:31.023 15:27:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:31.023 15:27:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:31.023 15:27:31 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:31.023 15:27:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:31.023 15:27:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:31.023 15:27:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:31.023 15:27:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:31.023 15:27:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:31.023 15:27:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:31.023 15:27:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:31.023 15:27:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:31.023 15:27:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:31.023 15:27:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:31.023 15:27:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:31.023 15:27:31 -- common/autotest_common.sh@10 -- # set +x 00:32:33.559 15:27:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:33.559 15:27:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:33.559 15:27:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:33.559 15:27:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:33.559 15:27:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:33.559 15:27:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:33.559 15:27:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:33.559 15:27:33 -- nvmf/common.sh@294 -- # net_devs=() 00:32:33.559 15:27:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:33.559 15:27:33 -- nvmf/common.sh@295 -- # e810=() 00:32:33.559 15:27:33 -- nvmf/common.sh@295 -- # local -ga e810 00:32:33.559 15:27:33 -- nvmf/common.sh@296 -- # x722=() 00:32:33.559 15:27:33 -- nvmf/common.sh@296 -- # local -ga x722 00:32:33.559 15:27:33 -- nvmf/common.sh@297 -- # mlx=() 00:32:33.559 15:27:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:33.559 15:27:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:33.559 15:27:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:33.560 15:27:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:33.560 15:27:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:33.560 15:27:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:33.560 15:27:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:33.560 15:27:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:33.560 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:33.560 15:27:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:33.560 15:27:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:33.560 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:33.560 15:27:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:33.560 15:27:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:33.560 15:27:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:33.560 15:27:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:33.560 15:27:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:33.560 15:27:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:33.560 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:33.560 15:27:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:33.560 15:27:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:33.560 15:27:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:33.560 15:27:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:33.560 15:27:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:33.560 15:27:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:33.560 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:33.560 15:27:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:33.560 15:27:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:33.560 15:27:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:33.560 15:27:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:33.560 15:27:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:33.560 15:27:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:33.560 15:27:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:33.560 15:27:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:33.560 15:27:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:33.560 15:27:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:33.560 15:27:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:33.560 15:27:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:33.560 15:27:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:33.560 15:27:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:33.560 15:27:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:33.560 15:27:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:33.560 15:27:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:33.560 15:27:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:33.560 15:27:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:33.560 15:27:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:33.560 15:27:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:33.560 15:27:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:33.560 15:27:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:33.560 15:27:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:33.560 15:27:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:33.560 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:33.560 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.280 ms 00:32:33.560 00:32:33.560 --- 10.0.0.2 ping statistics --- 00:32:33.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:33.560 rtt min/avg/max/mdev = 0.280/0.280/0.280/0.000 ms 00:32:33.560 15:27:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:33.560 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:33.560 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:32:33.560 00:32:33.560 --- 10.0.0.1 ping statistics --- 00:32:33.560 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:33.560 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:32:33.560 15:27:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:33.560 15:27:33 -- nvmf/common.sh@410 -- # return 0 00:32:33.560 15:27:33 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:33.560 15:27:33 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:34.496 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:34.496 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:34.496 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:35.439 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:35.698 15:27:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:35.698 15:27:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:35.698 15:27:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:35.698 15:27:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:35.698 15:27:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:35.698 15:27:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:35.698 15:27:35 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:35.698 15:27:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:35.698 15:27:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:35.698 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:32:35.698 15:27:35 -- nvmf/common.sh@469 -- # nvmfpid=863457 00:32:35.698 15:27:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:35.698 15:27:35 -- nvmf/common.sh@470 -- # waitforlisten 863457 00:32:35.698 15:27:35 -- common/autotest_common.sh@829 -- # '[' -z 863457 ']' 00:32:35.698 15:27:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:35.698 15:27:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:35.698 15:27:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:35.698 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:35.698 15:27:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:35.698 15:27:35 -- common/autotest_common.sh@10 -- # set +x 00:32:35.698 [2024-11-28 15:27:35.803215] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... 00:32:35.698 [2024-11-28 15:27:35.803294] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:35.698 EAL: No free 2048 kB hugepages reported on node 1 00:32:35.698 [2024-11-28 15:27:35.874240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:35.958 [2024-11-28 15:27:35.970554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:35.958 [2024-11-28 15:27:35.970685] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:35.958 [2024-11-28 15:27:35.970701] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:35.958 [2024-11-28 15:27:35.970712] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:35.958 [2024-11-28 15:27:35.970762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:35.958 [2024-11-28 15:27:35.970788] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:35.958 [2024-11-28 15:27:35.970841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:35.958 [2024-11-28 15:27:35.970844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:36.892 15:27:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:36.892 15:27:36 -- common/autotest_common.sh@862 -- # return 0 00:32:36.892 15:27:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:36.892 15:27:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:36.892 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:32:36.892 15:27:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:36.892 15:27:36 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:36.892 15:27:36 -- scripts/common.sh@312 -- # local nvmes 00:32:36.892 15:27:36 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:36.892 15:27:36 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:36.892 15:27:36 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:36.892 15:27:36 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:36.892 15:27:36 -- scripts/common.sh@322 -- # uname -s 00:32:36.892 15:27:36 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:36.892 15:27:36 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:36.892 15:27:36 -- scripts/common.sh@327 -- # (( 1 )) 00:32:36.892 15:27:36 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:36.892 15:27:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:36.892 15:27:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:36.892 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:32:36.892 ************************************ 00:32:36.892 START TEST spdk_target_abort 00:32:36.892 ************************************ 00:32:36.892 15:27:36 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:36.892 15:27:36 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:36.892 15:27:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:36.892 15:27:36 -- common/autotest_common.sh@10 -- # set +x 00:32:40.181 spdk_targetn1 00:32:40.181 15:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:40.181 15:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.181 15:27:39 -- common/autotest_common.sh@10 -- # set +x 00:32:40.181 [2024-11-28 15:27:39.681247] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:40.181 15:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:40.181 15:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.181 15:27:39 -- common/autotest_common.sh@10 -- # set +x 00:32:40.181 15:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:40.181 15:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.181 15:27:39 -- common/autotest_common.sh@10 -- # set +x 00:32:40.181 15:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:40.181 15:27:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:40.181 15:27:39 -- common/autotest_common.sh@10 -- # set +x 00:32:40.181 [2024-11-28 15:27:39.713538] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:40.181 15:27:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:40.181 15:27:39 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:40.181 EAL: No free 2048 kB hugepages reported on node 1 00:32:43.469 Initializing NVMe Controllers 00:32:43.469 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:43.469 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:43.469 Initialization complete. Launching workers. 00:32:43.469 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 11553, failed: 0 00:32:43.469 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1239, failed to submit 10314 00:32:43.469 success 718, unsuccess 521, failed 0 00:32:43.469 15:27:42 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:43.469 15:27:42 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:43.469 EAL: No free 2048 kB hugepages reported on node 1 00:32:46.006 Initializing NVMe Controllers 00:32:46.006 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:46.006 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:46.006 Initialization complete. Launching workers. 00:32:46.006 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8607, failed: 0 00:32:46.006 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1250, failed to submit 7357 00:32:46.006 success 309, unsuccess 941, failed 0 00:32:46.006 15:27:46 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:46.006 15:27:46 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:46.006 EAL: No free 2048 kB hugepages reported on node 1 00:32:49.295 Initializing NVMe Controllers 00:32:49.295 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:49.295 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:49.295 Initialization complete. Launching workers. 00:32:49.295 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32542, failed: 0 00:32:49.295 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2635, failed to submit 29907 00:32:49.295 success 551, unsuccess 2084, failed 0 00:32:49.295 15:27:49 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:49.295 15:27:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:49.295 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:32:49.295 15:27:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:49.295 15:27:49 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:49.295 15:27:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:49.295 15:27:49 -- common/autotest_common.sh@10 -- # set +x 00:32:50.673 15:27:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:50.673 15:27:50 -- target/abort_qd_sizes.sh@62 -- # killprocess 863457 00:32:50.673 15:27:50 -- common/autotest_common.sh@936 -- # '[' -z 863457 ']' 00:32:50.673 15:27:50 -- common/autotest_common.sh@940 -- # kill -0 863457 00:32:50.673 15:27:50 -- common/autotest_common.sh@941 -- # uname 00:32:50.673 15:27:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:50.673 15:27:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 863457 00:32:50.673 15:27:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:50.673 15:27:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:50.673 15:27:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 863457' 00:32:50.673 killing process with pid 863457 00:32:50.673 15:27:50 -- common/autotest_common.sh@955 -- # kill 863457 00:32:50.673 15:27:50 -- common/autotest_common.sh@960 -- # wait 863457 00:32:50.933 00:32:50.933 real 0m14.147s 00:32:50.933 user 0m56.264s 00:32:50.933 sys 0m2.555s 00:32:50.933 15:27:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:50.933 15:27:50 -- common/autotest_common.sh@10 -- # set +x 00:32:50.933 ************************************ 00:32:50.933 END TEST spdk_target_abort 00:32:50.933 ************************************ 00:32:50.933 15:27:51 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:50.933 15:27:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:50.933 15:27:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:50.933 15:27:51 -- common/autotest_common.sh@10 -- # set +x 00:32:50.933 ************************************ 00:32:50.933 START TEST kernel_target_abort 00:32:50.933 ************************************ 00:32:50.933 15:27:51 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:50.933 15:27:51 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:50.933 15:27:51 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:50.933 15:27:51 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:50.933 15:27:51 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:50.933 15:27:51 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:50.933 15:27:51 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:50.933 15:27:51 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:50.933 15:27:51 -- nvmf/common.sh@627 -- # local block nvme 00:32:50.933 15:27:51 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:50.933 15:27:51 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:50.933 15:27:51 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:50.933 15:27:51 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:51.871 Waiting for block devices as requested 00:32:52.129 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:52.129 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:52.129 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:52.387 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:52.387 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:52.387 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:52.387 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:52.646 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:52.646 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:52.646 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:52.646 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:52.905 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:52.905 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:52.905 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:52.905 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:53.164 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:53.164 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:53.164 15:27:53 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:53.164 15:27:53 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:53.164 15:27:53 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:53.164 15:27:53 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:53.164 15:27:53 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:53.424 No valid GPT data, bailing 00:32:53.424 15:27:53 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:53.424 15:27:53 -- scripts/common.sh@393 -- # pt= 00:32:53.424 15:27:53 -- scripts/common.sh@394 -- # return 1 00:32:53.424 15:27:53 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:53.424 15:27:53 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:53.424 15:27:53 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:53.424 15:27:53 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:53.424 15:27:53 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:53.424 15:27:53 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:53.424 15:27:53 -- nvmf/common.sh@654 -- # echo 1 00:32:53.424 15:27:53 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:53.424 15:27:53 -- nvmf/common.sh@656 -- # echo 1 00:32:53.424 15:27:53 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:53.424 15:27:53 -- nvmf/common.sh@663 -- # echo tcp 00:32:53.424 15:27:53 -- nvmf/common.sh@664 -- # echo 4420 00:32:53.424 15:27:53 -- nvmf/common.sh@665 -- # echo ipv4 00:32:53.424 15:27:53 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:53.424 15:27:53 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:53.424 00:32:53.424 Discovery Log Number of Records 2, Generation counter 2 00:32:53.424 =====Discovery Log Entry 0====== 00:32:53.424 trtype: tcp 00:32:53.424 adrfam: ipv4 00:32:53.424 subtype: current discovery subsystem 00:32:53.424 treq: not specified, sq flow control disable supported 00:32:53.424 portid: 1 00:32:53.424 trsvcid: 4420 00:32:53.424 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:53.424 traddr: 10.0.0.1 00:32:53.424 eflags: none 00:32:53.424 sectype: none 00:32:53.424 =====Discovery Log Entry 1====== 00:32:53.424 trtype: tcp 00:32:53.424 adrfam: ipv4 00:32:53.424 subtype: nvme subsystem 00:32:53.424 treq: not specified, sq flow control disable supported 00:32:53.424 portid: 1 00:32:53.424 trsvcid: 4420 00:32:53.424 subnqn: kernel_target 00:32:53.424 traddr: 10.0.0.1 00:32:53.424 eflags: none 00:32:53.424 sectype: none 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:53.424 15:27:53 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:53.424 EAL: No free 2048 kB hugepages reported on node 1 00:32:56.712 Initializing NVMe Controllers 00:32:56.712 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:56.712 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:56.712 Initialization complete. Launching workers. 00:32:56.712 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 46833, failed: 0 00:32:56.712 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 46833, failed to submit 0 00:32:56.712 success 0, unsuccess 46833, failed 0 00:32:56.712 15:27:56 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:56.712 15:27:56 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:56.712 EAL: No free 2048 kB hugepages reported on node 1 00:32:59.993 Initializing NVMe Controllers 00:32:59.993 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:59.993 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:59.993 Initialization complete. Launching workers. 00:32:59.993 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 83041, failed: 0 00:32:59.993 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20942, failed to submit 62099 00:32:59.993 success 0, unsuccess 20942, failed 0 00:32:59.993 15:27:59 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:59.993 15:27:59 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:59.993 EAL: No free 2048 kB hugepages reported on node 1 00:33:03.294 Initializing NVMe Controllers 00:33:03.294 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:33:03.294 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:33:03.294 Initialization complete. Launching workers. 00:33:03.294 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81077, failed: 0 00:33:03.294 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20254, failed to submit 60823 00:33:03.294 success 0, unsuccess 20254, failed 0 00:33:03.294 15:28:02 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:33:03.294 15:28:02 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:33:03.294 15:28:02 -- nvmf/common.sh@677 -- # echo 0 00:33:03.294 15:28:02 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:33:03.294 15:28:02 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:33:03.294 15:28:02 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:33:03.294 15:28:02 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:33:03.294 15:28:02 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:33:03.294 15:28:02 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:33:03.294 00:33:03.294 real 0m11.908s 00:33:03.294 user 0m5.925s 00:33:03.294 sys 0m2.318s 00:33:03.294 15:28:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:03.294 15:28:02 -- common/autotest_common.sh@10 -- # set +x 00:33:03.294 ************************************ 00:33:03.294 END TEST kernel_target_abort 00:33:03.294 ************************************ 00:33:03.294 15:28:02 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:33:03.294 15:28:02 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:33:03.294 15:28:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:33:03.294 15:28:02 -- nvmf/common.sh@116 -- # sync 00:33:03.294 15:28:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:33:03.294 15:28:02 -- nvmf/common.sh@119 -- # set +e 00:33:03.294 15:28:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:33:03.294 15:28:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:33:03.294 rmmod nvme_tcp 00:33:03.294 rmmod nvme_fabrics 00:33:03.294 rmmod nvme_keyring 00:33:03.294 15:28:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:33:03.294 15:28:03 -- nvmf/common.sh@123 -- # set -e 00:33:03.294 15:28:03 -- nvmf/common.sh@124 -- # return 0 00:33:03.294 15:28:03 -- nvmf/common.sh@477 -- # '[' -n 863457 ']' 00:33:03.294 15:28:03 -- nvmf/common.sh@478 -- # killprocess 863457 00:33:03.294 15:28:03 -- common/autotest_common.sh@936 -- # '[' -z 863457 ']' 00:33:03.294 15:28:03 -- common/autotest_common.sh@940 -- # kill -0 863457 00:33:03.294 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (863457) - No such process 00:33:03.294 15:28:03 -- common/autotest_common.sh@963 -- # echo 'Process with pid 863457 is not found' 00:33:03.294 Process with pid 863457 is not found 00:33:03.294 15:28:03 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:33:03.294 15:28:03 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:33:04.235 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:04.235 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:04.235 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:04.235 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:04.235 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:04.235 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:04.235 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:04.235 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:04.235 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:04.235 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:04.235 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:04.235 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:04.235 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:04.235 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:04.236 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:04.236 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:04.236 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:04.236 15:28:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:33:04.236 15:28:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:33:04.236 15:28:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:33:04.236 15:28:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:33:04.236 15:28:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:33:04.236 15:28:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:33:04.236 15:28:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:06.779 15:28:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:06.779 00:33:06.779 real 0m35.402s 00:33:06.779 user 1m4.681s 00:33:06.779 sys 0m8.346s 00:33:06.779 15:28:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:06.779 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:33:06.779 ************************************ 00:33:06.779 END TEST nvmf_abort_qd_sizes 00:33:06.779 ************************************ 00:33:06.779 15:28:06 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:06.779 15:28:06 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:06.779 15:28:06 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:06.779 15:28:06 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:06.779 15:28:06 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:06.779 15:28:06 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:06.779 15:28:06 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:06.779 15:28:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:06.779 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:33:06.779 15:28:06 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:06.779 15:28:06 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:06.779 15:28:06 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:06.779 15:28:06 -- common/autotest_common.sh@10 -- # set +x 00:33:08.159 INFO: APP EXITING 00:33:08.159 INFO: killing all VMs 00:33:08.159 INFO: killing vhost app 00:33:08.159 INFO: EXIT DONE 00:33:09.091 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:09.351 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:09.351 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:09.351 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:09.351 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:09.351 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:09.351 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:09.351 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:09.351 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:09.351 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:09.351 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:09.351 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:09.351 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:09.351 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:09.351 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:09.351 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:09.351 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:10.738 Cleaning 00:33:10.738 Removing: /var/run/dpdk/spdk0/config 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:10.738 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:10.738 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:10.738 Removing: /var/run/dpdk/spdk1/config 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:10.738 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:10.738 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:10.738 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:10.738 Removing: /var/run/dpdk/spdk2/config 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:10.738 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:10.738 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:10.738 Removing: /var/run/dpdk/spdk3/config 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:10.738 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:10.738 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:10.738 Removing: /var/run/dpdk/spdk4/config 00:33:10.738 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:10.738 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:10.738 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:10.738 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:10.738 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:10.739 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:10.739 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:10.739 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:10.739 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:10.739 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:10.739 Removing: /dev/shm/bdev_svc_trace.1 00:33:10.739 Removing: /dev/shm/nvmf_trace.0 00:33:10.739 Removing: /dev/shm/spdk_tgt_trace.pid584452 00:33:10.739 Removing: /var/run/dpdk/spdk0 00:33:10.739 Removing: /var/run/dpdk/spdk1 00:33:10.739 Removing: /var/run/dpdk/spdk2 00:33:10.739 Removing: /var/run/dpdk/spdk3 00:33:10.739 Removing: /var/run/dpdk/spdk4 00:33:10.739 Removing: /var/run/dpdk/spdk_pid582741 00:33:10.739 Removing: /var/run/dpdk/spdk_pid583505 00:33:10.739 Removing: /var/run/dpdk/spdk_pid584452 00:33:10.739 Removing: /var/run/dpdk/spdk_pid584958 00:33:10.739 Removing: /var/run/dpdk/spdk_pid586193 00:33:11.049 Removing: /var/run/dpdk/spdk_pid587261 00:33:11.049 Removing: /var/run/dpdk/spdk_pid587457 00:33:11.049 Removing: /var/run/dpdk/spdk_pid587790 00:33:11.049 Removing: /var/run/dpdk/spdk_pid588014 00:33:11.049 Removing: /var/run/dpdk/spdk_pid588341 00:33:11.049 Removing: /var/run/dpdk/spdk_pid588500 00:33:11.049 Removing: /var/run/dpdk/spdk_pid588654 00:33:11.049 Removing: /var/run/dpdk/spdk_pid588854 00:33:11.049 Removing: /var/run/dpdk/spdk_pid589440 00:33:11.049 Removing: /var/run/dpdk/spdk_pid591867 00:33:11.049 Removing: /var/run/dpdk/spdk_pid592169 00:33:11.049 Removing: /var/run/dpdk/spdk_pid592456 00:33:11.049 Removing: /var/run/dpdk/spdk_pid592480 00:33:11.049 Removing: /var/run/dpdk/spdk_pid592916 00:33:11.049 Removing: /var/run/dpdk/spdk_pid593056 00:33:11.049 Removing: /var/run/dpdk/spdk_pid593368 00:33:11.049 Removing: /var/run/dpdk/spdk_pid593508 00:33:11.049 Removing: /var/run/dpdk/spdk_pid593674 00:33:11.049 Removing: /var/run/dpdk/spdk_pid593816 00:33:11.049 Removing: /var/run/dpdk/spdk_pid593980 00:33:11.049 Removing: /var/run/dpdk/spdk_pid594124 00:33:11.049 Removing: /var/run/dpdk/spdk_pid594624 00:33:11.049 Removing: /var/run/dpdk/spdk_pid594782 00:33:11.049 Removing: /var/run/dpdk/spdk_pid594992 00:33:11.049 Removing: /var/run/dpdk/spdk_pid595165 00:33:11.049 Removing: /var/run/dpdk/spdk_pid595313 00:33:11.049 Removing: /var/run/dpdk/spdk_pid595372 00:33:11.049 Removing: /var/run/dpdk/spdk_pid595527 00:33:11.049 Removing: /var/run/dpdk/spdk_pid595794 00:33:11.049 Removing: /var/run/dpdk/spdk_pid595937 00:33:11.049 Removing: /var/run/dpdk/spdk_pid596099 00:33:11.049 Removing: /var/run/dpdk/spdk_pid596269 00:33:11.049 Removing: /var/run/dpdk/spdk_pid596515 00:33:11.049 Removing: /var/run/dpdk/spdk_pid596662 00:33:11.049 Removing: /var/run/dpdk/spdk_pid596822 00:33:11.049 Removing: /var/run/dpdk/spdk_pid596976 00:33:11.049 Removing: /var/run/dpdk/spdk_pid597249 00:33:11.049 Removing: /var/run/dpdk/spdk_pid597390 00:33:11.049 Removing: /var/run/dpdk/spdk_pid597556 00:33:11.049 Removing: /var/run/dpdk/spdk_pid597694 00:33:11.049 Removing: /var/run/dpdk/spdk_pid597978 00:33:11.049 Removing: /var/run/dpdk/spdk_pid598117 00:33:11.049 Removing: /var/run/dpdk/spdk_pid598276 00:33:11.049 Removing: /var/run/dpdk/spdk_pid598421 00:33:11.049 Removing: /var/run/dpdk/spdk_pid598699 00:33:11.049 Removing: /var/run/dpdk/spdk_pid598844 00:33:11.049 Removing: /var/run/dpdk/spdk_pid599001 00:33:11.049 Removing: /var/run/dpdk/spdk_pid599142 00:33:11.049 Removing: /var/run/dpdk/spdk_pid599426 00:33:11.049 Removing: /var/run/dpdk/spdk_pid599565 00:33:11.049 Removing: /var/run/dpdk/spdk_pid599726 00:33:11.049 Removing: /var/run/dpdk/spdk_pid599868 00:33:11.049 Removing: /var/run/dpdk/spdk_pid600141 00:33:11.049 Removing: /var/run/dpdk/spdk_pid600292 00:33:11.049 Removing: /var/run/dpdk/spdk_pid600445 00:33:11.049 Removing: /var/run/dpdk/spdk_pid600593 00:33:11.049 Removing: /var/run/dpdk/spdk_pid600868 00:33:11.049 Removing: /var/run/dpdk/spdk_pid601016 00:33:11.049 Removing: /var/run/dpdk/spdk_pid601176 00:33:11.049 Removing: /var/run/dpdk/spdk_pid601319 00:33:11.049 Removing: /var/run/dpdk/spdk_pid601605 00:33:11.049 Removing: /var/run/dpdk/spdk_pid601752 00:33:11.049 Removing: /var/run/dpdk/spdk_pid601909 00:33:11.049 Removing: /var/run/dpdk/spdk_pid602055 00:33:11.049 Removing: /var/run/dpdk/spdk_pid602332 00:33:11.049 Removing: /var/run/dpdk/spdk_pid602483 00:33:11.049 Removing: /var/run/dpdk/spdk_pid602638 00:33:11.049 Removing: /var/run/dpdk/spdk_pid602834 00:33:11.049 Removing: /var/run/dpdk/spdk_pid603047 00:33:11.049 Removing: /var/run/dpdk/spdk_pid605183 00:33:11.049 Removing: /var/run/dpdk/spdk_pid662333 00:33:11.049 Removing: /var/run/dpdk/spdk_pid665041 00:33:11.049 Removing: /var/run/dpdk/spdk_pid672728 00:33:11.049 Removing: /var/run/dpdk/spdk_pid676085 00:33:11.049 Removing: /var/run/dpdk/spdk_pid678461 00:33:11.049 Removing: /var/run/dpdk/spdk_pid679002 00:33:11.049 Removing: /var/run/dpdk/spdk_pid682770 00:33:11.049 Removing: /var/run/dpdk/spdk_pid682772 00:33:11.049 Removing: /var/run/dpdk/spdk_pid683444 00:33:11.049 Removing: /var/run/dpdk/spdk_pid684118 00:33:11.049 Removing: /var/run/dpdk/spdk_pid684684 00:33:11.049 Removing: /var/run/dpdk/spdk_pid685110 00:33:11.049 Removing: /var/run/dpdk/spdk_pid685212 00:33:11.049 Removing: /var/run/dpdk/spdk_pid685378 00:33:11.049 Removing: /var/run/dpdk/spdk_pid685508 00:33:11.049 Removing: /var/run/dpdk/spdk_pid685520 00:33:11.049 Removing: /var/run/dpdk/spdk_pid686166 00:33:11.049 Removing: /var/run/dpdk/spdk_pid686746 00:33:11.049 Removing: /var/run/dpdk/spdk_pid687421 00:33:11.049 Removing: /var/run/dpdk/spdk_pid687838 00:33:11.050 Removing: /var/run/dpdk/spdk_pid687841 00:33:11.050 Removing: /var/run/dpdk/spdk_pid688109 00:33:11.050 Removing: /var/run/dpdk/spdk_pid689029 00:33:11.050 Removing: /var/run/dpdk/spdk_pid689915 00:33:11.050 Removing: /var/run/dpdk/spdk_pid695639 00:33:11.050 Removing: /var/run/dpdk/spdk_pid695926 00:33:11.050 Removing: /var/run/dpdk/spdk_pid699117 00:33:11.050 Removing: /var/run/dpdk/spdk_pid702894 00:33:11.050 Removing: /var/run/dpdk/spdk_pid705130 00:33:11.050 Removing: /var/run/dpdk/spdk_pid711895 00:33:11.050 Removing: /var/run/dpdk/spdk_pid717314 00:33:11.050 Removing: /var/run/dpdk/spdk_pid718656 00:33:11.050 Removing: /var/run/dpdk/spdk_pid719344 00:33:11.050 Removing: /var/run/dpdk/spdk_pid729852 00:33:11.050 Removing: /var/run/dpdk/spdk_pid732115 00:33:11.050 Removing: /var/run/dpdk/spdk_pid735678 00:33:11.050 Removing: /var/run/dpdk/spdk_pid736895 00:33:11.050 Removing: /var/run/dpdk/spdk_pid738270 00:33:11.050 Removing: /var/run/dpdk/spdk_pid738478 00:33:11.050 Removing: /var/run/dpdk/spdk_pid738691 00:33:11.050 Removing: /var/run/dpdk/spdk_pid738842 00:33:11.050 Removing: /var/run/dpdk/spdk_pid739430 00:33:11.050 Removing: /var/run/dpdk/spdk_pid740817 00:33:11.050 Removing: /var/run/dpdk/spdk_pid741831 00:33:11.050 Removing: /var/run/dpdk/spdk_pid742284 00:33:11.050 Removing: /var/run/dpdk/spdk_pid745906 00:33:11.050 Removing: /var/run/dpdk/spdk_pid749367 00:33:11.050 Removing: /var/run/dpdk/spdk_pid753144 00:33:11.050 Removing: /var/run/dpdk/spdk_pid777562 00:33:11.050 Removing: /var/run/dpdk/spdk_pid780284 00:33:11.050 Removing: /var/run/dpdk/spdk_pid784123 00:33:11.050 Removing: /var/run/dpdk/spdk_pid785221 00:33:11.050 Removing: /var/run/dpdk/spdk_pid786355 00:33:11.050 Removing: /var/run/dpdk/spdk_pid788929 00:33:11.050 Removing: /var/run/dpdk/spdk_pid791460 00:33:11.050 Removing: /var/run/dpdk/spdk_pid796086 00:33:11.050 Removing: /var/run/dpdk/spdk_pid796101 00:33:11.050 Removing: /var/run/dpdk/spdk_pid799549 00:33:11.050 Removing: /var/run/dpdk/spdk_pid799695 00:33:11.050 Removing: /var/run/dpdk/spdk_pid799834 00:33:11.050 Removing: /var/run/dpdk/spdk_pid800106 00:33:11.050 Removing: /var/run/dpdk/spdk_pid800117 00:33:11.050 Removing: /var/run/dpdk/spdk_pid801223 00:33:11.050 Removing: /var/run/dpdk/spdk_pid802550 00:33:11.050 Removing: /var/run/dpdk/spdk_pid803775 00:33:11.335 Removing: /var/run/dpdk/spdk_pid804992 00:33:11.335 Removing: /var/run/dpdk/spdk_pid806211 00:33:11.335 Removing: /var/run/dpdk/spdk_pid807433 00:33:11.335 Removing: /var/run/dpdk/spdk_pid811328 00:33:11.335 Removing: /var/run/dpdk/spdk_pid811784 00:33:11.335 Removing: /var/run/dpdk/spdk_pid813100 00:33:11.335 Removing: /var/run/dpdk/spdk_pid813861 00:33:11.335 Removing: /var/run/dpdk/spdk_pid817669 00:33:11.335 Removing: /var/run/dpdk/spdk_pid819713 00:33:11.335 Removing: /var/run/dpdk/spdk_pid823450 00:33:11.335 Removing: /var/run/dpdk/spdk_pid827706 00:33:11.335 Removing: /var/run/dpdk/spdk_pid831379 00:33:11.335 Removing: /var/run/dpdk/spdk_pid831812 00:33:11.335 Removing: /var/run/dpdk/spdk_pid832340 00:33:11.335 Removing: /var/run/dpdk/spdk_pid832759 00:33:11.335 Removing: /var/run/dpdk/spdk_pid833356 00:33:11.335 Removing: /var/run/dpdk/spdk_pid833901 00:33:11.335 Removing: /var/run/dpdk/spdk_pid834338 00:33:11.335 Removing: /var/run/dpdk/spdk_pid834844 00:33:11.335 Removing: /var/run/dpdk/spdk_pid837482 00:33:11.335 Removing: /var/run/dpdk/spdk_pid837704 00:33:11.335 Removing: /var/run/dpdk/spdk_pid841568 00:33:11.335 Removing: /var/run/dpdk/spdk_pid841747 00:33:11.335 Removing: /var/run/dpdk/spdk_pid843464 00:33:11.335 Removing: /var/run/dpdk/spdk_pid848688 00:33:11.335 Removing: /var/run/dpdk/spdk_pid848693 00:33:11.335 Removing: /var/run/dpdk/spdk_pid851650 00:33:11.335 Removing: /var/run/dpdk/spdk_pid853121 00:33:11.335 Removing: /var/run/dpdk/spdk_pid854641 00:33:11.335 Removing: /var/run/dpdk/spdk_pid855413 00:33:11.335 Removing: /var/run/dpdk/spdk_pid857527 00:33:11.335 Removing: /var/run/dpdk/spdk_pid858370 00:33:11.335 Removing: /var/run/dpdk/spdk_pid863900 00:33:11.335 Removing: /var/run/dpdk/spdk_pid864303 00:33:11.335 Removing: /var/run/dpdk/spdk_pid864706 00:33:11.335 Removing: /var/run/dpdk/spdk_pid866175 00:33:11.335 Removing: /var/run/dpdk/spdk_pid866589 00:33:11.335 Removing: /var/run/dpdk/spdk_pid866997 00:33:11.335 Clean 00:33:11.335 killing process with pid 554143 00:33:19.458 killing process with pid 554140 00:33:19.716 killing process with pid 554142 00:33:19.716 killing process with pid 554141 00:33:19.716 15:28:19 -- common/autotest_common.sh@1446 -- # return 0 00:33:19.716 15:28:19 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:19.716 15:28:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:19.716 15:28:19 -- common/autotest_common.sh@10 -- # set +x 00:33:19.716 15:28:19 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:19.716 15:28:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:19.716 15:28:19 -- common/autotest_common.sh@10 -- # set +x 00:33:19.975 15:28:19 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:19.975 15:28:19 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:19.975 15:28:19 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:19.975 15:28:19 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:19.975 15:28:19 -- spdk/autotest.sh@383 -- # hostname 00:33:19.975 15:28:19 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:19.975 geninfo: WARNING: invalid characters removed from testname! 00:33:52.037 15:28:47 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:52.037 15:28:51 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:54.565 15:28:54 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:57.092 15:28:56 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:59.621 15:28:59 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:02.902 15:29:02 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:05.433 15:29:05 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:05.433 15:29:05 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:05.433 15:29:05 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:05.433 15:29:05 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:05.433 15:29:05 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:05.433 15:29:05 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:05.433 15:29:05 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:05.433 15:29:05 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:05.433 15:29:05 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:05.433 15:29:05 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:05.433 15:29:05 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:05.433 15:29:05 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:05.433 15:29:05 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:05.433 15:29:05 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:05.433 15:29:05 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:05.433 15:29:05 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:05.433 15:29:05 -- scripts/common.sh@343 -- $ case "$op" in 00:34:05.433 15:29:05 -- scripts/common.sh@344 -- $ : 1 00:34:05.433 15:29:05 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:05.433 15:29:05 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:05.433 15:29:05 -- scripts/common.sh@364 -- $ decimal 1 00:34:05.433 15:29:05 -- scripts/common.sh@352 -- $ local d=1 00:34:05.433 15:29:05 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:05.433 15:29:05 -- scripts/common.sh@354 -- $ echo 1 00:34:05.433 15:29:05 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:05.433 15:29:05 -- scripts/common.sh@365 -- $ decimal 2 00:34:05.433 15:29:05 -- scripts/common.sh@352 -- $ local d=2 00:34:05.433 15:29:05 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:05.433 15:29:05 -- scripts/common.sh@354 -- $ echo 2 00:34:05.433 15:29:05 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:05.433 15:29:05 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:05.433 15:29:05 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:05.433 15:29:05 -- scripts/common.sh@367 -- $ return 0 00:34:05.433 15:29:05 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:05.433 15:29:05 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:05.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:05.433 --rc genhtml_branch_coverage=1 00:34:05.433 --rc genhtml_function_coverage=1 00:34:05.433 --rc genhtml_legend=1 00:34:05.433 --rc geninfo_all_blocks=1 00:34:05.433 --rc geninfo_unexecuted_blocks=1 00:34:05.433 00:34:05.433 ' 00:34:05.433 15:29:05 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:05.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:05.433 --rc genhtml_branch_coverage=1 00:34:05.433 --rc genhtml_function_coverage=1 00:34:05.433 --rc genhtml_legend=1 00:34:05.433 --rc geninfo_all_blocks=1 00:34:05.433 --rc geninfo_unexecuted_blocks=1 00:34:05.433 00:34:05.433 ' 00:34:05.433 15:29:05 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:05.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:05.433 --rc genhtml_branch_coverage=1 00:34:05.433 --rc genhtml_function_coverage=1 00:34:05.433 --rc genhtml_legend=1 00:34:05.433 --rc geninfo_all_blocks=1 00:34:05.433 --rc geninfo_unexecuted_blocks=1 00:34:05.433 00:34:05.433 ' 00:34:05.433 15:29:05 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:05.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:05.433 --rc genhtml_branch_coverage=1 00:34:05.433 --rc genhtml_function_coverage=1 00:34:05.433 --rc genhtml_legend=1 00:34:05.433 --rc geninfo_all_blocks=1 00:34:05.433 --rc geninfo_unexecuted_blocks=1 00:34:05.433 00:34:05.433 ' 00:34:05.433 15:29:05 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:05.433 15:29:05 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:05.433 15:29:05 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:05.433 15:29:05 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:05.434 15:29:05 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:05.434 15:29:05 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:05.434 15:29:05 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:05.434 15:29:05 -- paths/export.sh@5 -- $ export PATH 00:34:05.434 15:29:05 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:05.434 15:29:05 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:05.434 15:29:05 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:05.434 15:29:05 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732804145.XXXXXX 00:34:05.434 15:29:05 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732804145.FohJ9h 00:34:05.434 15:29:05 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:05.434 15:29:05 -- common/autobuild_common.sh@446 -- $ '[' -n v22.11.4 ']' 00:34:05.434 15:29:05 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:05.434 15:29:05 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:05.434 15:29:05 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:05.434 15:29:05 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:05.434 15:29:05 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:05.434 15:29:05 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:05.434 15:29:05 -- common/autotest_common.sh@10 -- $ set +x 00:34:05.434 15:29:05 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:05.434 15:29:05 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:05.434 15:29:05 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:05.434 15:29:05 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:05.434 15:29:05 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:05.434 15:29:05 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:05.434 15:29:05 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:05.434 15:29:05 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:05.434 15:29:05 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:05.434 15:29:05 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:05.434 15:29:05 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:05.434 + [[ -n 499356 ]] 00:34:05.434 + sudo kill 499356 00:34:05.444 [Pipeline] } 00:34:05.459 [Pipeline] // stage 00:34:05.464 [Pipeline] } 00:34:05.478 [Pipeline] // timeout 00:34:05.484 [Pipeline] } 00:34:05.498 [Pipeline] // catchError 00:34:05.503 [Pipeline] } 00:34:05.519 [Pipeline] // wrap 00:34:05.526 [Pipeline] } 00:34:05.539 [Pipeline] // catchError 00:34:05.549 [Pipeline] stage 00:34:05.551 [Pipeline] { (Epilogue) 00:34:05.563 [Pipeline] catchError 00:34:05.565 [Pipeline] { 00:34:05.576 [Pipeline] echo 00:34:05.578 Cleanup processes 00:34:05.584 [Pipeline] sh 00:34:05.873 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:05.873 879286 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:05.888 [Pipeline] sh 00:34:06.176 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:06.176 ++ grep -v 'sudo pgrep' 00:34:06.176 ++ awk '{print $1}' 00:34:06.176 + sudo kill -9 00:34:06.176 + true 00:34:06.189 [Pipeline] sh 00:34:06.474 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:16.457 [Pipeline] sh 00:34:16.746 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:16.746 Artifacts sizes are good 00:34:16.763 [Pipeline] archiveArtifacts 00:34:16.771 Archiving artifacts 00:34:16.983 [Pipeline] sh 00:34:17.316 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:17.333 [Pipeline] cleanWs 00:34:17.344 [WS-CLEANUP] Deleting project workspace... 00:34:17.344 [WS-CLEANUP] Deferred wipeout is used... 00:34:17.351 [WS-CLEANUP] done 00:34:17.353 [Pipeline] } 00:34:17.371 [Pipeline] // catchError 00:34:17.384 [Pipeline] sh 00:34:17.677 + logger -p user.info -t JENKINS-CI 00:34:17.685 [Pipeline] } 00:34:17.699 [Pipeline] // stage 00:34:17.705 [Pipeline] } 00:34:17.719 [Pipeline] // node 00:34:17.727 [Pipeline] End of Pipeline 00:34:17.768 Finished: SUCCESS